feat(ci): refactor and parallelize integration-tests (CI review)

[pront]

Summary

Greatly simplifies the ci-integration-review.yml workflow. Also, integration tests can now run in parallel.

Change Type

• Bug fix
• New feature
• Non-functional (chore, refactoring, docs)
• Performance

Is this a breaking change?

• Yes
• No

How did you test this PR?

Does this PR include user facing changes?

• Yes. Please add a changelog fragment based on our guidelines.
• No. A maintainer will apply the "no-changelog" label to this PR.

Checklist

• Please read our Vector contributor resources.
  • make check-all is a good command to run locally. This check is
    defined here. Some of these
    checks might not be relevant to your PR. For Rust changes, at the very least you should run:
    • cargo fmt --all
    • cargo clippy --workspace --all-targets -- -D warnings
    • cargo nextest run --workspace (alternatively, you can run cargo test --all)
• If this PR introduces changes Vector dependencies (modifies Cargo.lock), please
  run dd-rust-license-tool write to regenerate the license inventory and commit the changes (if any). More details here.

References

[datadog-vectordotdev]

Datadog Report

Branch report: pront/ci-IT-parallel
Commit report: 15ffbf9
Test service: vector

✅ 0 Failed, 7 Passed, 0 Skipped, 25.43s Total Time

[pront]

/ci-run-integration-all

[pront]

Tests failed due to #22379

[jszwedko]

Nice, I've wanted to do this for a long while.