feat(integration-tests): Test compression with the CLP package.

[quinntaylormitchell]

Description

This PR implements the code that enumerates and facilitates compression test jobs that will be run on the CLP package.

Structure

Compression jobs are described with the PackageCompressJob data class. They are enumerated in clp_job_utils.py. Jobs relevant to the current test run are assembled in PackageJobList for each PackageConfig object by a central job list creator. After the relevant package is spun up, the listed jobs for that package run are dispatched from dispatch_test_jobs in test_clp_package.

All listed compression jobs are run from compress_with_clp_package. Success of compression is verified with run_and_assert.

NOTE: The code to check the correctness of this compression will be introduced in later PRs.

Command syntax

The dev running the integration test can select which jobs they'd like to run in a given test run by using the following command syntax from the integration-tests directory:

uv run pytest \
	-m 'package' \
	-k '<MODE_NAME>' \
	--job-name '<JOB_NAME_OR_SUBSTRING>'

The central job list creator will add all of the relevant jobs depending on <MODE_NAME> and '<JOB_NAME_OR_SUBSTRING>'.

A simple spin-up and spin-down without any jobs can be run with the command

uv run pytest \
	-m 'package' \
	-k '<MODE_NAME>' \
	--no-jobs

PR dependencies

This PR is built on top of the following PRs:

• feat(integration-tests): Add fixtures and tests for starting and stopping CLP packages. #1437
• feat(integration-tests): Record required components in PackageConfig based on the CLP package config. #1658
• feat(integration-tests): Validate that the components of the CLP package are running (fixes #1644). #1659
• feat(integration-tests): Validate generated package service configuration integrity. #1660
• feat(integration-tests): Add port range assignment based on a configurable base port to avoid package spin-up failures. #1662
• feat(ci): Add task for package integration tests. #1664

Dependent PRs

This is a foundational infra PR, and so there are other PRs which depend on this one. They are listed below:

• feat(integration-tests): Assert correctness of compression by decompressing with the package and comparing against original. #1665
• feat(integration-tests): Enumerate package compression jobs that test the full range of package compression functionality. #1666

Checklist

• The PR satisfies the contribution guidelines.
• This is a breaking change and that has been indicated in the PR title, OR this isn't a
  breaking change.
• Necessary docs have been updated, OR no docs need to be updated.

Validation performed

Ran all permutations of possible user commands; all succeed.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}