-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
low priorityThis should be addressed as time permitsThis should be addressed as time permitstaskTask/chore unrelated to a bug or feature requestTask/chore unrelated to a bug or feature request
Description
Description
Add code coverage to the phylum-dev/phylum-ci repository for the phylum-ci package. This is both for computing code coverage and enforcing it.
Additional Details
- Compute the code coverage automatically in a workflow
- The
Testworkflow is a likely candidate since it could also be the place to fail the build if coverage drops - Provide a report as an artifact...even when the build fails
- HINT: use the
always()logic in GHA for this
- HINT: use the
- Fail the build if coverage drops below a set threshold
- Not sure what is normal here...maybe 80% ???
- Might also be okay to just ensure coverage does not decrease
- HINT: use the actions/checkout action,
refinput to check both themainbranch and the current ref to get a diff
- HINT: use the actions/checkout action,
- The
- Expose the ability to compute coverage locally
- Adding to the test(s) tox environments is a good bet here
- Consider the
pytest-covpackage/extension for integrating easily with the existingpytestpackage
Acceptance Criteria
- Code coverage is computed automatically in CI
- Code coverage is available to be computed locally
- Code coverage is enforced in PRs via failing required checks for minimum coverage threshold
- Documentation is updated
Metadata
Metadata
Assignees
Labels
low priorityThis should be addressed as time permitsThis should be addressed as time permitstaskTask/chore unrelated to a bug or feature requestTask/chore unrelated to a bug or feature request