Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add branch test coverage report #1343

Merged
merged 6 commits into from
Mar 29, 2021
Merged

Add branch test coverage report #1343

merged 6 commits into from
Mar 29, 2021

Conversation

marcotc
Copy link
Member

@marcotc marcotc commented Feb 2, 2021

This PR adds branch coverage reporting to our CI.

Currently, our SimpleCov HTML reports will report both line and branch coverage, while the Ruby Codecov gem does not consume branch coverage data in the latest version.

There's currently an open issue with SimpleCov that happens when merging results from old rubies with new ones. I've created a PR to address it, currently awaiting feedback: simplecov-ruby/simplecov#972
I'm pointing to a GitHub commit representing that PR's changes in order to make our coverage CI step pass.

For Codecov reporting, we are waiting on support for branch coverage reporting, which was reported here: codecov/codecov-ruby#73. Meanwhile, we can see the results in the "Artifacts" tabs of the "coverage" step in CircleCI: https://123359-66497320-gh.circle-artifacts.com/0/coverage/index.html#_AllFiles

Screen Shot 2021-03-26 at 2 55 08 PM

@marcotc marcotc added dev/testing Involves testing processes (e.g. RSpec) dev/ci Involves CircleCI, GitHub Actions, or GitLab labels Feb 2, 2021
@marcotc marcotc requested a review from a team February 2, 2021 22:03
@marcotc marcotc self-assigned this Feb 2, 2021
@marcotc marcotc marked this pull request as draft February 2, 2021 22:09
@marcotc marcotc removed the request for review from a team February 2, 2021 22:10
@ivoanjo
Copy link
Member

ivoanjo commented Feb 3, 2021

Nice!

@marcotc marcotc marked this pull request as ready for review March 26, 2021 21:55
@marcotc marcotc requested a review from a team March 26, 2021 21:55
ivoanjo
ivoanjo previously approved these changes Mar 29, 2021
Gemfile Outdated
# Merging branch coverage results does not work for old, unsupported rubies.
# We have a fix up for review, https://github.com/simplecov-ruby/simplecov/pull/972,
# but given it only affects unsupported version of Ruby, it might not get merged.
gem 'simplecov', git: 'https://github.com/marcotc/simplecov', ref: '3bb6b7ee58bf4b1954ca205f50dd44d6f41c57db'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since this may stick for a few years (it sounds like there'll be a manned mission to Mars before we drop 2.4), I suggest forking this to the datadog account, and pushing the branch there as well, just in case :)

@marcotc marcotc merged commit 0794be4 into master Mar 29, 2021
@marcotc marcotc deleted the branch-coverage branch March 29, 2021 20:06
@github-actions github-actions bot added this to the 0.47.0 milestone Mar 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dev/ci Involves CircleCI, GitHub Actions, or GitLab dev/testing Involves testing processes (e.g. RSpec)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants