Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove profiler_submission.rb benchmark #3028

Merged
merged 1 commit into from
Aug 8, 2023

Conversation

ivoanjo
Copy link
Member

@ivoanjo ivoanjo commented Aug 7, 2023

What does this PR do?:

This PR removes the profiler_submission.rb benchmark.

Motivation:

This benchmark is no longer relevant, as it only tested the old Ruby profiler, and not the new CPU Profiling 2.0 profiler.

The old profiler is no longer in use and will be removed soon, and I spotted this benchmark failing in the benchmarking platform and rather than fix it, I decided to remove it instead.

In the future, we may want to add a benchmark to replace it, but the new profiler internals are different enough that it's non-trivial to update the existing benchmark.

Additional Notes:

Update to benchmarking platform is at
https://github.com/DataDog/benchmarking-platform/pull/16 (Datadog internal link).

How to test the change?:

Validate that CI is still green.

**What does this PR do?**:

This PR removes the `profiler_submission.rb` benchmark.

**Motivation**:

This benchmark is no longer relevant, as it only tested the old Ruby
profiler, and not the new CPU Profiling 2.0 profiler.

The old profiler is no longer in use and will be removed soon, and I
spotted this benchmark failing in the benchmarking platform and rather
than fix it, I decided to remove it instead.

In the future, we may want to add a benchmark to replace it, but the
new profiler internals are different enough that it's non-trivial
to update the existing benchmark.

**Additional Notes**:

Update to benchmarking platform is at
DataDog/benchmarking-platform#16 (Datadog
internal link).

**How to test the change?**:

Validate that CI is still green.
@ivoanjo ivoanjo requested a review from a team August 7, 2023 09:35
@github-actions github-actions bot added the dev/testing Involves testing processes (e.g. RSpec) label Aug 7, 2023
@codecov-commenter
Copy link

Codecov Report

Merging #3028 (9a25aa6) into master (b3f3a0a) will increase coverage by 0.00%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #3028   +/-   ##
=======================================
  Coverage   98.09%   98.09%           
=======================================
  Files        1317     1317           
  Lines       74362    74359    -3     
  Branches     3402     3402           
=======================================
- Hits        72943    72942    -1     
+ Misses       1419     1417    -2     
Files Changed Coverage Δ
spec/datadog/profiling/validate_benchmarks_spec.rb 100.00% <ø> (ø)

... and 5 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@ivoanjo ivoanjo merged commit 355a238 into master Aug 8, 2023
163 checks passed
@ivoanjo ivoanjo deleted the ivoanjo/remove-profiler-submission-benchmark branch August 8, 2023 15:37
@github-actions github-actions bot added this to the 1.13.1 milestone Aug 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dev/testing Involves testing processes (e.g. RSpec)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants