-
Notifications
You must be signed in to change notification settings - Fork 285
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Lazy median aggregator #6167
Lazy median aggregator #6167
Conversation
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #6167 +/- ##
==========================================
- Coverage 89.85% 89.85% -0.01%
==========================================
Files 88 88
Lines 23384 23392 +8
Branches 4356 4357 +1
==========================================
+ Hits 21012 21019 +7
Misses 1646 1646
- Partials 726 727 +1 ☔ View full report in Codecov by Sentry. |
Ping @SciTools/peloton, this is looking for a reviewer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @fnattino!
All the code looks great, happy with this. I've rerun the tests, as there was an issue with readthedocs that we've since fixed, so assuming they pass, I'm happy with this.
The only thing to say is that we're now trying to ensure any new tests are written in pytest, using the _shared_utils file for all conveniences. That said, I believe this was put in place after you pushed this PR up, so the fault lies on me for my late review! If you fancy rewriting them in pytest, ideal, if not I'm happy to do so myself once this is merged in.
Thanks for the review @ESadek-MO ! No problem, I have now updated the test module to pytest. Please let me know whether there is anything else that should still be addressed here! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @fnattino, looks good to me!
⏱️ Performance Benchmark Report: 869691fPerformance shifts
Full benchmark results
Generated by GHA run |
🚀 Pull Request
Description
Adding the lazy implementation of the median aggregator, following the implementation discussed in #4039 .
It is true that the issue above suggests that there was not much interest for a lazy median, but it looked like it would need only little effort. And we thought it could still be useful to some ESMValTool users who might not be aware of the workaround of using the 50th percentile.
CC: @bouweandela