-
Notifications
You must be signed in to change notification settings - Fork 7
Issue 471: Add TransfromObservationModel #496
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Try this Pull Request!Open Julia and type: import Pkg
Pkg.activate(temp=true)
Pkg.add(url="https://github.com/CDCgov/Rt-without-renewal", rev="transform-obs-model", subdir="EpiAware")
using EpiAware |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Just a couple of comments
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #496 +/- ##
=======================================
Coverage 89.87% 89.88%
=======================================
Files 51 52 +1
Lines 741 751 +10
=======================================
+ Hits 666 675 +9
- Misses 75 76 +1 ☔ View full report in Codecov by Sentry. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Hmm does this repeat failure indicate we should change the test? |
@SamuelBrand1 thoughts on something to change here to make this safer for merging |
What was the fail? |
its an inexact error for the benchmark for this feature which given its simplicity I find very confusing |
Not sure what is causing this, but its quite a wild error in benchmarks |
Any idea if this is actually related to this PR or if its something from the numerical stability issues? If it is this PR any thoughts? It would be good to get this merged |
I'm 70% its this PR because such a large benchmark error would IMO likely have been caught already. I'm running locally to have a closer look. |
Could be a |
The error in the benchmarking is happening at the |
To specify I already located it to this newly added benchmark so it is definitely the problem |
I'm still at a bit of a lose about why this is problematic for the |
@SamuelBrand1 can you take a look at this and see if you can spot the problem? It would be great to be able to merge. this |
EpiAware/src/EpiObsModels/modifiers/TransformObservationModel.jl
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This looks really handy. Noting the benchmark CI problem, which I'll also investigate.
Co-authored-by: Samuel Brand <48288458+SamuelBrand1@users.noreply.github.com>
Benchmark resultJudge resultBenchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewalJob Properties
ResultsA ratio greater than
Benchmark Group ListHere's a list of all the benchmark groups executed by this job:
Julia versioninfoTarget
Baseline
Target resultBenchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewalJob Properties
ResultsBelow is a table of this job's results, obtained by running the benchmarks.
Benchmark Group ListHere's a list of all the benchmark groups executed by this job:
Julia versioninfo
Baseline resultBenchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewalJob Properties
ResultsBelow is a table of this job's results, obtained by running the benchmarks.
Benchmark Group ListHere's a list of all the benchmark groups executed by this job:
Julia versioninfo
Runtime information
|
This PR adds
TransformObservationModel
in the same style asTransformLatentModels
. It helps to address #471.I noted during this PR that the obs models names are getting very long and unwieldy. One obvious way to address this would be to use obs everywhere. I also think we should update
TransformLatentModels
to have a transform argument to match that used here.