Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add oneexpy to pipeline #480

Conversation

SamuelBrand1
Copy link
Collaborator

A small PR which brings the LogExpFunctions based use of exp transform which has safety against NaN etc from EpiAware into the pipeline as the default transformation.

Closes #479

@SamuelBrand1 SamuelBrand1 requested a review from seabbs October 7, 2024 14:29
Copy link
Contributor

github-actions bot commented Oct 7, 2024

Try this Pull Request!

Open Julia and type:

import Pkg
Pkg.activate(temp=true)
Pkg.add(url="https://github.com/CDCgov/Rt-without-renewal", rev="add-oneexpy-to-pipeline", subdir="EpiAware")
using EpiAware

@SamuelBrand1 SamuelBrand1 changed the base branch from main to 404-upgrade-the-testmode-pipeline-script-to-just-pipeline-script October 7, 2024 14:30
@seabbs seabbs merged commit ae8e3ca into 404-upgrade-the-testmode-pipeline-script-to-just-pipeline-script Oct 7, 2024
11 checks passed
@seabbs seabbs deleted the add-oneexpy-to-pipeline branch October 7, 2024 15:01
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.05%. Comparing base (5cd5040) to head (6ab847a).
Report is 2 commits behind head on 404-upgrade-the-testmode-pipeline-script-to-just-pipeline-script.

Additional details and impacted files
@@                                        Coverage Diff                                        @@
##           404-upgrade-the-testmode-pipeline-script-to-just-pipeline-script     #480   +/-   ##
=================================================================================================
  Coverage                                                             90.05%   90.05%           
=================================================================================================
  Files                                                                    57       57           
  Lines                                                                   744      744           
=================================================================================================
  Hits                                                                    670      670           
  Misses                                                                   74       74           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Oct 7, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmarks:
    • Target: 7 Oct 2024 - 14:58
    • Baseline: 7 Oct 2024 - 15:22
  • Package commits:
    • Target: 632638
    • Baseline: 0414f5
  • Julia commits:
    • Target: 6f3fdf
    • Baseline: 6f3fdf
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: None
    • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 0.90 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.79 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 0.93 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 0.93 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 0.90 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 0.95 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 0.94 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 0.91 (5%) ✅ 1.00 (1%)
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.05 (5%) ❌ 1.00 (1%)
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 0.93 (5%) ✅ 1.00 (1%)
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.05 (5%) ❌ 1.00 (1%)
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.12 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Target

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.8.0-1014-azure #16~22.04.1-Ubuntu SMP Thu Aug 15 21:31:41 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3239 MHz       4657 s          0 s        537 s      12385 s          0 s
       #2  3235 MHz       6169 s          0 s        665 s      10757 s          0 s
       #3  3208 MHz       5003 s          0 s        473 s      12122 s          0 s
       #4  2680 MHz       4981 s          0 s        485 s      12125 s          0 s
  Memory: 15.615272521972656 GB (12799.68359375 MB free)
  Uptime: 1764.1 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.8.0-1014-azure #16~22.04.1-Ubuntu SMP Thu Aug 15 21:31:41 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3223 MHz       7182 s          0 s        864 s      24113 s          0 s
       #2  3245 MHz      11171 s          0 s       1066 s      19939 s          0 s
       #3  2445 MHz       7494 s          0 s        794 s      23893 s          0 s
       #4  3243 MHz       8592 s          0 s        938 s      22646 s          0 s
  Memory: 15.615272521972656 GB (12729.1796875 MB free)
  Uptime: 3224.37 sec
  Load Avg:  1.07  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 7 Oct 2024 - 14:58
  • Package commit: 632638
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 2.057 μs (5%) 416 bytes (1%) 5
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 292.579 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 295.903 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 430.910 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 435.543 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.799 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.839 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 557.893 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 556.979 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 213.229 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 212.660 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 309.110 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 310.262 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.357 μs (5%) 5.45 KiB (1%) 108
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.337 μs (5%) 5.45 KiB (1%) 108
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 553.979 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 555.053 ns (5%) 272 bytes (1%) 6
["EpiLatentModels", "AR", "evaluation", "linked"] 2.014 μs (5%) 3.84 KiB (1%) 45
["EpiLatentModels", "AR", "evaluation", "standard"] 1.609 μs (5%) 2.80 KiB (1%) 38
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.465 μs (5%) 11.69 KiB (1%) 55
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.885 μs (5%) 10.12 KiB (1%) 46
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 104.776 μs (5%) 55.31 KiB (1%) 1113
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 68.488 μs (5%) 40.64 KiB (1%) 818
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.112 μs (5%) 8.44 KiB (1%) 225
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.499 μs (5%) 7.31 KiB (1%) 207
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 1.506 μs (5%) 3.05 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 1.258 μs (5%) 2.17 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.000 μs (5%) 5.16 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.680 μs (5%) 4.28 KiB (1%) 37
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 44.353 μs (5%) 24.41 KiB (1%) 447
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 27.722 μs (5%) 16.86 KiB (1%) 333
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.007 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.738 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 63.409 μs (5%) 52.27 KiB (1%) 580
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 59.391 μs (5%) 37.69 KiB (1%) 536
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 132.489 μs (5%) 119.19 KiB (1%) 1184
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 124.865 μs (5%) 89.31 KiB (1%) 1092
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 187.341 μs (5%) 107.81 KiB (1%) 1710
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 146.014 μs (5%) 79.61 KiB (1%) 1378
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.783 μs (5%) 8.58 KiB (1%) 226
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.950 μs (5%) 7.45 KiB (1%) 208
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 11.642 μs (5%) 30.39 KiB (1%) 214
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 8.987 μs (5%) 21.95 KiB (1%) 184
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 13.445 μs (5%) 34.09 KiB (1%) 224
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 10.179 μs (5%) 25.66 KiB (1%) 194
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 72.836 μs (5%) 56.38 KiB (1%) 719
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 52.398 μs (5%) 42.72 KiB (1%) 580
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.178 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.881 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 1.847 μs (5%) 4.17 KiB (1%) 37
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 1.381 μs (5%) 2.48 KiB (1%) 31
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.037 μs (5%) 12.62 KiB (1%) 45
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.716 μs (5%) 10.94 KiB (1%) 39
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 59.511 μs (5%) 38.81 KiB (1%) 748
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.648 μs (5%) 31.91 KiB (1%) 633
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.537 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.468 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 421.298 ns (5%) 1.00 KiB (1%) 8
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 356.213 ns (5%) 864 bytes (1%) 7
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.112 μs (5%) 5.28 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 893.333 ns (5%) 5.12 KiB (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 40.766 μs (5%) 19.83 KiB (1%) 376
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 25.578 μs (5%) 14.45 KiB (1%) 266
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.261 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.065 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "Intercept", "evaluation", "linked"] 248.646 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "evaluation", "standard"] 250.252 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 357.651 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 359.488 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.135 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.182 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 455.523 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 460.817 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.853 μs (5%) 3.47 KiB (1%) 30
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.663 μs (5%) 3.00 KiB (1%) 27
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.682 μs (5%) 7.75 KiB (1%) 36
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.333 μs (5%) 7.28 KiB (1%) 33
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 44.363 μs (5%) 22.16 KiB (1%) 397
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 28.794 μs (5%) 16.47 KiB (1%) 285
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.235 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.065 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 896.317 ns (5%) 1.86 KiB (1%) 18
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 762.669 ns (5%) 1.42 KiB (1%) 16
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.889 μs (5%) 8.73 KiB (1%) 25
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.723 μs (5%) 8.30 KiB (1%) 23
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.676 μs (5%) 26.19 KiB (1%) 487
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 29.345 μs (5%) 20.53 KiB (1%) 376
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.587 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.354 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 578.811 ns (5%) 1.19 KiB (1%) 12
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 474.188 ns (5%) 896 bytes (1%) 10
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 834.944 ns (5%) 1.72 KiB (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 693.025 ns (5%) 1.41 KiB (1%) 16
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 41.728 μs (5%) 19.08 KiB (1%) 380
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 26.209 μs (5%) 13.55 KiB (1%) 269
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.147 μs (5%) 400 bytes (1%) 11
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 977.118 ns (5%) 400 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 310.178 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 308.630 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 407.520 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 406.515 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.378 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.414 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 521.607 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 518.677 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 2.055 μs (5%) 4.16 KiB (1%) 44
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 1.597 μs (5%) 2.84 KiB (1%) 38
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.904 μs (5%) 10.00 KiB (1%) 51
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.568 μs (5%) 8.69 KiB (1%) 45
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 57.969 μs (5%) 35.58 KiB (1%) 689
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 38.482 μs (5%) 29.05 KiB (1%) 574
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.133 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.861 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 2.217 μs (5%) 4.52 KiB (1%) 47
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 1.702 μs (5%) 2.62 KiB (1%) 37
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.821 μs (5%) 7.69 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.181 μs (5%) 5.53 KiB (1%) 45
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 81.183 μs (5%) 41.95 KiB (1%) 771
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 47.109 μs (5%) 28.44 KiB (1%) 513
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.457 μs (5%) 1.81 KiB (1%) 49
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.623 μs (5%) 1.69 KiB (1%) 47
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.335 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.315 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.132 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 4.046 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 49.263 μs (5%) 39.05 KiB (1%) 905
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 33.924 μs (5%) 33.83 KiB (1%) 796
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.955 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.784 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 16.461 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 16.381 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 21.891 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 21.230 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 288.302 μs (5%) 293.61 KiB (1%) 6804
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 271.269 μs (5%) 288.39 KiB (1%) 6695
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 50.976 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 51.667 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.152 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.129 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.856 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.714 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.256 μs (5%) 36.33 KiB (1%) 899
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.277 μs (5%) 31.11 KiB (1%) 790
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.027 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.744 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.540 μs (5%) 1.80 KiB (1%) 22
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.212 μs (5%) 1.38 KiB (1%) 18
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.462 μs (5%) 7.75 KiB (1%) 31
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.751 μs (5%) 4.52 KiB (1%) 25
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 136.746 μs (5%) 91.00 KiB (1%) 1913
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 24.526 μs (5%) 29.25 KiB (1%) 712
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.296 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.396 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.682 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.630 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.849 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.794 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 22.412 μs (5%) 12.91 KiB (1%) 283
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 8.643 μs (5%) 7.69 KiB (1%) 174
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.360 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.079 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 6.971 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 6.971 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.918 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.822 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 58.440 μs (5%) 49.23 KiB (1%) 1020
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.598 μs (5%) 44.02 KiB (1%) 911
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.342 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.214 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.331 μs (5%) 8.88 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 4.241 μs (5%) 7.62 KiB (1%) 67
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 5.624 μs (5%) 15.88 KiB (1%) 83
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.248 μs (5%) 14.62 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 77.756 μs (5%) 60.41 KiB (1%) 1139
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 60.284 μs (5%) 53.94 KiB (1%) 1022
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.711 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.512 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.539 μs (5%) 2.97 KiB (1%) 31
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 1.018 μs (5%) 1.41 KiB (1%) 21
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.151 μs (5%) 4.03 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.582 μs (5%) 2.47 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 28.654 μs (5%) 24.73 KiB (1%) 490
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 13.375 μs (5%) 17.28 KiB (1%) 352
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.339 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.997 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 445.990 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 412.925 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 569.543 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 529.058 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 23.835 μs (5%) 18.72 KiB (1%) 414
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 10.068 μs (5%) 12.83 KiB (1%) 286
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.983 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.679 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 1.805 μs (5%) 2.05 KiB (1%) 27
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 1.660 μs (5%) 1.73 KiB (1%) 25
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.672 μs (5%) 2.22 KiB (1%) 26
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.502 μs (5%) 1.91 KiB (1%) 24
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 37.891 μs (5%) 23.89 KiB (1%) 499
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 22.703 μs (5%) 17.69 KiB (1%) 369
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.292 μs (5%) 112 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.361 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.8.0-1014-azure #16~22.04.1-Ubuntu SMP Thu Aug 15 21:31:41 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3239 MHz       4657 s          0 s        537 s      12385 s          0 s
       #2  3235 MHz       6169 s          0 s        665 s      10757 s          0 s
       #3  3208 MHz       5003 s          0 s        473 s      12122 s          0 s
       #4  2680 MHz       4981 s          0 s        485 s      12125 s          0 s
  Memory: 15.615272521972656 GB (12799.68359375 MB free)
  Uptime: 1764.1 sec
  Load Avg:  1.0  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/Rt-without-renewal/Rt-without-renewal

Job Properties

  • Time of benchmark: 7 Oct 2024 - 15:22
  • Package commit: 0414f5
  • Julia commit: 6f3fdf
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["EpiAwareUtils", "censored_pmf"] 2.053 μs (5%) 416 bytes (1%) 5
["EpiInfModels", "DirectInfections", "evaluation", "linked"] 296.735 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "evaluation", "standard"] 302.078 ns (5%) 432 bytes (1%) 7
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 429.648 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 428.543 ns (5%) 784 bytes (1%) 13
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.378 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.438 μs (5%) 5.62 KiB (1%) 115
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 577.530 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 580.596 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "evaluation", "linked"] 214.308 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "evaluation", "standard"] 214.138 ns (5%) 256 bytes (1%) 4
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 312.762 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 312.218 ns (5%) 512 bytes (1%) 9
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 9.208 μs (5%) 5.45 KiB (1%) 108
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 9.217 μs (5%) 5.45 KiB (1%) 108
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 581.646 ns (5%) 272 bytes (1%) 6
["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 574.082 ns (5%) 272 bytes (1%) 6
["EpiLatentModels", "AR", "evaluation", "linked"] 1.956 μs (5%) 3.84 KiB (1%) 45
["EpiLatentModels", "AR", "evaluation", "standard"] 1.610 μs (5%) 2.80 KiB (1%) 38
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.440 μs (5%) 11.69 KiB (1%) 55
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.887 μs (5%) 10.12 KiB (1%) 46
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 103.613 μs (5%) 55.31 KiB (1%) 1113
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 69.521 μs (5%) 40.64 KiB (1%) 818
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 16.802 μs (5%) 8.44 KiB (1%) 225
["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 15.379 μs (5%) 7.31 KiB (1%) 207
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "linked"] 1.546 μs (5%) 3.05 KiB (1%) 34
["EpiLatentModels", "BroadcastLatentModel", "evaluation", "standard"] 1.312 μs (5%) 2.17 KiB (1%) 30
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.069 μs (5%) 5.16 KiB (1%) 41
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.721 μs (5%) 4.28 KiB (1%) 37
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 44.614 μs (5%) 24.41 KiB (1%) 447
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 28.103 μs (5%) 16.86 KiB (1%) 333
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.041 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.803 μs (5%) 1.00 KiB (1%) 27
["EpiLatentModels", "CombineLatentModels", "evaluation", "linked"] 63.780 μs (5%) 52.27 KiB (1%) 580
["EpiLatentModels", "CombineLatentModels", "evaluation", "standard"] 59.862 μs (5%) 37.69 KiB (1%) 536
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 132.268 μs (5%) 119.19 KiB (1%) 1184
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 123.892 μs (5%) 89.31 KiB (1%) 1092
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 190.478 μs (5%) 107.81 KiB (1%) 1710
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 145.803 μs (5%) 79.61 KiB (1%) 1378
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 17.543 μs (5%) 8.58 KiB (1%) 226
["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 16.150 μs (5%) 7.45 KiB (1%) 208
["EpiLatentModels", "ConcatLatentModels", "evaluation", "linked"] 11.682 μs (5%) 30.39 KiB (1%) 214
["EpiLatentModels", "ConcatLatentModels", "evaluation", "standard"] 8.947 μs (5%) 21.95 KiB (1%) 184
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 13.225 μs (5%) 34.09 KiB (1%) 224
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 9.939 μs (5%) 25.66 KiB (1%) 194
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 74.048 μs (5%) 56.38 KiB (1%) 719
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 53.069 μs (5%) 42.72 KiB (1%) 580
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.181 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.983 μs (5%) 2.19 KiB (1%) 52
["EpiLatentModels", "DiffLatentModel", "evaluation", "linked"] 1.817 μs (5%) 4.17 KiB (1%) 37
["EpiLatentModels", "DiffLatentModel", "evaluation", "standard"] 1.366 μs (5%) 2.48 KiB (1%) 31
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.033 μs (5%) 12.62 KiB (1%) 45
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.596 μs (5%) 10.94 KiB (1%) 39
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 59.803 μs (5%) 38.81 KiB (1%) 748
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 42.208 μs (5%) 31.91 KiB (1%) 633
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.301 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.614 μs (5%) 2.22 KiB (1%) 51
["EpiLatentModels", "HierarchicalNormal", "evaluation", "linked"] 431.362 ns (5%) 1.00 KiB (1%) 8
["EpiLatentModels", "HierarchicalNormal", "evaluation", "standard"] 372.182 ns (5%) 864 bytes (1%) 7
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.413 μs (5%) 5.28 KiB (1%) 14
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 883.071 ns (5%) 5.12 KiB (1%) 13
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 40.887 μs (5%) 19.83 KiB (1%) 376
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 26.419 μs (5%) 14.45 KiB (1%) 266
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.229 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.085 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "Intercept", "evaluation", "linked"] 249.989 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "evaluation", "standard"] 249.231 ns (5%) 336 bytes (1%) 5
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 351.493 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 350.137 ns (5%) 640 bytes (1%) 10
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.194 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.278 μs (5%) 3.53 KiB (1%) 76
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 490.559 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 494.124 ns (5%) 240 bytes (1%) 3
["EpiLatentModels", "PrefixLatentModel", "evaluation", "linked"] 1.802 μs (5%) 3.47 KiB (1%) 30
["EpiLatentModels", "PrefixLatentModel", "evaluation", "standard"] 1.634 μs (5%) 3.00 KiB (1%) 27
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.988 μs (5%) 7.75 KiB (1%) 36
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.349 μs (5%) 7.28 KiB (1%) 33
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.776 μs (5%) 22.16 KiB (1%) 397
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 29.014 μs (5%) 16.47 KiB (1%) 285
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.236 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.099 μs (5%) 656 bytes (1%) 11
["EpiLatentModels", "RandomWalk", "evaluation", "linked"] 918.106 ns (5%) 1.86 KiB (1%) 18
["EpiLatentModels", "RandomWalk", "evaluation", "standard"] 790.366 ns (5%) 1.42 KiB (1%) 16
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.816 μs (5%) 8.73 KiB (1%) 25
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.652 μs (5%) 8.30 KiB (1%) 23
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.605 μs (5%) 26.19 KiB (1%) 487
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.006 μs (5%) 20.53 KiB (1%) 376
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 3.661 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 3.413 μs (5%) 1.31 KiB (1%) 27
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "linked"] 596.966 ns (5%) 1.19 KiB (1%) 12
["EpiLatentModels", "RecordExpectedLatent", "evaluation", "standard"] 490.102 ns (5%) 896 bytes (1%) 10
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 803.622 ns (5%) 1.72 KiB (1%) 18
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 675.063 ns (5%) 1.41 KiB (1%) 16
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 41.738 μs (5%) 19.08 KiB (1%) 380
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 26.530 μs (5%) 13.55 KiB (1%) 269
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.147 μs (5%) 400 bytes (1%) 11
["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 989.133 ns (5%) 400 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "evaluation", "linked"] 312.743 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "evaluation", "standard"] 312.139 ns (5%) 384 bytes (1%) 6
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 413.286 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 410.920 ns (5%) 704 bytes (1%) 11
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 4.546 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 4.523 μs (5%) 3.84 KiB (1%) 81
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 550.979 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 554.699 ns (5%) 192 bytes (1%) 3
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "linked"] 2.255 μs (5%) 4.16 KiB (1%) 44
["EpiLatentModels", "broadcast_dayofweek", "evaluation", "standard"] 1.634 μs (5%) 2.84 KiB (1%) 38
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.829 μs (5%) 10.00 KiB (1%) 51
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.439 μs (5%) 8.69 KiB (1%) 45
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 56.525 μs (5%) 35.58 KiB (1%) 689
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.237 μs (5%) 29.05 KiB (1%) 574
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.218 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.919 μs (5%) 1.22 KiB (1%) 27
["EpiLatentModels", "broadcast_weekly", "evaluation", "linked"] 2.193 μs (5%) 4.52 KiB (1%) 47
["EpiLatentModels", "broadcast_weekly", "evaluation", "standard"] 1.662 μs (5%) 2.62 KiB (1%) 37
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.902 μs (5%) 7.69 KiB (1%) 57
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.265 μs (5%) 5.53 KiB (1%) 45
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 82.264 μs (5%) 41.95 KiB (1%) 771
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 46.397 μs (5%) 28.44 KiB (1%) 513
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.240 μs (5%) 1.81 KiB (1%) 49
["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.581 μs (5%) 1.69 KiB (1%) 47
["EpiObsModels", "Ascertainment", "evaluation", "linked"] 3.288 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "evaluation", "standard"] 3.252 μs (5%) 3.42 KiB (1%) 49
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 4.166 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 4.103 μs (5%) 3.77 KiB (1%) 56
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 49.333 μs (5%) 39.05 KiB (1%) 905
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 34.064 μs (5%) 33.83 KiB (1%) 796
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.697 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.584 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "evaluation", "linked"] 16.451 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "evaluation", "standard"] 16.440 μs (5%) 22.14 KiB (1%) 206
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 21.981 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 21.280 μs (5%) 22.36 KiB (1%) 211
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 299.251 μs (5%) 293.61 KiB (1%) 6804
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 278.493 μs (5%) 288.39 KiB (1%) 6695
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 50.835 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 50.525 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "evaluation", "linked"] 1.159 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "evaluation", "standard"] 1.136 μs (5%) 336 bytes (1%) 5
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.794 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.706 μs (5%) 560 bytes (1%) 10
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 45.495 μs (5%) 36.33 KiB (1%) 899
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 30.837 μs (5%) 31.11 KiB (1%) 790
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.732 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.624 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PoissonError", "evaluation", "linked"] 1.556 μs (5%) 1.80 KiB (1%) 22
["EpiObsModels", "PoissonError", "evaluation", "standard"] 1.223 μs (5%) 1.38 KiB (1%) 18
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 3.565 μs (5%) 7.75 KiB (1%) 31
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 2.859 μs (5%) 4.52 KiB (1%) 25
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 136.136 μs (5%) 91.00 KiB (1%) 1913
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 24.937 μs (5%) 29.25 KiB (1%) 712
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 7.324 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 4.255 μs (5%) 176 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "evaluation", "linked"] 1.704 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "evaluation", "standard"] 1.651 μs (5%) 1.44 KiB (1%) 26
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.832 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.796 μs (5%) 1.66 KiB (1%) 31
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 22.262 μs (5%) 12.91 KiB (1%) 283
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 8.309 μs (5%) 7.69 KiB (1%) 174
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.333 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.089 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "evaluation", "linked"] 6.955 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "evaluation", "standard"] 6.915 μs (5%) 5.48 KiB (1%) 93
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 7.918 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 7.847 μs (5%) 5.83 KiB (1%) 100
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 59.322 μs (5%) 49.23 KiB (1%) 1020
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 41.889 μs (5%) 44.02 KiB (1%) 911
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 6.294 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 6.160 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "linked"] 4.400 μs (5%) 8.88 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "evaluation", "standard"] 4.142 μs (5%) 7.62 KiB (1%) 67
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 5.713 μs (5%) 15.88 KiB (1%) 83
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 5.252 μs (5%) 14.62 KiB (1%) 75
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 80.210 μs (5%) 60.41 KiB (1%) 1139
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 61.405 μs (5%) 53.94 KiB (1%) 1022
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 5.702 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 5.445 μs (5%) 544 bytes (1%) 11
["EpiObsModels", "observation_error", "missing obs", "evaluation", "linked"] 1.558 μs (5%) 2.97 KiB (1%) 31
["EpiObsModels", "observation_error", "missing obs", "evaluation", "standard"] 1.040 μs (5%) 1.41 KiB (1%) 21
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 2.121 μs (5%) 4.03 KiB (1%) 38
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.638 μs (5%) 2.47 KiB (1%) 28
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 29.154 μs (5%) 24.73 KiB (1%) 490
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 13.295 μs (5%) 17.28 KiB (1%) 352
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.359 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.084 μs (5%) 144 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "linked"] 445.783 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "evaluation", "standard"] 415.830 ns (5%) 288 bytes (1%) 5
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 584.193 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 536.455 ns (5%) 512 bytes (1%) 10
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 23.554 μs (5%) 18.72 KiB (1%) 414
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 10.159 μs (5%) 12.83 KiB (1%) 286
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 1.967 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 1.755 μs (5%) 96 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "linked"] 1.870 μs (5%) 2.05 KiB (1%) 27
["EpiObsModels", "observation_error", "partially missing obs", "evaluation", "standard"] 1.694 μs (5%) 1.73 KiB (1%) 25
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "linked"] 1.717 μs (5%) 2.22 KiB (1%) 26
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)", "standard"] 1.524 μs (5%) 1.91 KiB (1%) 24
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "linked"] 39.093 μs (5%) 23.89 KiB (1%) 499
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()", "standard"] 22.673 μs (5%) 17.69 KiB (1%) 369
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "linked"] 2.319 μs (5%) 112 bytes (1%) 2
["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)", "standard"] 2.103 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["EpiAwareUtils"]
  • ["EpiInfModels", "DirectInfections", "evaluation"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "DirectInfections", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiInfModels", "ExpGrowthRate", "evaluation"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiInfModels", "ExpGrowthRate", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "AR", "evaluation"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "AR", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "evaluation"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "BroadcastLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "CombineLatentModels", "evaluation"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "CombineLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "ConcatLatentModels", "evaluation"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "ConcatLatentModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "DiffLatentModel", "evaluation"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "DiffLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "HierarchicalNormal", "evaluation"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "HierarchicalNormal", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "Intercept", "evaluation"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "Intercept", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "PrefixLatentModel", "evaluation"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "PrefixLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RandomWalk", "evaluation"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RandomWalk", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "evaluation"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "RecordExpectedLatent", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "TransformLatentModel", "evaluation"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "TransformLatentModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "evaluation"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiLatentModels", "broadcast_weekly", "evaluation"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiLatentModels", "broadcast_weekly", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "Ascertainment", "evaluation"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "Ascertainment", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "LatentDelay", "evaluation"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "LatentDelay", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "NegativeBinomialError", "evaluation"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "NegativeBinomialError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PoissonError", "evaluation"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PoissonError", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "PrefixObservationModel", "evaluation"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "PrefixObservationModel", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "StackObservationModels", "evaluation"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "StackObservationModels", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "evaluation"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "ascertainment_dayofweek", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "no missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "evaluation"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoForwardDiff(chunksize=0)"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff()"]
  • ["EpiObsModels", "observation_error", "partially missing obs", "gradient", "ADTypes.AutoReverseDiff(compile=true)"]

Julia versioninfo

Julia Version 1.10.5
Commit 6f3fdf7b362 (2024-08-27 14:19 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.5 LTS
  uname: Linux 6.8.0-1014-azure #16~22.04.1-Ubuntu SMP Thu Aug 15 21:31:41 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  3223 MHz       7182 s          0 s        864 s      24113 s          0 s
       #2  3245 MHz      11171 s          0 s       1066 s      19939 s          0 s
       #3  2445 MHz       7494 s          0 s        794 s      23893 s          0 s
       #4  3243 MHz       8592 s          0 s        938 s      22646 s          0 s
  Memory: 15.615272521972656 GB (12729.1796875 MB free)
  Uptime: 3224.37 sec
  Load Avg:  1.07  1.02  1.0
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                         x86_64
CPU op-mode(s):                       32-bit, 64-bit
Address sizes:                        48 bits physical, 48 bits virtual
Byte Order:                           Little Endian
CPU(s):                               4
On-line CPU(s) list:                  0-3
Vendor ID:                            AuthenticAMD
Model name:                           AMD EPYC 7763 64-Core Processor
CPU family:                           25
Model:                                1
Thread(s) per core:                   2
Core(s) per socket:                   2
Socket(s):                            1
Stepping:                             1
BogoMIPS:                             4890.85
Flags:                                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves user_shstk clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                       AMD-V
Hypervisor vendor:                    Microsoft
Virtualization type:                  full
L1d cache:                            64 KiB (2 instances)
L1i cache:                            64 KiB (2 instances)
L2 cache:                             1 MiB (2 instances)
L3 cache:                             32 MiB (1 instance)
NUMA node(s):                         1
NUMA node0 CPU(s):                    0-3
Vulnerability Gather data sampling:   Not affected
Vulnerability Itlb multihit:          Not affected
Vulnerability L1tf:                   Not affected
Vulnerability Mds:                    Not affected
Vulnerability Meltdown:               Not affected
Vulnerability Mmio stale data:        Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Not affected
Vulnerability Spec rstack overflow:   Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass:      Vulnerable
Vulnerability Spectre v1:             Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

github-merge-queue bot pushed a commit that referenced this pull request Oct 7, 2024
…dictive + full (#445)

* remove most compat from pipeline

* Update test_pipelinefunctions.jl

* Fix the truthdata output to be missing or Int

* change to daily increments in latent processes

* Change default AD mode to ReverseDiff{true}

* Create changelog.md

* reformat

* change filename

* Update simulate.jl

* add a testmode to pipelinetypes

* tighten typing

* fix constructor

* fix constructor

* pipeline helper functions

* unit tests and end-to-end tests

* remove old scripts

* Fix y_t type

* bring inference prefixing into line with truthdata prefixing

* reformat

* interim commit

* rename and collect plot functions

* tidy up tests

* basic plots to Makie

* new plot tests and test reorganisation

* Update runtests.jl

* reformat

* 455 plotting methods of prior predictive (#462)

* add priorpredictive method to make_inference

* Add pipeline priorpredictive boolean

* reformat

* remove inference_method kwarg because can be dispatched on

* remove specialisation on forecast results

add missing handling as well

* move inference step into own function

and give fail cover with error report

* remove passing inference_method

* add a latent model name to InferenceConfig

* Util for setting up PI levels

* prior pred plot

* export prior_predictive_plot

* remove dead end-to-end test

in favour of direct test of prior_predictive_plot

* Make pipeline inference tests more focused (#475)

* fix tests and capture forecasting failures

* delete stale end-to-end test

* Full priorpred check pipeline script (#476)

* Hotfix: Doc link to main

* create xexpy function with x = 1 typestable (#473)

* rename data folder

* catch bug where objects were getting saved to root dir

* fix bug where being saved to root

* add priorpredictive mode to the inference config struct

* do_truthdata behaviour modifed by prior predictive

* send priorpredictive mode in generate_inference

* update tests

* prior predictive pipeline

* reformat

---------

Co-authored-by: Sam Abbott <azw1@cdc.gov>

* Add oneexpy to pipeline (#480)

* Changed saved prior predictive data (#478)

* change to pipeline being part of InferenceConfig

This also splits figure saving from data saving

* fix passed var

* change serialisation target dir

* update tests and config usage to pass pipeline object

---------

Co-authored-by: Sam Abbott <azw1@cdc.gov>

* Update run_priorpred_pipeline.jl

* Only save strings rather than Exception objects

---------

Co-authored-by: Sam Abbott <azw1@cdc.gov>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add stable form of exp transform to pipeline
3 participants