Skip to content

Garnet CI BDN.benchmark #119

Garnet CI BDN.benchmark

Garnet CI BDN.benchmark #119

Manually triggered October 14, 2024 23:10
Status Failure
Total duration 7m 1s
Artifacts 24

ci-bdnbenchmark.yml

on: workflow_dispatch
Check for changes
4s
Check for changes
Matrix: BDNBenchmark
Fit to window
Zoom out
Zoom in

Annotations

3 errors and 11 warnings
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespLuaRunnerStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1`. | Benchmark suite | Current: 980988bcff9ca1f077bf3eb362f0c4ea1c04bdf2 | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.SetEx` | `26842.587147639348` ns (`± 114.83469563329753`) | `26215.926110839842` ns (`± 136.66928475243665`) | `1.02` | | `BDN.benchmark.Resp.RespParseStress.Get` | `14237.271223958332` ns (`± 112.01975939426748`) | `13798.928869628906` ns (`± 64.21500147899489`) | `1.03` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `157985.62470354352` ns (`± 1120.316461947115`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `1.00` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `203056.7072265625` ns (`± 1991.5912267817864`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `1.00` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `243715.8372333233` ns (`± 838.9569134416141`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `1.03` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/980988bcff9ca1f077bf3eb362f0c4ea1c04bdf2#commitcomment-147929273
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1`. | Benchmark suite | Current: 3297f8b44e376a719569ab6cba7b9acfa4c30bf6 | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.Get` | `14192.444610595703` ns (`± 21.64354458077553`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1.02` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `144827.92593149038` ns (`± 177.88845687116626`) | `140510.107421875` ns (`± 349.47163991529584`) | `1.03` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `125847.56704477164` ns (`± 238.5735060571294`) | `120134.89614633414` ns (`± 192.54329690055798`) | `1.05` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `173075.46105018028` ns (`± 567.1651702298674`) | `150802.53208705358` ns (`± 764.4027973144957`) | `1.15` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `249762.58638822116` ns (`± 449.66884506030226`) | `240391.75130208334` ns (`± 632.1422687457991`) | `1.04` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/3297f8b44e376a719569ab6cba7b9acfa4c30bf6#commitcomment-147929292
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 26842.587147639348. It is 1.0239038298380156x worse than previous exceeding a ratio threshold 1
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 14237.271223958332. It is 1.0317664043688353x worse than previous exceeding a ratio threshold 1
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 157985.62470354352. It is 1.0021809171178433x worse than previous exceeding a ratio threshold 1
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 203056.7072265625. It is 1.004851349814713x worse than previous exceeding a ratio threshold 1
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 243715.8372333233. It is 1.0328932158089825x worse than previous exceeding a ratio threshold 1
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 14192.444610595703. It is 1.0178538524693928x worse than previous exceeding a ratio threshold 1
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 144827.92593149038. It is 1.030729593684327x worse than previous exceeding a ratio threshold 1
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 125847.56704477164. It is 1.047552135821377x worse than previous exceeding a ratio threshold 1
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 173075.46105018028. It is 1.1476959879577435x worse than previous exceeding a ratio threshold 1
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 249762.58638822116. It is 1.0389815167757654x worse than previous exceeding a ratio threshold 1

Artifacts

Produced during runtime
Name Size
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
254 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
228 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
232 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
240 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
258 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
232 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
236 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
244 Bytes
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
10.4 KB
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
10.4 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
11.1 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
8.51 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
15.7 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
6.67 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
7.83 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
7.81 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
8.37 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
8.47 KB
Results-windows-latest-net8.0-Release-Resp.RespParseStress
15.2 KB
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
6.88 KB