Skip to content

Garnet CI BDN.benchmark #113

Garnet CI BDN.benchmark

Garnet CI BDN.benchmark #113

Manually triggered October 14, 2024 21:42
Status Failure
Total duration 6m 1s
Artifacts 24

ci-bdnbenchmark.yml

on: workflow_dispatch
Check for changes
4s
Check for changes
Matrix: BDNBenchmark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 29 warnings
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: 2609921273b8e643f9da8cdc51afb75c93436178 | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `1064605.2116350445` ns (`± 658.924574203032`) | `2471.1294351305282` ns (`± 12.949508963376248`) | `430.82` | | `BDN.benchmark.Resp.RespParseStress.Set` | `1085210.224609375` ns (`± 476.4852589890372`) | `18996.77194918119` ns (`± 37.42607751602984`) | `57.13` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `1095103.714564732` ns (`± 991.5831838219984`) | `26215.926110839842` ns (`± 136.66928475243665`) | `41.77` | | `BDN.benchmark.Resp.RespParseStress.Get` | `1079720.6597377232` ns (`± 582.6764908912269`) | `13798.928869628906` ns (`± 64.21500147899489`) | `78.25` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `1253288.259765625` ns (`± 2069.562844063654`) | `197105.64436035155` ns (`± 1763.9160246358654`) | `6.36` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `1232686.2193080357` ns (`± 1543.9206970535645`) | `184024.47240397136` ns (`± 1014.2859833621429`) | `6.70` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `1222752.479361979` ns (`± 1485.0388617553951`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `7.76` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `1295960.8313151042` ns (`± 12886.504548634797`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `6.41` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `1308914.2420572916` ns (`± 3904.2814919350185`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `5.55` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/2609921273b8e643f9da8cdc51afb75c93436178#commitcomment-147927892
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: 2609921273b8e643f9da8cdc51afb75c93436178 | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `15626670.673076924` ns (`± 5796.8513502524`) | `2417.139801612267` ns (`± 5.332391242477296`) | `6464.94` | | `BDN.benchmark.Resp.RespParseStress.Set` | `15543849.21875` ns (`± 152420.69963760197`) | `18088.291727701824` ns (`± 26.527437904880887`) | `859.33` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `15631665` ns (`± 8201.364368881603`) | `26138.006474421574` ns (`± 22.167591954955206`) | `598.04` | | `BDN.benchmark.Resp.RespParseStress.Get` | `15615955.833333334` ns (`± 60239.52620491062`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1119.95` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `15638575.3125` ns (`± 8300.187897910806`) | `140510.107421875` ns (`± 349.47163991529584`) | `111.30` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `15634982.916666666` ns (`± 13184.851834372097`) | `143942.81529017858` ns (`± 463.05647099861875`) | `108.62` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `15639121.205357144` ns (`± 11486.123930053847`) | `120134.89614633414` ns (`± 192.54329690055798`) | `130.18` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `15588852.395833334` ns (`± 18097.666946905916`) | `150802.53208705358` ns (`± 764.4027973144957`) | `103.37` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `15638345.9375` ns (`± 6418.243585705238`) | `240391.75130208334` ns (`± 632.1422687457991`) | `65.05` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/2609921273b8e643f9da8cdc51afb75c93436178#commitcomment-147927908
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Retrying to generate a commit and push to remote gh-pages with retry count 10...
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Retrying to generate a commit and push to remote gh-pages with retry count 9...
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespLuaStress)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespLuaStress)
Retrying to generate a commit and push to remote gh-pages with retry count 10...
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Retrying to generate a commit and push to remote gh-pages with retry count 10...
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Retrying to generate a commit and push to remote gh-pages with retry count 9...
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2471.1294351305282 and current value is 1064605.2116350445. It is 430.8172597113719x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18996.77194918119 and current value is 1085210.224609375. It is 57.12603317618656x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 1095103.714564732. It is 41.7724596085097x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 1079720.6597377232. It is 78.24670088083148x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 197105.64436035155 and current value is 1253288.259765625. It is 6.358459514606007x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 184024.47240397136 and current value is 1232686.2193080357. It is 6.698490712702804x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 1222752.479361979. It is 7.756523439867245x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 1295960.8313151042. It is 6.413223224392111x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 1308914.2420572916. It is 5.547315496786591x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2417.139801612267 and current value is 15626670.673076924. It is 6464.942848011401x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18088.291727701824 and current value is 15543849.21875. It is 859.3320725220798x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26138.006474421574 and current value is 15631665. It is 598.0435047828537x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 15615955.833333334. It is 1119.945241363395x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 15638575.3125. It is 111.29857915164716x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 143942.81529017858 and current value is 15634982.916666666. It is 108.61940476256243x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 15639121.205357144. It is 130.17967057887503x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 15588852.395833334. It is 103.3726170249872x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 15638345.9375. It is 65.05358795713583x worse than previous exceeding a ratio threshold 2

Artifacts

Produced during runtime
Name Size
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
254 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
228 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
232 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
240 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
258 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
232 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
236 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
244 Bytes
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
8.85 KB
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
9.51 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
8.54 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
10.7 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
15.1 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
8.08 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
6.48 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
6.62 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
8.38 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
8.42 KB
Results-windows-latest-net8.0-Release-Resp.RespParseStress
11.2 KB
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
5.71 KB