Skip to content

Garnet CI BDN.benchmark #112

Garnet CI BDN.benchmark

Garnet CI BDN.benchmark #112

Manually triggered October 14, 2024 21:17
Status Failure
Total duration 6m 9s
Artifacts 24

ci-bdnbenchmark.yml

on: workflow_dispatch
Check for changes
7s
Check for changes
Matrix: BDNBenchmark
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 19 warnings
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: f621f1160104f3f1be63b7a3268169fb499f332c | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `1063563.7904897837` ns (`± 393.56252090493126`) | `2471.1294351305282` ns (`± 12.949508963376248`) | `430.40` | | `BDN.benchmark.Resp.RespParseStress.Set` | `1082553.8132161458` ns (`± 905.8693416918933`) | `18996.77194918119` ns (`± 37.42607751602984`) | `56.99` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `1089696.1391276042` ns (`± 713.7560009302882`) | `26215.926110839842` ns (`± 136.66928475243665`) | `41.57` | | `BDN.benchmark.Resp.RespParseStress.Get` | `1076618.3029947917` ns (`± 724.1157962102372`) | `13798.928869628906` ns (`± 64.21500147899489`) | `78.02` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `1251657.1592548077` ns (`± 2538.0554523887754`) | `197105.64436035155` ns (`± 1763.9160246358654`) | `6.35` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `1238325.1815104166` ns (`± 1489.192493812088`) | `184024.47240397136` ns (`± 1014.2859833621429`) | `6.73` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `1224627.528450521` ns (`± 1459.1379589134558`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `7.77` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `1289586.020703125` ns (`± 14811.702637047716`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `6.38` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `1306817.929408482` ns (`± 3205.5493643536884`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `5.54` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/f621f1160104f3f1be63b7a3268169fb499f332c#commitcomment-147927473
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`. | Benchmark suite | Current: f621f1160104f3f1be63b7a3268169fb499f332c | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `15596023.4375` ns (`± 125317.38075667163`) | `2417.139801612267` ns (`± 5.332391242477296`) | `6452.26` | | `BDN.benchmark.Resp.RespParseStress.Set` | `15565019.166666666` ns (`± 248124.50987791945`) | `18088.291727701824` ns (`± 26.527437904880887`) | `860.50` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `15627359.82142857` ns (`± 3135.777534664942`) | `26138.006474421574` ns (`± 22.167591954955206`) | `597.88` | | `BDN.benchmark.Resp.RespParseStress.Get` | `15630074.55357143` ns (`± 2360.0040097414835`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1120.96` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `15633594.583333334` ns (`± 6949.709781913729`) | `140510.107421875` ns (`± 349.47163991529584`) | `111.26` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `15639608.92857143` ns (`± 13544.635237453216`) | `143942.81529017858` ns (`± 463.05647099861875`) | `108.65` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `15566247.708333334` ns (`± 170310.90775577244`) | `120134.89614633414` ns (`± 192.54329690055798`) | `129.57` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `15585964.270833334` ns (`± 24219.303060121405`) | `150802.53208705358` ns (`± 764.4027973144957`) | `103.35` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `15636556.971153846` ns (`± 3917.5023669005577`) | `240391.75130208334` ns (`± 632.1422687457991`) | `65.05` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/f621f1160104f3f1be63b7a3268169fb499f332c#commitcomment-147927492
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2471.1294351305282 and current value is 1063563.7904897837. It is 430.39582442333904x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18996.77194918119 and current value is 1082553.8132161458. It is 56.98619829264238x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 1089696.1391276042. It is 41.5661889845285x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 1076618.3029947917. It is 78.02187497062916x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 197105.64436035155 and current value is 1251657.1592548077. It is 6.350184254320536x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 184024.47240397136 and current value is 1238325.1815104166. It is 6.729133170897181x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 1224627.528450521. It is 7.768417803159615x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 1289586.020703125. It is 6.3816766818732615x worse than previous exceeding a ratio threshold 2
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 1306817.929408482. It is 5.538431104464162x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2417.139801612267 and current value is 15596023.4375. It is 6452.263715610172x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18088.291727701824 and current value is 15565019.166666666. It is 860.50243997498x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26138.006474421574 and current value is 15627359.82142857. It is 597.878795260127x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 15630074.55357143. It is 1120.9578078507466x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 15633594.583333334. It is 111.26313167204549x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 143942.81529017858 and current value is 15639608.92857143. It is 108.65154260768819x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 15566247.708333334. It is 129.57307333393263x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 15585964.270833334. It is 103.35346532401753x worse than previous exceeding a ratio threshold 2
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 15636556.971153846. It is 65.04614607805111x worse than previous exceeding a ratio threshold 2

Artifacts

Produced during runtime
Name Size
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
254 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
228 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
232 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
240 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
258 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
232 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
236 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
244 Bytes
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
9.43 KB
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
9.34 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
11.1 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
10.9 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
15.3 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
8.56 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
6.55 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
6.53 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
8.43 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
8.5 KB
Results-windows-latest-net8.0-Release-Resp.RespParseStress
10.7 KB
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
5.86 KB