Garnet CI BDN.benchmark #112
ci-bdnbenchmark.yml
on: workflow_dispatch
Check for changes
7s
Matrix: BDNBenchmark
Annotations
10 errors and 19 warnings
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespTsavoriteStress)
Process completed with exit code 1.
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`.
| Benchmark suite | Current: f621f1160104f3f1be63b7a3268169fb499f332c | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio |
|-|-|-|-|
| `BDN.benchmark.Resp.RespParseStress.InlinePing` | `1063563.7904897837` ns (`± 393.56252090493126`) | `2471.1294351305282` ns (`± 12.949508963376248`) | `430.40` |
| `BDN.benchmark.Resp.RespParseStress.Set` | `1082553.8132161458` ns (`± 905.8693416918933`) | `18996.77194918119` ns (`± 37.42607751602984`) | `56.99` |
| `BDN.benchmark.Resp.RespParseStress.SetEx` | `1089696.1391276042` ns (`± 713.7560009302882`) | `26215.926110839842` ns (`± 136.66928475243665`) | `41.57` |
| `BDN.benchmark.Resp.RespParseStress.Get` | `1076618.3029947917` ns (`± 724.1157962102372`) | `13798.928869628906` ns (`± 64.21500147899489`) | `78.02` |
| `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `1251657.1592548077` ns (`± 2538.0554523887754`) | `197105.64436035155` ns (`± 1763.9160246358654`) | `6.35` |
| `BDN.benchmark.Resp.RespParseStress.LPushPop` | `1238325.1815104166` ns (`± 1489.192493812088`) | `184024.47240397136` ns (`± 1014.2859833621429`) | `6.73` |
| `BDN.benchmark.Resp.RespParseStress.SAddRem` | `1224627.528450521` ns (`± 1459.1379589134558`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `7.77` |
| `BDN.benchmark.Resp.RespParseStress.HSetDel` | `1289586.020703125` ns (`± 14811.702637047716`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `6.38` |
| `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `1306817.929408482` ns (`± 3205.5493643536884`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `5.54` |
This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
CC: @darrenge
Comment was generated at https://github.com/darrenge/garnet/commit/f621f1160104f3f1be63b7a3268169fb499f332c#commitcomment-147927473
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
|
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterBench)
Process completed with exit code 1.
|
BDNBenchmark (windows-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Process completed with exit code 1.
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `2`.
| Benchmark suite | Current: f621f1160104f3f1be63b7a3268169fb499f332c | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio |
|-|-|-|-|
| `BDN.benchmark.Resp.RespParseStress.InlinePing` | `15596023.4375` ns (`± 125317.38075667163`) | `2417.139801612267` ns (`± 5.332391242477296`) | `6452.26` |
| `BDN.benchmark.Resp.RespParseStress.Set` | `15565019.166666666` ns (`± 248124.50987791945`) | `18088.291727701824` ns (`± 26.527437904880887`) | `860.50` |
| `BDN.benchmark.Resp.RespParseStress.SetEx` | `15627359.82142857` ns (`± 3135.777534664942`) | `26138.006474421574` ns (`± 22.167591954955206`) | `597.88` |
| `BDN.benchmark.Resp.RespParseStress.Get` | `15630074.55357143` ns (`± 2360.0040097414835`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1120.96` |
| `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `15633594.583333334` ns (`± 6949.709781913729`) | `140510.107421875` ns (`± 349.47163991529584`) | `111.26` |
| `BDN.benchmark.Resp.RespParseStress.LPushPop` | `15639608.92857143` ns (`± 13544.635237453216`) | `143942.81529017858` ns (`± 463.05647099861875`) | `108.65` |
| `BDN.benchmark.Resp.RespParseStress.SAddRem` | `15566247.708333334` ns (`± 170310.90775577244`) | `120134.89614633414` ns (`± 192.54329690055798`) | `129.57` |
| `BDN.benchmark.Resp.RespParseStress.HSetDel` | `15585964.270833334` ns (`± 24219.303060121405`) | `150802.53208705358` ns (`± 764.4027973144957`) | `103.35` |
| `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `15636556.971153846` ns (`± 3917.5023669005577`) | `240391.75130208334` ns (`± 632.1422687457991`) | `65.05` |
This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
CC: @darrenge
Comment was generated at https://github.com/darrenge/garnet/commit/f621f1160104f3f1be63b7a3268169fb499f332c#commitcomment-147927492
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Process completed with exit code 1.
|
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2471.1294351305282 and current value is 1063563.7904897837. It is 430.39582442333904x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18996.77194918119 and current value is 1082553.8132161458. It is 56.98619829264238x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 1089696.1391276042. It is 41.5661889845285x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 1076618.3029947917. It is 78.02187497062916x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 197105.64436035155 and current value is 1251657.1592548077. It is 6.350184254320536x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 184024.47240397136 and current value is 1238325.1815104166. It is 6.729133170897181x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 1224627.528450521. It is 7.768417803159615x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 1289586.020703125. It is 6.3816766818732615x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 1306817.929408482. It is 5.538431104464162x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2417.139801612267 and current value is 15596023.4375. It is 6452.263715610172x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18088.291727701824 and current value is 15565019.166666666. It is 860.50243997498x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26138.006474421574 and current value is 15627359.82142857. It is 597.878795260127x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 15630074.55357143. It is 1120.9578078507466x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 15633594.583333334. It is 111.26313167204549x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 143942.81529017858 and current value is 15639608.92857143. It is 108.65154260768819x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 15566247.708333334. It is 129.57307333393263x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 15585964.270833334. It is 103.35346532401753x worse than previous exceeding a ratio threshold 2
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 15636556.971153846. It is 65.04614607805111x worse than previous exceeding a ratio threshold 2
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
|
240 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
254 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
240 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
|
228 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
|
232 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
|
240 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
|
244 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
258 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
244 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
|
232 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
|
236 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
|
244 Bytes |
|
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
|
9.43 KB |
|
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
9.34 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
11.1 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
|
10.9 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
|
15.3 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
|
8.56 KB |
|
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
|
6.55 KB |
|
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
6.53 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
8.43 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
|
8.5 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespParseStress
|
10.7 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
|
5.86 KB |
|