Garnet CI BDN.benchmark #119
ci-bdnbenchmark.yml
on: workflow_dispatch
Check for changes
4s
Matrix: BDNBenchmark
Annotations
3 errors and 11 warnings
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespLuaRunnerStress)
Process completed with exit code 1.
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1`.
| Benchmark suite | Current: 980988bcff9ca1f077bf3eb362f0c4ea1c04bdf2 | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio |
|-|-|-|-|
| `BDN.benchmark.Resp.RespParseStress.SetEx` | `26842.587147639348` ns (`± 114.83469563329753`) | `26215.926110839842` ns (`± 136.66928475243665`) | `1.02` |
| `BDN.benchmark.Resp.RespParseStress.Get` | `14237.271223958332` ns (`± 112.01975939426748`) | `13798.928869628906` ns (`± 64.21500147899489`) | `1.03` |
| `BDN.benchmark.Resp.RespParseStress.SAddRem` | `157985.62470354352` ns (`± 1120.316461947115`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `1.00` |
| `BDN.benchmark.Resp.RespParseStress.HSetDel` | `203056.7072265625` ns (`± 1991.5912267817864`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `1.00` |
| `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `243715.8372333233` ns (`± 838.9569134416141`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `1.03` |
This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
CC: @darrenge
Comment was generated at https://github.com/darrenge/garnet/commit/980988bcff9ca1f077bf3eb362f0c4ea1c04bdf2#commitcomment-147929273
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning:
Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1`.
| Benchmark suite | Current: 3297f8b44e376a719569ab6cba7b9acfa4c30bf6 | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio |
|-|-|-|-|
| `BDN.benchmark.Resp.RespParseStress.Get` | `14192.444610595703` ns (`± 21.64354458077553`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1.02` |
| `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `144827.92593149038` ns (`± 177.88845687116626`) | `140510.107421875` ns (`± 349.47163991529584`) | `1.03` |
| `BDN.benchmark.Resp.RespParseStress.SAddRem` | `125847.56704477164` ns (`± 238.5735060571294`) | `120134.89614633414` ns (`± 192.54329690055798`) | `1.05` |
| `BDN.benchmark.Resp.RespParseStress.HSetDel` | `173075.46105018028` ns (`± 567.1651702298674`) | `150802.53208705358` ns (`± 764.4027973144957`) | `1.15` |
| `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `249762.58638822116` ns (`± 449.66884506030226`) | `240391.75130208334` ns (`± 632.1422687457991`) | `1.04` |
This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark).
CC: @darrenge
Comment was generated at https://github.com/darrenge/garnet/commit/3297f8b44e376a719569ab6cba7b9acfa4c30bf6#commitcomment-147929292
|
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 26842.587147639348. It is 1.0239038298380156x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 14237.271223958332. It is 1.0317664043688353x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 157985.62470354352. It is 1.0021809171178433x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 203056.7072265625. It is 1.004851349814713x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 243715.8372333233. It is 1.0328932158089825x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 14192.444610595703. It is 1.0178538524693928x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 144827.92593149038. It is 1.030729593684327x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 125847.56704477164. It is 1.047552135821377x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 173075.46105018028. It is 1.1476959879577435x worse than previous exceeding a ratio threshold 1
|
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 249762.58638822116. It is 1.0389815167757654x worse than previous exceeding a ratio threshold 1
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
|
240 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
254 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
240 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
|
228 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
|
232 Bytes |
|
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
|
240 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
|
244 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
258 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
244 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
|
232 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
|
236 Bytes |
|
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
|
244 Bytes |
|
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
|
10.4 KB |
|
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
10.4 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
11.1 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
|
8.51 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
|
15.7 KB |
|
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
|
6.67 KB |
|
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
|
7.83 KB |
|
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
|
7.81 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
|
8.37 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
|
8.47 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespParseStress
|
15.2 KB |
|
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
|
6.88 KB |
|