Skip to content

Garnet CI BDN.benchmark #118

Garnet CI BDN.benchmark

Garnet CI BDN.benchmark #118

Manually triggered October 14, 2024 23:02
Status Failure
Total duration 6m 45s
Artifacts 24

ci-bdnbenchmark.yml

on: workflow_dispatch
Check for changes
3s
Check for changes
Matrix: BDNBenchmark
Fit to window
Zoom out
Zoom in

Annotations

3 errors and 23 warnings
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespLuaRunnerStress)
Process completed with exit code 1.
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `0.50`. | Benchmark suite | Current: 3db56b1947cf4fc8080d53fbcad091ff5c9dd1c2 | Previous: 39b17adf4b32b7d4289dbe6d7f164f27c0e6ce58 | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `2093.6001575176533` ns (`± 3.0488151182163925`) | `2471.1294351305282` ns (`± 12.949508963376248`) | `0.85` | | `BDN.benchmark.Resp.RespParseStress.Set` | `18354.934443547176` ns (`± 14.485505188819548`) | `18996.77194918119` ns (`± 37.42607751602984`) | `0.97` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `27068.385321044923` ns (`± 228.82596737899433`) | `26215.926110839842` ns (`± 136.66928475243665`) | `1.03` | | `BDN.benchmark.Resp.RespParseStress.Get` | `13367.289486476353` ns (`± 86.89584525205507`) | `13798.928869628906` ns (`± 64.21500147899489`) | `0.97` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `188740.30941336494` ns (`± 2510.1443662426755`) | `197105.64436035155` ns (`± 1763.9160246358654`) | `0.96` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `168365.07983398438` ns (`± 607.9930878441944`) | `184024.47240397136` ns (`± 1014.2859833621429`) | `0.91` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `159032.36904296876` ns (`± 1584.343236165707`) | `157641.8209577288` ns (`± 1020.5646495658468`) | `1.01` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `194800.68352864584` ns (`± 2778.1808991779794`) | `202076.3640950521` ns (`± 2790.8043002402414`) | `0.96` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `237725.02606670672` ns (`± 857.5259249459555`) | `235954.53383091517` ns (`± 1092.1170404907311`) | `1.01` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/3db56b1947cf4fc8080d53fbcad091ff5c9dd1c2#commitcomment-147929151
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `0.50`. | Benchmark suite | Current: 3db56b1947cf4fc8080d53fbcad091ff5c9dd1c2 | Previous: 521927ff4b4b476bb0433a047546b4ebc1a674cb | Ratio | |-|-|-|-| | `BDN.benchmark.Resp.RespParseStress.InlinePing` | `2257.8180166391226` ns (`± 3.6878127730458545`) | `2417.139801612267` ns (`± 5.332391242477296`) | `0.93` | | `BDN.benchmark.Resp.RespParseStress.Set` | `18243.28120304988` ns (`± 56.118058498247294`) | `18088.291727701824` ns (`± 26.527437904880887`) | `1.01` | | `BDN.benchmark.Resp.RespParseStress.SetEx` | `26025.816462590145` ns (`± 44.0956320282025`) | `26138.006474421574` ns (`± 22.167591954955206`) | `1.00` | | `BDN.benchmark.Resp.RespParseStress.Get` | `13922.256796700614` ns (`± 10.604450586219146`) | `13943.499428885323` ns (`± 14.698601246714226`) | `1.00` | | `BDN.benchmark.Resp.RespParseStress.ZAddRem` | `148946.9761439732` ns (`± 316.2148893192875`) | `140510.107421875` ns (`± 349.47163991529584`) | `1.06` | | `BDN.benchmark.Resp.RespParseStress.LPushPop` | `130564.75266676683` ns (`± 243.91254872957555`) | `143942.81529017858` ns (`± 463.05647099861875`) | `0.91` | | `BDN.benchmark.Resp.RespParseStress.SAddRem` | `128817.94782366071` ns (`± 322.33524548362`) | `120134.89614633414` ns (`± 192.54329690055798`) | `1.07` | | `BDN.benchmark.Resp.RespParseStress.HSetDel` | `154807.90812174478` ns (`± 408.092978778579`) | `150802.53208705358` ns (`± 764.4027973144957`) | `1.03` | | `BDN.benchmark.Resp.RespParseStress.MyDictSetGet` | `248072.74344308037` ns (`± 591.787952993215`) | `240391.75130208334` ns (`± 632.1422687457991`) | `1.03` | This comment was automatically generated by [workflow](https://github.com/darrenge/garnet/actions?query=workflow%3AGarnet%20CI%20BDN.benchmark) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). CC: @darrenge Comment was generated at https://github.com/darrenge/garnet/commit/3db56b1947cf4fc8080d53fbcad091ff5c9dd1c2#commitcomment-147929164
Check for changes
'before' field is missing in event payload - changes will be detected from last commit
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Retrying to generate a commit and push to remote gh-pages with retry count 10...
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Auto-push failed because the remote gh-pages was updated after git pull
BDNBenchmark (ubuntu-latest, net8.0, Release, Cluster.RespClusterMigrateBench)
Retrying to generate a commit and push to remote gh-pages with retry count 9...
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2471.1294351305282 and current value is 2093.6001575176533. It is 0.8472239971545913x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18996.77194918119 and current value is 18354.934443547176. It is 0.9662133383844891x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26215.926110839842 and current value is 27068.385321044923. It is 1.0325168451650695x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13798.928869628906 and current value is 13367.289486476353. It is 0.9687193558840222x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 197105.64436035155 and current value is 188740.30941336494. It is 0.9575591304138761x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 184024.47240397136 and current value is 168365.07983398438. It is 0.9149059232969221x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 157641.8209577288 and current value is 159032.36904296876. It is 1.0088209339171033x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 202076.3640950521 and current value is 194800.68352864584. It is 0.9639953905594623x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (ubuntu-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 235954.53383091517 and current value is 237725.02606670672. It is 1.0075035313246419x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 2417.139801612267 and current value is 2257.8180166391226. It is 0.9340866486634846x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 18088.291727701824 and current value is 18243.28120304988. It is 1.0085684971074793x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 26138.006474421574 and current value is 26025.816462590145. It is 0.9957077823841991x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 13943.499428885323 and current value is 13922.256796700614. It is 0.9984765207405034x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 140510.107421875 and current value is 148946.9761439732. It is 1.0600445681588364x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 143942.81529017858 and current value is 130564.75266676683. It is 0.907059879324699x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 120134.89614633414 and current value is 128817.94782366071. It is 1.0722775143264776x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 150802.53208705358 and current value is 154807.90812174478. It is 1.026560403059937x worse than previous exceeding a ratio threshold 0.5
BDNBenchmark (windows-latest, net8.0, Release, Resp.RespParseStress)
Performance alert! Previous value was 240391.75130208334 and current value is 248072.74344308037. It is 1.0319519787987437x worse than previous exceeding a ratio threshold 0.5

Artifacts

Produced during runtime
Name Size
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
254 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
240 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
228 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespParseStress
232 Bytes
ErrorLog-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
240 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterBench
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
258 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
244 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespLuaStress
232 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespParseStress
236 Bytes
ErrorLog-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
244 Bytes
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterBench
10.2 KB
Results-ubuntu-latest-net8.0-Release-Cluster.RespClusterMigrateBench
10.3 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaRunnerStress
10.9 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespLuaStress
8.63 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespParseStress
18.2 KB
Results-ubuntu-latest-net8.0-Release-Resp.RespTsavoriteStress
8.88 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterBench
7.84 KB
Results-windows-latest-net8.0-Release-Cluster.RespClusterMigrateBench
7.8 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaRunnerStress
8.43 KB
Results-windows-latest-net8.0-Release-Resp.RespLuaStress
8.51 KB
Results-windows-latest-net8.0-Release-Resp.RespParseStress
14.7 KB
Results-windows-latest-net8.0-Release-Resp.RespTsavoriteStress
6.82 KB