Skip to content

Commit

Permalink
Up threshold to 20%
Browse files Browse the repository at this point in the history
  • Loading branch information
@darrenge
darrenge committed Oct 14, 2024
1 parent d2fa240 commit a3f13c8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion .github/workflows/ci-bdnbenchmark.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@ jobs:
tool: 'benchmarkdotnet'
output-file-path: ./test/BDNPerfTests/BenchmarkDotNet.Artifacts/results/BDN.benchmark.${{ matrix.test }}-report-full-compressed.json
github-token: ${{ secrets.GITHUB_TOKEN }}
alert-threshold: '10%'
alert-threshold: '20%'
external-data-json-path: ./cache/benchmark-data.json
comment-on-alert: true
fail-on-alert: true
Expand Down

2 comments on commit a3f13c8

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 0.20.

Benchmark suite Current: a3f13c8 Previous: 39b17ad Ratio
BDN.benchmark.Resp.RespParseStress.InlinePing 2094.2433738708496 ns (± 3.316869505266483) 2471.1294351305282 ns (± 12.949508963376248) 0.85
BDN.benchmark.Resp.RespParseStress.Set 19142.89953358968 ns (± 27.710747023247414) 18996.77194918119 ns (± 37.42607751602984) 1.01
BDN.benchmark.Resp.RespParseStress.SetEx 26052.414423624676 ns (± 126.8445172135541) 26215.926110839842 ns (± 136.66928475243665) 0.99
BDN.benchmark.Resp.RespParseStress.Get 13401.59776763916 ns (± 85.39434166543964) 13798.928869628906 ns (± 64.21500147899489) 0.97
BDN.benchmark.Resp.RespParseStress.ZAddRem 186593.00467122396 ns (± 2602.943136174644) 197105.64436035155 ns (± 1763.9160246358654) 0.95
BDN.benchmark.Resp.RespParseStress.LPushPop 162044.8618727464 ns (± 498.41105862433915) 184024.47240397136 ns (± 1014.2859833621429) 0.88
BDN.benchmark.Resp.RespParseStress.SAddRem 157675.08628743488 ns (± 1599.7359946056617) 157641.8209577288 ns (± 1020.5646495658468) 1.00
BDN.benchmark.Resp.RespParseStress.HSetDel 213174.33557942708 ns (± 1742.409642740662) 202076.3640950521 ns (± 2790.8043002402414) 1.05
BDN.benchmark.Resp.RespParseStress.MyDictSetGet 238324.90016526444 ns (± 861.7285532896784) 235954.53383091517 ns (± 1092.1170404907311) 1.01

This comment was automatically generated by workflow using github-action-benchmark.

CC: @darrenge

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 0.20.

Benchmark suite Current: a3f13c8 Previous: 521927f Ratio
BDN.benchmark.Resp.RespParseStress.InlinePing 2254.0745074932393 ns (± 2.182048719741846) 2417.139801612267 ns (± 5.332391242477296) 0.93
BDN.benchmark.Resp.RespParseStress.Set 17521.038382393974 ns (± 32.878055551166405) 18088.291727701824 ns (± 26.527437904880887) 0.97
BDN.benchmark.Resp.RespParseStress.SetEx 27056.40575702374 ns (± 381.03693874328) 26138.006474421574 ns (± 22.167591954955206) 1.04
BDN.benchmark.Resp.RespParseStress.Get 13838.748059953961 ns (± 18.584175131573357) 13943.499428885323 ns (± 14.698601246714226) 0.99
BDN.benchmark.Resp.RespParseStress.ZAddRem 148867.7943638393 ns (± 287.48532541759556) 140510.107421875 ns (± 349.47163991529584) 1.06
BDN.benchmark.Resp.RespParseStress.LPushPop 126207.1027483259 ns (± 315.23302037620596) 143942.81529017858 ns (± 463.05647099861875) 0.88
BDN.benchmark.Resp.RespParseStress.SAddRem 128335.19984654018 ns (± 99.83380251651816) 120134.89614633414 ns (± 192.54329690055798) 1.07
BDN.benchmark.Resp.RespParseStress.HSetDel 162812.53380408653 ns (± 474.7517766977087) 150802.53208705358 ns (± 764.4027973144957) 1.08
BDN.benchmark.Resp.RespParseStress.MyDictSetGet 251643.46842447916 ns (± 920.9366221858834) 240391.75130208334 ns (± 632.1422687457991) 1.05

This comment was automatically generated by workflow using github-action-benchmark.

CC: @darrenge

Please sign in to comment.