Skip to content

Commit

Permalink
Bump to 50% threshold
Browse files Browse the repository at this point in the history
  • Loading branch information
@darrenge
darrenge committed Oct 14, 2024
1 parent a3f13c8 commit 3db56b1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion .github/workflows/ci-bdnbenchmark.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@ jobs:
tool: 'benchmarkdotnet'
output-file-path: ./test/BDNPerfTests/BenchmarkDotNet.Artifacts/results/BDN.benchmark.${{ matrix.test }}-report-full-compressed.json
github-token: ${{ secrets.GITHUB_TOKEN }}
alert-threshold: '20%'
alert-threshold: '50%'
external-data-json-path: ./cache/benchmark-data.json
comment-on-alert: true
fail-on-alert: true
Expand Down

2 comments on commit 3db56b1

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 0.50.

Benchmark suite Current: 3db56b1 Previous: 39b17ad Ratio
BDN.benchmark.Resp.RespParseStress.InlinePing 2093.6001575176533 ns (± 3.0488151182163925) 2471.1294351305282 ns (± 12.949508963376248) 0.85
BDN.benchmark.Resp.RespParseStress.Set 18354.934443547176 ns (± 14.485505188819548) 18996.77194918119 ns (± 37.42607751602984) 0.97
BDN.benchmark.Resp.RespParseStress.SetEx 27068.385321044923 ns (± 228.82596737899433) 26215.926110839842 ns (± 136.66928475243665) 1.03
BDN.benchmark.Resp.RespParseStress.Get 13367.289486476353 ns (± 86.89584525205507) 13798.928869628906 ns (± 64.21500147899489) 0.97
BDN.benchmark.Resp.RespParseStress.ZAddRem 188740.30941336494 ns (± 2510.1443662426755) 197105.64436035155 ns (± 1763.9160246358654) 0.96
BDN.benchmark.Resp.RespParseStress.LPushPop 168365.07983398438 ns (± 607.9930878441944) 184024.47240397136 ns (± 1014.2859833621429) 0.91
BDN.benchmark.Resp.RespParseStress.SAddRem 159032.36904296876 ns (± 1584.343236165707) 157641.8209577288 ns (± 1020.5646495658468) 1.01
BDN.benchmark.Resp.RespParseStress.HSetDel 194800.68352864584 ns (± 2778.1808991779794) 202076.3640950521 ns (± 2790.8043002402414) 0.96
BDN.benchmark.Resp.RespParseStress.MyDictSetGet 237725.02606670672 ns (± 857.5259249459555) 235954.53383091517 ns (± 1092.1170404907311) 1.01

This comment was automatically generated by workflow using github-action-benchmark.

CC: @darrenge

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 0.50.

Benchmark suite Current: 3db56b1 Previous: 521927f Ratio
BDN.benchmark.Resp.RespParseStress.InlinePing 2257.8180166391226 ns (± 3.6878127730458545) 2417.139801612267 ns (± 5.332391242477296) 0.93
BDN.benchmark.Resp.RespParseStress.Set 18243.28120304988 ns (± 56.118058498247294) 18088.291727701824 ns (± 26.527437904880887) 1.01
BDN.benchmark.Resp.RespParseStress.SetEx 26025.816462590145 ns (± 44.0956320282025) 26138.006474421574 ns (± 22.167591954955206) 1.00
BDN.benchmark.Resp.RespParseStress.Get 13922.256796700614 ns (± 10.604450586219146) 13943.499428885323 ns (± 14.698601246714226) 1.00
BDN.benchmark.Resp.RespParseStress.ZAddRem 148946.9761439732 ns (± 316.2148893192875) 140510.107421875 ns (± 349.47163991529584) 1.06
BDN.benchmark.Resp.RespParseStress.LPushPop 130564.75266676683 ns (± 243.91254872957555) 143942.81529017858 ns (± 463.05647099861875) 0.91
BDN.benchmark.Resp.RespParseStress.SAddRem 128817.94782366071 ns (± 322.33524548362) 120134.89614633414 ns (± 192.54329690055798) 1.07
BDN.benchmark.Resp.RespParseStress.HSetDel 154807.90812174478 ns (± 408.092978778579) 150802.53208705358 ns (± 764.4027973144957) 1.03
BDN.benchmark.Resp.RespParseStress.MyDictSetGet 248072.74344308037 ns (± 591.787952993215) 240391.75130208334 ns (± 632.1422687457991) 1.03

This comment was automatically generated by workflow using github-action-benchmark.

CC: @darrenge

Please sign in to comment.