Skip to content

increase load benchmark scenario durations #9567

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 5 commits into
base: master
Choose a base branch
from
Draft

increase load benchmark scenario durations #9567

wants to merge 5 commits into from

Conversation

igoragoli
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@datadog-official Datadog Official
Copy link

datadog-official bot commented Sep 19, 2025 •
edited by datadog-datadog-prod-us1 bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 60.15% (+0.37%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: ad3458c | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 19, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758822615 1758807921
git_commit_sha 61c2d97 100af21
release_version 1.54.0-SNAPSHOT~61c2d97420 1.54.0-SNAPSHOT~100af21ae1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758867127 1758867127
ci_job_id 1149093443 1149093443
ci_pipeline_id 77523807 77523807
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-rv6iem14 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-rv6iem14 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 19 performance regressions! Performance is the same for 35 metrics, 5 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start worse
[+35.998ms; +51.160ms] or [+3.143%; +4.467%]		 1.189s 1.145s
scenario:startup:insecure-bank:iast:BytebuddyAgent worse
[+34.324ms; +46.563ms] or [+4.233%; +5.743%]		 851.258ms 810.814ms
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+5.287ms; +10.183ms] or [+2.235%; +4.304%]		 244.310ms 236.575ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+54.011ms; +62.258ms] or [+5.383%; +6.205%]		 1.062s 1.003s
scenario:startup:insecure-bank:tracing:BytebuddyAgent worse
[+42.827ms; +49.014ms] or [+6.237%; +7.138%]		 732.611ms 686.690ms
scenario:startup:insecure-bank:tracing:Telemetry worse
[+7.073ms; +7.772ms] or [+77.871%; +85.567%]		 16.505ms 9.083ms
scenario:startup:petclinic:appsec:Agent.start worse
[+29.488ms; +63.813ms] or [+2.469%; +5.343%]		 1.241s 1.194s
scenario:startup:petclinic:appsec:BytebuddyAgent worse
[+31.950ms; +53.601ms] or [+4.464%; +7.489%]		 758.516ms 715.741ms
scenario:startup:petclinic:iast:Agent.start worse
[+35.712ms; +70.287ms] or [+3.128%; +6.156%]		 1.195s 1.142s
scenario:startup:petclinic:iast:BytebuddyAgent worse
[+34.848ms; +62.117ms] or [+4.314%; +7.690%]		 856.273ms 807.790ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+5.251ms; +11.537ms] or [+2.219%; +4.875%]		 245.044ms 236.650ms
scenario:startup:petclinic:profiling:Agent.start worse
[+51.819ms; +68.436ms] or [+4.502%; +5.945%]		 1.211s 1.151s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+5.535ms; +10.197ms] or [+5.467%; +10.073%]		 109.097ms 101.231ms
scenario:startup:petclinic:profiling:BytebuddyAgent worse
[+40.242ms; +47.004ms] or [+5.611%; +6.554%]		 760.841ms 717.218ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+7.069ms; +12.582ms] or [+3.153%; +5.613%]		 234.010ms 224.185ms
scenario:startup:petclinic:profiling:Profiling worse
[+5.593ms; +10.297ms] or [+5.493%; +10.113%]		 109.766ms 101.820ms
scenario:startup:petclinic:tracing:Agent.start worse
[+46.499ms; +77.615ms] or [+4.630%; +7.729%]		 1.066s 1.004s
scenario:startup:petclinic:tracing:BytebuddyAgent worse
[+37.543ms; +59.576ms] or [+5.460%; +8.664%]		 736.193ms 687.634ms
scenario:startup:petclinic:tracing:Telemetry worse
[+6.857ms; +7.570ms] or [+76.274%; +84.211%]		 16.203ms 8.989ms
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.003 s) : 0, 1003401
Total [baseline] (8.652 s) : 0, 8652479
Agent [candidate] (1.062 s) : 0, 1061536
Total [candidate] (8.588 s) : 0, 8588219
section iast
Agent [baseline] (1.145 s) : 0, 1145334
Total [baseline] (9.25 s) : 0, 9249652
Agent [candidate] (1.189 s) : 0, 1188913
Total [candidate] (9.283 s) : 0, 9282560
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.003 s -
Agent iast 1.145 s 141.933 ms (14.1%)
Total tracing 8.652 s -
Total iast 9.25 s 597.173 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.189 s 127.377 ms (12.0%)
Total tracing 8.588 s -
Total iast 9.283 s 694.342 ms (8.1%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.449 ms) : 0, 1449
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (686.69 ms) : 0, 686690
BytebuddyAgent [candidate] (732.611 ms) : 0, 732611
GlobalTracer [baseline] (246.961 ms) : 0, 246961
GlobalTracer [candidate] (252.237 ms) : 0, 252237
AppSec [baseline] (31.226 ms) : 0, 31226
AppSec [candidate] (30.627 ms) : 0, 30627
Debugger [baseline] (6.316 ms) : 0, 6316
Debugger [candidate] (6.348 ms) : 0, 6348
Remote Config [baseline] (673.551 µs) : 0, 674
Remote Config [candidate] (695.505 µs) : 0, 696
Telemetry [baseline] (9.083 ms) : 0, 9083
Telemetry [candidate] (16.505 ms) : 0, 16505
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (810.814 ms) : 0, 810814
BytebuddyAgent [candidate] (851.258 ms) : 0, 851258
GlobalTracer [baseline] (236.575 ms) : 0, 236575
GlobalTracer [candidate] (244.31 ms) : 0, 244310
IAST [baseline] (27.096 ms) : 0, 27096
IAST [candidate] (29.851 ms) : 0, 29851
AppSec [baseline] (33.035 ms) : 0, 33035
AppSec [candidate] (26.31 ms) : 0, 26310
Debugger [baseline] (6.115 ms) : 0, 6115
Debugger [candidate] (6.051 ms) : 0, 6051
Remote Config [baseline] (603.078 µs) : 0, 603
Remote Config [candidate] (607.713 µs) : 0, 608
Telemetry [baseline] (8.338 ms) : 0, 8338
Telemetry [candidate] (8.123 ms) : 0, 8123
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.004 s) : 0, 1004213
Total [baseline] (10.635 s) : 0, 10635499
Agent [candidate] (1.066 s) : 0, 1066270
Total [candidate] (10.687 s) : 0, 10687143
section appsec
Agent [baseline] (1.194 s) : 0, 1194397
Total [baseline] (10.915 s) : 0, 10915138
Agent [candidate] (1.241 s) : 0, 1241047
Total [candidate] (11.03 s) : 0, 11029797
section iast
Agent [baseline] (1.142 s) : 0, 1141809
Total [baseline] (10.895 s) : 0, 10895498
Agent [candidate] (1.195 s) : 0, 1194809
Total [candidate] (10.945 s) : 0, 10944872
section profiling
Agent [baseline] (1.151 s) : 0, 1151069
Total [baseline] (11.016 s) : 0, 11016301
Agent [candidate] (1.211 s) : 0, 1211197
Total [candidate] (11.071 s) : 0, 11070968
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.004 s -
Agent appsec 1.194 s 190.183 ms (18.9%)
Agent iast 1.142 s 137.596 ms (13.7%)
Agent profiling 1.151 s 146.855 ms (14.6%)
Total tracing 10.635 s -
Total appsec 10.915 s 279.639 ms (2.6%)
Total iast 10.895 s 259.999 ms (2.4%)
Total profiling 11.016 s 380.802 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.241 s 174.776 ms (16.4%)
Agent iast 1.195 s 128.539 ms (12.1%)
Agent profiling 1.211 s 144.926 ms (13.6%)
Total tracing 10.687 s -
Total appsec 11.03 s 342.654 ms (3.2%)
Total iast 10.945 s 257.729 ms (2.4%)
Total profiling 11.071 s 383.824 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (687.634 ms) : 0, 687634
BytebuddyAgent [candidate] (736.193 ms) : 0, 736193
GlobalTracer [baseline] (247.238 ms) : 0, 247238
GlobalTracer [candidate] (253.411 ms) : 0, 253411
AppSec [baseline] (30.795 ms) : 0, 30795
AppSec [candidate] (30.691 ms) : 0, 30691
Debugger [baseline] (6.353 ms) : 0, 6353
Debugger [candidate] (6.409 ms) : 0, 6409
Remote Config [baseline] (679.579 µs) : 0, 680
Remote Config [candidate] (695.654 µs) : 0, 696
Telemetry [baseline] (8.989 ms) : 0, 8989
Telemetry [candidate] (16.203 ms) : 0, 16203
section appsec
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (715.741 ms) : 0, 715741
BytebuddyAgent [candidate] (758.516 ms) : 0, 758516
GlobalTracer [baseline] (241.628 ms) : 0, 241628
GlobalTracer [candidate] (247.674 ms) : 0, 247674
IAST [baseline] (25.098 ms) : 0, 25098
IAST [candidate] (23.994 ms) : 0, 23994
AppSec [baseline] (172.537 ms) : 0, 172537
AppSec [candidate] (172.849 ms) : 0, 172849
Debugger [baseline] (5.974 ms) : 0, 5974
Debugger [candidate] (6.126 ms) : 0, 6126
Remote Config [baseline] (636.768 µs) : 0, 637
Remote Config [candidate] (631.222 µs) : 0, 631
Telemetry [baseline] (10.079 ms) : 0, 10079
Telemetry [candidate] (8.494 ms) : 0, 8494
section iast
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.45 ms) : 0, 1450
BytebuddyAgent [baseline] (807.79 ms) : 0, 807790
BytebuddyAgent [candidate] (856.273 ms) : 0, 856273
GlobalTracer [baseline] (236.65 ms) : 0, 236650
GlobalTracer [candidate] (245.044 ms) : 0, 245044
IAST [baseline] (26.06 ms) : 0, 26060
IAST [candidate] (29.76 ms) : 0, 29760
AppSec [baseline] (33.768 ms) : 0, 33768
AppSec [candidate] (26.31 ms) : 0, 26310
Debugger [baseline] (6.01 ms) : 0, 6010
Debugger [candidate] (6.023 ms) : 0, 6023
Remote Config [baseline] (595.563 µs) : 0, 596
Remote Config [candidate] (610.645 µs) : 0, 611
Telemetry [baseline] (8.278 ms) : 0, 8278
Telemetry [candidate] (8.307 ms) : 0, 8307
section profiling
crashtracking [baseline] (1.447 ms) : 0, 1447
crashtracking [candidate] (1.432 ms) : 0, 1432
BytebuddyAgent [baseline] (717.218 ms) : 0, 717218
BytebuddyAgent [candidate] (760.841 ms) : 0, 760841
GlobalTracer [baseline] (224.185 ms) : 0, 224185
GlobalTracer [candidate] (234.01 ms) : 0, 234010
AppSec [baseline] (31.246 ms) : 0, 31246
AppSec [candidate] (30.524 ms) : 0, 30524
Debugger [baseline] (6.53 ms) : 0, 6530
Debugger [candidate] (6.66 ms) : 0, 6660
Remote Config [baseline] (725.087 µs) : 0, 725
Remote Config [candidate] (702.528 µs) : 0, 703
Telemetry [baseline] (16.305 ms) : 0, 16305
Telemetry [candidate] (16.723 ms) : 0, 16723
ProfilingAgent [baseline] (101.231 ms) : 0, 101231
ProfilingAgent [candidate] (109.097 ms) : 0, 109097
Profiling [baseline] (101.82 ms) : 0, 101820
Profiling [candidate] (109.766 ms) : 0, 109766
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758822615 1758807921
git_commit_sha 61c2d97 100af21
release_version 1.54.0-SNAPSHOT~61c2d97420 1.54.0-SNAPSHOT~100af21ae1
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758868784 1758868784
ci_job_id 1149093445 1149093445
ci_pipeline_id 77523807 77523807
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gwnudb4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gwnudb4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 5 performance regressions! Performance is the same for 13 metrics, 2 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-120.038µs; -89.908µs] or [-3.750%; -2.809%]		 unstable
[-35.583op/s; +135.028op/s] or [-2.361%; +8.960%]		 3.096ms 1556.718op/s 3.201ms 1506.995op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-415.854µs; -334.274µs] or [-5.544%; -4.456%]		 unsure
[+7.335op/s; +60.506op/s] or [+1.124%; +9.276%]		 7.126ms 686.228op/s 7.501ms 652.307op/s
scenario:load:petclinic:code_origins:high_load worse
[+0.966ms; +1.102ms] or [+4.524%; +5.165%]		 worse
[-15.241op/s; -6.018op/s] or [-6.600%; -2.606%]		 22.378ms 220.281op/s 21.344ms 230.911op/s
scenario:load:petclinic:no_agent:high_load worse
[+917.873µs; +1029.351µs] or [+4.866%; +5.457%]		 worse
[-17.284op/s; -8.233op/s] or [-6.619%; -3.153%]		 19.837ms 248.370op/s 18.863ms 261.129op/s
scenario:load:petclinic:appsec:high_load worse
[+688.644µs; +838.727µs] or [+3.049%; +3.713%]		 unsure
[-11.965op/s; -2.268op/s] or [-5.483%; -1.039%]		 23.353ms 211.127op/s 22.589ms 218.244op/s
scenario:load:petclinic:iast:high_load better
[-1014.698µs; -884.164µs] or [-4.759%; -4.147%]		 better
[+5.898op/s; +15.555op/s] or [+2.551%; +6.729%]		 20.371ms 241.889op/s 21.321ms 231.162op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.362 ms) : 1357, 1368
.   : milestone, 1362,
iast (4.127 ms) : 4107, 4147
.   : milestone, 4127,
iast_FULL (7.501 ms) : 7461, 7541
.   : milestone, 7501,
iast_GLOBAL (4.623 ms) : 4597, 4648
.   : milestone, 4623,
profiling (3.201 ms) : 3187, 3215
.   : milestone, 3201,
tracing (2.739 ms) : 2727, 2751
.   : milestone, 2739,
section candidate
no_agent (1.379 ms) : 1373, 1385
.   : milestone, 1379,
iast (4.096 ms) : 4077, 4116
.   : milestone, 4096,
iast_FULL (7.126 ms) : 7090, 7162
.   : milestone, 7126,
iast_GLOBAL (4.549 ms) : 4524, 4574
.   : milestone, 4549,
profiling (3.096 ms) : 3082, 3110
.   : milestone, 3096,
tracing (2.697 ms) : 2685, 2709
.   : milestone, 2697,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.357 ms, 1.368 ms] -
iast 4.127 ms [4.107 ms, 4.147 ms] 2.765 ms (202.9%)
iast_FULL 7.501 ms [7.461 ms, 7.541 ms] 6.138 ms (450.5%)
iast_GLOBAL 4.623 ms [4.597 ms, 4.648 ms] 3.26 ms (239.3%)
profiling 3.201 ms [3.187 ms, 3.215 ms] 1.838 ms (134.9%)
tracing 2.739 ms [2.727 ms, 2.751 ms] 1.377 ms (101.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.379 ms [1.373 ms, 1.385 ms] -
iast 4.096 ms [4.077 ms, 4.116 ms] 2.717 ms (197.0%)
iast_FULL 7.126 ms [7.09 ms, 7.162 ms] 5.747 ms (416.6%)
iast_GLOBAL 4.549 ms [4.524 ms, 4.574 ms] 3.169 ms (229.8%)
profiling 3.096 ms [3.082 ms, 3.11 ms] 1.717 ms (124.5%)
tracing 2.697 ms [2.685 ms, 2.709 ms] 1.318 ms (95.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.863 ms) : 18813, 18914
.   : milestone, 18863,
appsec (22.589 ms) : 22520, 22658
.   : milestone, 22589,
code_origins (21.344 ms) : 21282, 21406
.   : milestone, 21344,
iast (21.321 ms) : 21258, 21383
.   : milestone, 21321,
profiling (23.663 ms) : 23592, 23735
.   : milestone, 23663,
tracing (21.674 ms) : 21610, 21739
.   : milestone, 21674,
section candidate
no_agent (19.837 ms) : 19784, 19890
.   : milestone, 19837,
appsec (23.353 ms) : 23282, 23423
.   : milestone, 23353,
code_origins (22.378 ms) : 22313, 22444
.   : milestone, 22378,
iast (20.371 ms) : 20312, 20430
.   : milestone, 20371,
profiling (24.186 ms) : 24112, 24260
.   : milestone, 24186,
tracing (21.528 ms) : 21466, 21591
.   : milestone, 21528,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.863 ms [18.813 ms, 18.914 ms] -
appsec 22.589 ms [22.52 ms, 22.658 ms] 3.726 ms (19.8%)
code_origins 21.344 ms [21.282 ms, 21.406 ms] 2.481 ms (13.2%)
iast 21.321 ms [21.258 ms, 21.383 ms] 2.457 ms (13.0%)
profiling 23.663 ms [23.592 ms, 23.735 ms] 4.8 ms (25.4%)
tracing 21.674 ms [21.61 ms, 21.739 ms] 2.811 ms (14.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.837 ms [19.784 ms, 19.89 ms] -
appsec 23.353 ms [23.282 ms, 23.423 ms] 3.516 ms (17.7%)
code_origins 22.378 ms [22.313 ms, 22.444 ms] 2.541 ms (12.8%)
iast 20.371 ms [20.312 ms, 20.43 ms] 534.156 µs (2.7%)
profiling 24.186 ms [24.112 ms, 24.26 ms] 4.349 ms (21.9%)
tracing 21.528 ms [21.466 ms, 21.591 ms] 1.691 ms (8.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master augusto/benchmark-load-experiments
git_commit_date 1758822615 1758807921
git_commit_sha 61c2d97 100af21
release_version 1.54.0-SNAPSHOT~61c2d97420 1.54.0-SNAPSHOT~100af21ae1
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758867305 1758867305
ci_job_id 1149093447 1149093447
ci_pipeline_id 77523807 77523807
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-pafd4d1i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-pafd4d1i 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.714 ms) : 3497, 3930
.   : milestone, 3714,
iast (2.194 ms) : 2132, 2257
.   : milestone, 2194,
iast_GLOBAL (2.234 ms) : 2170, 2297
.   : milestone, 2234,
profiling (2.038 ms) : 1988, 2088
.   : milestone, 2038,
tracing (2.004 ms) : 1956, 2052
.   : milestone, 2004,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.726 ms) : 3510, 3942
.   : milestone, 3726,
iast (2.189 ms) : 2127, 2252
.   : milestone, 2189,
iast_GLOBAL (2.239 ms) : 2176, 2302
.   : milestone, 2239,
profiling (2.051 ms) : 1999, 2102
.   : milestone, 2051,
tracing (2.01 ms) : 1961, 2059
.   : milestone, 2010,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.714 ms [3.497 ms, 3.93 ms] 2.24 ms (152.1%)
iast 2.194 ms [2.132 ms, 2.257 ms] 720.939 µs (48.9%)
iast_GLOBAL 2.234 ms [2.17 ms, 2.297 ms] 760.294 µs (51.6%)
profiling 2.038 ms [1.988 ms, 2.088 ms] 564.404 µs (38.3%)
tracing 2.004 ms [1.956 ms, 2.052 ms] 530.795 µs (36.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 3.726 ms [3.51 ms, 3.942 ms] 2.252 ms (152.8%)
iast 2.189 ms [2.127 ms, 2.252 ms] 715.516 µs (48.5%)
iast_GLOBAL 2.239 ms [2.176 ms, 2.302 ms] 765.276 µs (51.9%)
profiling 2.051 ms [1.999 ms, 2.102 ms] 576.709 µs (39.1%)
tracing 2.01 ms [1.961 ms, 2.059 ms] 535.917 µs (36.4%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~100af21ae1, baseline=1.54.0-SNAPSHOT~61c2d97420
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.984 s) : 14984000, 14984000
.   : milestone, 14984000,
appsec (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
iast (18.663 s) : 18663000, 18663000
.   : milestone, 18663000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
profiling (15.401 s) : 15401000, 15401000
.   : milestone, 15401000,
tracing (15.192 s) : 15192000, 15192000
.   : milestone, 15192000,
section candidate
no_agent (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
appsec (14.941 s) : 14941000, 14941000
.   : milestone, 14941000,
iast (18.163 s) : 18163000, 18163000
.   : milestone, 18163000,
iast_GLOBAL (18.04 s) : 18040000, 18040000
.   : milestone, 18040000,
profiling (15.324 s) : 15324000, 15324000
.   : milestone, 15324000,
tracing (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.984 s [14.984 s, 14.984 s] -
appsec 15.024 s [15.024 s, 15.024 s] 40.0 ms (0.3%)
iast 18.663 s [18.663 s, 18.663 s] 3.679 s (24.6%)
iast_GLOBAL 18.045 s [18.045 s, 18.045 s] 3.061 s (20.4%)
profiling 15.401 s [15.401 s, 15.401 s] 417.0 ms (2.8%)
tracing 15.192 s [15.192 s, 15.192 s] 208.0 ms (1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.988 s [14.988 s, 14.988 s] -
appsec 14.941 s [14.941 s, 14.941 s] -47.0 ms (-0.3%)
iast 18.163 s [18.163 s, 18.163 s] 3.175 s (21.2%)
iast_GLOBAL 18.04 s [18.04 s, 18.04 s] 3.052 s (20.4%)
profiling 15.324 s [15.324 s, 15.324 s] 336.0 ms (2.2%)
tracing 14.963 s [14.963 s, 14.963 s] -25.0 ms (-0.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@igoragoli