Skip to content

Update task naming in gradle files PT 4 #9640

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 5 commits into
base: master
Choose a base branch
from
Draft

Update task naming in gradle files PT 4 #9640

wants to merge 5 commits into from

Conversation

sarahchen6
Copy link
Contributor

What Does This Do

Update instrumentation gradle file tasks to use lazy API formatting.

Motivation

Build improvements

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Sep 30, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 30, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 87.81% (+29.84%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1508bd9 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
release_version 1.54.0-SNAPSHOT~6c26663efe 1.54.0-SNAPSHOT~1508bd9244
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759338209 1759338209
ci_job_id 1157962449 1157962449
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-z62inu7u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-z62inu7u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1016698
Total [baseline] (8.668 s) : 0, 8668320
Agent [candidate] (1.025 s) : 0, 1025063
Total [candidate] (8.707 s) : 0, 8707162
section iast
Agent [baseline] (1.166 s) : 0, 1165604
Total [baseline] (9.272 s) : 0, 9271855
Agent [candidate] (1.15 s) : 0, 1150214
Total [candidate] (9.243 s) : 0, 9242793
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.017 s -
Agent iast 1.166 s 148.906 ms (14.6%)
Total tracing 8.668 s -
Total iast 9.272 s 603.535 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent iast 1.15 s 125.151 ms (12.2%)
Total tracing 8.707 s -
Total iast 9.243 s 535.631 ms (6.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.45 ms) : 0, 1450
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (690.476 ms) : 0, 690476
BytebuddyAgent [candidate] (696.892 ms) : 0, 696892
GlobalTracer [baseline] (242.724 ms) : 0, 242724
GlobalTracer [candidate] (244.308 ms) : 0, 244308
AppSec [baseline] (33.012 ms) : 0, 33012
AppSec [candidate] (33.08 ms) : 0, 33080
Debugger [baseline] (6.433 ms) : 0, 6433
Debugger [candidate] (6.409 ms) : 0, 6409
Remote Config [baseline] (671.292 µs) : 0, 671
Remote Config [candidate] (695.574 µs) : 0, 696
Telemetry [baseline] (9.096 ms) : 0, 9096
Telemetry [candidate] (9.179 ms) : 0, 9179
Flare Poller [baseline] (11.705 ms) : 0, 11705
Flare Poller [candidate] (11.775 ms) : 0, 11775
section iast
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (825.133 ms) : 0, 825133
BytebuddyAgent [candidate] (813.737 ms) : 0, 813737
GlobalTracer [baseline] (235.703 ms) : 0, 235703
GlobalTracer [candidate] (233.34 ms) : 0, 233340
AppSec [baseline] (35.798 ms) : 0, 35798
AppSec [candidate] (35.157 ms) : 0, 35157
Debugger [baseline] (6.084 ms) : 0, 6084
Debugger [candidate] (6.021 ms) : 0, 6021
Remote Config [baseline] (600.58 µs) : 0, 601
Remote Config [candidate] (586.315 µs) : 0, 586
Telemetry [baseline] (8.303 ms) : 0, 8303
Telemetry [candidate] (8.277 ms) : 0, 8277
Flare Poller [baseline] (4.219 ms) : 0, 4219
Flare Poller [candidate] (4.269 ms) : 0, 4269
IAST [baseline] (26.901 ms) : 0, 26901
IAST [candidate] (26.183 ms) : 0, 26183
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.014 s) : 0, 1014262
Total [baseline] (10.625 s) : 0, 10625264
Agent [candidate] (1.019 s) : 0, 1018870
Total [candidate] (10.785 s) : 0, 10784886
section appsec
Agent [baseline] (1.202 s) : 0, 1202374
Total [baseline] (11.097 s) : 0, 11097403
Agent [candidate] (1.2 s) : 0, 1200054
Total [candidate] (11.122 s) : 0, 11121872
section iast
Agent [baseline] (1.156 s) : 0, 1156272
Total [baseline] (10.873 s) : 0, 10873443
Agent [candidate] (1.147 s) : 0, 1147054
Total [candidate] (10.917 s) : 0, 10916965
section profiling
Agent [baseline] (1.163 s) : 0, 1162927
Total [baseline] (11.016 s) : 0, 11015889
Agent [candidate] (1.169 s) : 0, 1168767
Total [candidate] (11.007 s) : 0, 11007446
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.014 s -
Agent appsec 1.202 s 188.112 ms (18.5%)
Agent iast 1.156 s 142.01 ms (14.0%)
Agent profiling 1.163 s 148.665 ms (14.7%)
Total tracing 10.625 s -
Total appsec 11.097 s 472.139 ms (4.4%)
Total iast 10.873 s 248.179 ms (2.3%)
Total profiling 11.016 s 390.624 ms (3.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.2 s 181.184 ms (17.8%)
Agent iast 1.147 s 128.184 ms (12.6%)
Agent profiling 1.169 s 149.896 ms (14.7%)
Total tracing 10.785 s -
Total appsec 11.122 s 336.986 ms (3.1%)
Total iast 10.917 s 132.078 ms (1.2%)
Total profiling 11.007 s 222.56 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (689.776 ms) : 0, 689776
BytebuddyAgent [candidate] (692.579 ms) : 0, 692579
GlobalTracer [baseline] (242.087 ms) : 0, 242087
GlobalTracer [candidate] (243.409 ms) : 0, 243409
AppSec [baseline] (32.773 ms) : 0, 32773
AppSec [candidate] (33.161 ms) : 0, 33161
Debugger [baseline] (6.381 ms) : 0, 6381
Debugger [candidate] (6.431 ms) : 0, 6431
Remote Config [baseline] (671.665 µs) : 0, 672
Remote Config [candidate] (683.281 µs) : 0, 683
Telemetry [baseline] (9.054 ms) : 0, 9054
Telemetry [candidate] (9.088 ms) : 0, 9088
Flare Poller [baseline] (11.043 ms) : 0, 11043
Flare Poller [candidate] (10.933 ms) : 0, 10933
section appsec
crashtracking [baseline] (1.457 ms) : 0, 1457
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (723.042 ms) : 0, 723042
BytebuddyAgent [candidate] (721.582 ms) : 0, 721582
GlobalTracer [baseline] (237.442 ms) : 0, 237442
GlobalTracer [candidate] (237.24 ms) : 0, 237240
AppSec [baseline] (174.946 ms) : 0, 174946
AppSec [candidate] (173.726 ms) : 0, 173726
Debugger [baseline] (6.019 ms) : 0, 6019
Debugger [candidate] (6.075 ms) : 0, 6075
Remote Config [baseline] (654.65 µs) : 0, 655
Remote Config [candidate] (646.726 µs) : 0, 647
Telemetry [baseline] (8.402 ms) : 0, 8402
Telemetry [candidate] (9.106 ms) : 0, 9106
Flare Poller [baseline] (4.035 ms) : 0, 4035
Flare Poller [candidate] (4.035 ms) : 0, 4035
IAST [baseline] (25.126 ms) : 0, 25126
IAST [candidate] (24.962 ms) : 0, 24962
section iast
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (818.314 ms) : 0, 818314
BytebuddyAgent [candidate] (811.083 ms) : 0, 811083
GlobalTracer [baseline] (234.226 ms) : 0, 234226
GlobalTracer [candidate] (232.96 ms) : 0, 232960
AppSec [baseline] (35.048 ms) : 0, 35048
AppSec [candidate] (34.918 ms) : 0, 34918
Debugger [baseline] (6.066 ms) : 0, 6066
Debugger [candidate] (6.038 ms) : 0, 6038
Remote Config [baseline] (586.925 µs) : 0, 587
Remote Config [candidate] (600.8 µs) : 0, 601
Telemetry [baseline] (8.162 ms) : 0, 8162
Telemetry [candidate] (8.129 ms) : 0, 8129
Flare Poller [baseline] (4.243 ms) : 0, 4243
Flare Poller [candidate] (4.216 ms) : 0, 4216
IAST [baseline] (26.698 ms) : 0, 26698
IAST [candidate] (26.351 ms) : 0, 26351
section profiling
crashtracking [baseline] (1.418 ms) : 0, 1418
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (721.568 ms) : 0, 721568
BytebuddyAgent [candidate] (724.982 ms) : 0, 724982
GlobalTracer [baseline] (219.081 ms) : 0, 219081
GlobalTracer [candidate] (220.323 ms) : 0, 220323
AppSec [baseline] (32.803 ms) : 0, 32803
AppSec [candidate] (32.935 ms) : 0, 32935
Debugger [baseline] (7.466 ms) : 0, 7466
Debugger [candidate] (7.418 ms) : 0, 7418
Remote Config [baseline] (813.834 µs) : 0, 814
Remote Config [candidate] (802.383 µs) : 0, 802
Telemetry [baseline] (15.734 ms) : 0, 15734
Telemetry [candidate] (15.738 ms) : 0, 15738
Flare Poller [baseline] (4.18 ms) : 0, 4180
Flare Poller [candidate] (4.178 ms) : 0, 4178
ProfilingAgent [baseline] (104.953 ms) : 0, 104953
ProfilingAgent [candidate] (106.729 ms) : 0, 106729
Profiling [baseline] (107.985 ms) : 0, 107985
Profiling [candidate] (108.827 ms) : 0, 108827
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
release_version 1.54.0-SNAPSHOT~6c26663efe 1.54.0-SNAPSHOT~1508bd9244
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759337873 1759337873
ci_job_id 1157962450 1157962450
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-5eqb2b5q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-5eqb2b5q 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-444.938µs; -201.272µs] or [-5.651%; -2.556%]		 unstable
[-47.175op/s; +96.862op/s] or [-8.019%; +16.465%]		 7.550ms 613.125op/s 7.873ms 588.281op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+314.759µs; +733.251µs] or [+2.999%; +6.987%]		 unstable
[-69.471op/s; +27.471op/s] or [-15.690%; +6.204%]		 11.019ms 421.781op/s 10.495ms 442.781op/s
scenario:load:insecure-bank:iast:high_load better
[-784.838µs; -420.613µs] or [-7.717%; -4.136%]		 unstable
[-25.871op/s; +82.496op/s] or [-5.664%; +18.061%]		 9.567ms 485.062op/s 10.170ms 456.750op/s
scenario:load:petclinic:appsec:high_load worse
[+1.843ms; +2.809ms] or [+3.784%; +5.768%]		 unstable
[-10.927op/s; +2.177op/s] or [-11.373%; +2.265%]		 51.029ms 91.700op/s 48.703ms 96.075op/s
scenario:load:petclinic:profiling:high_load better
[-3.811ms; -2.857ms] or [-7.720%; -5.788%]		 unstable
[-0.169op/s; +13.819op/s] or [-0.178%; +14.577%]		 46.033ms 101.625op/s 49.367ms 94.800op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.466 ms) : 36178, 36753
.   : milestone, 36466,
appsec (48.703 ms) : 48279, 49127
.   : milestone, 48703,
code_origins (44.82 ms) : 44449, 45192
.   : milestone, 44820,
iast (44.406 ms) : 44019, 44793
.   : milestone, 44406,
profiling (49.367 ms) : 48907, 49827
.   : milestone, 49367,
tracing (44.866 ms) : 44487, 45246
.   : milestone, 44866,
section candidate
no_agent (37.308 ms) : 37010, 37607
.   : milestone, 37308,
appsec (51.029 ms) : 50556, 51502
.   : milestone, 51029,
code_origins (44.654 ms) : 44279, 45029
.   : milestone, 44654,
iast (45.503 ms) : 45107, 45899
.   : milestone, 45503,
profiling (46.033 ms) : 45608, 46458
.   : milestone, 46033,
tracing (44.21 ms) : 43838, 44583
.   : milestone, 44210,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.466 ms [36.178 ms, 36.753 ms] -
appsec 48.703 ms [48.279 ms, 49.127 ms] 12.237 ms (33.6%)
code_origins 44.82 ms [44.449 ms, 45.192 ms] 8.355 ms (22.9%)
iast 44.406 ms [44.019 ms, 44.793 ms] 7.941 ms (21.8%)
profiling 49.367 ms [48.907 ms, 49.827 ms] 12.902 ms (35.4%)
tracing 44.866 ms [44.487 ms, 45.246 ms] 8.401 ms (23.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.308 ms [37.01 ms, 37.607 ms] -
appsec 51.029 ms [50.556 ms, 51.502 ms] 13.721 ms (36.8%)
code_origins 44.654 ms [44.279 ms, 45.029 ms] 7.346 ms (19.7%)
iast 45.503 ms [45.107 ms, 45.899 ms] 8.195 ms (22.0%)
profiling 46.033 ms [45.608 ms, 46.458 ms] 8.725 ms (23.4%)
tracing 44.21 ms [43.838 ms, 44.583 ms] 6.902 ms (18.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.27 ms) : 4223, 4316
.   : milestone, 4270,
iast (10.17 ms) : 9990, 10351
.   : milestone, 10170,
iast_FULL (14.391 ms) : 14102, 14680
.   : milestone, 14391,
iast_GLOBAL (10.495 ms) : 10302, 10687
.   : milestone, 10495,
profiling (9.5 ms) : 9348, 9653
.   : milestone, 9500,
tracing (7.873 ms) : 7761, 7986
.   : milestone, 7873,
section candidate
no_agent (4.342 ms) : 4286, 4397
.   : milestone, 4342,
iast (9.567 ms) : 9410, 9725
.   : milestone, 9567,
iast_FULL (14.468 ms) : 14174, 14761
.   : milestone, 14468,
iast_GLOBAL (11.019 ms) : 10822, 11215
.   : milestone, 11019,
profiling (9.373 ms) : 9227, 9518
.   : milestone, 9373,
tracing (7.55 ms) : 7436, 7664
.   : milestone, 7550,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.27 ms [4.223 ms, 4.316 ms] -
iast 10.17 ms [9.99 ms, 10.351 ms] 5.901 ms (138.2%)
iast_FULL 14.391 ms [14.102 ms, 14.68 ms] 10.122 ms (237.1%)
iast_GLOBAL 10.495 ms [10.302 ms, 10.687 ms] 6.225 ms (145.8%)
profiling 9.5 ms [9.348 ms, 9.653 ms] 5.231 ms (122.5%)
tracing 7.873 ms [7.761 ms, 7.986 ms] 3.604 ms (84.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.342 ms [4.286 ms, 4.397 ms] -
iast 9.567 ms [9.41 ms, 9.725 ms] 5.226 ms (120.4%)
iast_FULL 14.468 ms [14.174 ms, 14.761 ms] 10.126 ms (233.2%)
iast_GLOBAL 11.019 ms [10.822 ms, 11.215 ms] 6.677 ms (153.8%)
profiling 9.373 ms [9.227 ms, 9.518 ms] 5.031 ms (115.9%)
tracing 7.55 ms [7.436 ms, 7.664 ms] 3.209 ms (73.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
release_version 1.54.0-SNAPSHOT~6c26663efe 1.54.0-SNAPSHOT~1508bd9244
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759338371 1759338371
ci_job_id 1157962452 1157962452
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ow1pas08 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ow1pas08 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.488 ms) : 1476, 1499
.   : milestone, 1488,
appsec (3.755 ms) : 3535, 3976
.   : milestone, 3755,
iast (2.243 ms) : 2178, 2307
.   : milestone, 2243,
iast_GLOBAL (2.287 ms) : 2223, 2352
.   : milestone, 2287,
profiling (2.091 ms) : 2039, 2144
.   : milestone, 2091,
tracing (2.06 ms) : 2009, 2110
.   : milestone, 2060,
section candidate
no_agent (1.486 ms) : 1474, 1497
.   : milestone, 1486,
appsec (3.705 ms) : 3491, 3919
.   : milestone, 3705,
iast (2.235 ms) : 2171, 2299
.   : milestone, 2235,
iast_GLOBAL (2.271 ms) : 2207, 2336
.   : milestone, 2271,
profiling (2.07 ms) : 2019, 2122
.   : milestone, 2070,
tracing (2.053 ms) : 2003, 2102
.   : milestone, 2053,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.488 ms [1.476 ms, 1.499 ms] -
appsec 3.755 ms [3.535 ms, 3.976 ms] 2.268 ms (152.5%)
iast 2.243 ms [2.178 ms, 2.307 ms] 755.071 µs (50.8%)
iast_GLOBAL 2.287 ms [2.223 ms, 2.352 ms] 799.839 µs (53.8%)
profiling 2.091 ms [2.039 ms, 2.144 ms] 603.684 µs (40.6%)
tracing 2.06 ms [2.009 ms, 2.11 ms] 572.246 µs (38.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.497 ms] -
appsec 3.705 ms [3.491 ms, 3.919 ms] 2.219 ms (149.4%)
iast 2.235 ms [2.171 ms, 2.299 ms] 749.33 µs (50.4%)
iast_GLOBAL 2.271 ms [2.207 ms, 2.336 ms] 785.567 µs (52.9%)
profiling 2.07 ms [2.019 ms, 2.122 ms] 584.582 µs (39.3%)
tracing 2.053 ms [2.003 ms, 2.102 ms] 566.93 µs (38.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1508bd9244, baseline=1.54.0-SNAPSHOT~6c26663efe
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
appsec (15.018 s) : 15018000, 15018000
.   : milestone, 15018000,
iast (18.711 s) : 18711000, 18711000
.   : milestone, 18711000,
iast_GLOBAL (17.976 s) : 17976000, 17976000
.   : milestone, 17976000,
profiling (15.601 s) : 15601000, 15601000
.   : milestone, 15601000,
tracing (15.324 s) : 15324000, 15324000
.   : milestone, 15324000,
section candidate
no_agent (14.972 s) : 14972000, 14972000
.   : milestone, 14972000,
appsec (15.208 s) : 15208000, 15208000
.   : milestone, 15208000,
iast (18.693 s) : 18693000, 18693000
.   : milestone, 18693000,
iast_GLOBAL (17.929 s) : 17929000, 17929000
.   : milestone, 17929000,
profiling (15.973 s) : 15973000, 15973000
.   : milestone, 15973000,
tracing (15.024 s) : 15024000, 15024000
.   : milestone, 15024000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.977 s [14.977 s, 14.977 s] -
appsec 15.018 s [15.018 s, 15.018 s] 41.0 ms (0.3%)
iast 18.711 s [18.711 s, 18.711 s] 3.734 s (24.9%)
iast_GLOBAL 17.976 s [17.976 s, 17.976 s] 2.999 s (20.0%)
profiling 15.601 s [15.601 s, 15.601 s] 624.0 ms (4.2%)
tracing 15.324 s [15.324 s, 15.324 s] 347.0 ms (2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.972 s [14.972 s, 14.972 s] -
appsec 15.208 s [15.208 s, 15.208 s] 236.0 ms (1.6%)
iast 18.693 s [18.693 s, 18.693 s] 3.721 s (24.9%)
iast_GLOBAL 17.929 s [17.929 s, 17.929 s] 2.957 s (19.8%)
profiling 15.973 s [15.973 s, 15.973 s] 1.001 s (6.7%)
tracing 15.024 s [15.024 s, 15.024 s] 52.0 ms (0.3%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 30, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
See matching parameters
Baseline Candidate
ci_job_date 1759337570 1759337570
ci_job_id 1157962459 1157962459
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume unsure
[-10093.358op/s; -1381.745op/s] or [-3.363%; -0.460%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@pr-commenter
Copy link

pr-commenter bot commented Oct 1, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/lazy-api-instrumentations
git_commit_date 1759335243 1759336284
git_commit_sha 6c26663 1508bd9
See matching parameters
Baseline Candidate
ci_job_date 1759337449 1759337449
ci_job_id 1157962457 1157962457
ci_pipeline_id 78102352 78102352
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sarahchen6