Skip to content

Fix Exception Probes to not emit any probe status #9669

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Fix Exception Probes to not emit any probe status #9669

wants to merge 1 commit into from
+38 −22

Conversation

jpbempel
Copy link
Member

@jpbempel jpbempel commented Oct 3, 2025 •
edited by atlassian bot
Loading

What Does This Do

filter on probe definition type

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-4559

@jpbempel jpbempel requested a review from a team as a code owner October 3, 2025 17:21
@jpbempel jpbempel added the type: enhancement Enhancements and improvements label Oct 3, 2025
@jpbempel jpbempel requested review from shatzi and removed request for a team October 3, 2025 17:21
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Oct 3, 2025
@pr-commenter
Copy link

pr-commenter bot commented Oct 3, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1759517994 1759518339
end_time 2025-10-03T19:01:15 2025-10-03T19:07:00
git_branch master jpbempel/er-no-probe-status
git_commit_sha 6549d20 1c380db
start_time 2025-10-03T18:59:55 2025-10-03T19:05:40
See matching parameters
Baseline Candidate
ci_job_id 1163015386 1163015386
ci_pipeline_id 78352209 78352209
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1759517199 1759517199

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-25.104µs; +34.472µs] or [-8.932%; +12.265%]		 unstable
[-36.693µs; +50.096µs] or [-11.391%; +15.552%]		 unstable
[-45.609µs; +63.004µs] or [-13.590%; +18.773%]		 unstable
[-88.694µs; +147.324µs] or [-9.229%; +15.330%]		 same
scenario:basic same same same unstable
[-138.267µs; +53.374µs] or [-18.377%; +7.094%]		 unstable
[-171.188op/s; +171.188op/s] or [-6.505%; +6.505%]
scenario:loop unsure
[-20.370µs; -13.600µs] or [-0.229%; -0.153%]		 unsure
[-16.590µs; -5.722µs] or [-0.185%; -0.064%]		 unsure
[-15.932µs; -4.954µs] or [-0.177%; -0.055%]		 same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (322.11 µs) : 290, 354
.   : milestone, 322,
basic (281.194 µs) : 274, 288
.   : milestone, 281,
loop (8.966 ms) : 8960, 8972
.   : milestone, 8966,
section candidate
noprobe (328.811 µs) : 280, 378
.   : milestone, 329,
basic (281.173 µs) : 275, 288
.   : milestone, 281,
loop (8.955 ms) : 8950, 8959
.   : milestone, 8955,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 322.11 µs [290.281 µs, 353.938 µs]
basic 281.194 µs [273.936 µs, 288.451 µs]
loop 8.966 ms [8.96 ms, 8.972 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 328.811 µs [279.821 µs, 377.801 µs]
basic 281.173 µs [274.658 µs, 287.688 µs]
loop 8.955 ms [8.95 ms, 8.959 ms]

@datadog-official Datadog Official
Copy link

datadog-official bot commented Oct 3, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 80.00% (+21.99%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1c380db | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 3, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/er-no-probe-status
git_commit_date 1759515098 1759517199
git_commit_sha 6549d20 1c380db
release_version 1.54.0-SNAPSHOT~6549d20548 1.54.0-SNAPSHOT~1c380dbb1f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759519277 1759519277
ci_job_id 1163015379 1163015379
ci_pipeline_id 78352209 78352209
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5l0qm0ki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5l0qm0ki 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1026408
Total [baseline] (8.708 s) : 0, 8708028
Agent [candidate] (1.025 s) : 0, 1025261
Total [candidate] (8.676 s) : 0, 8676081
section iast
Agent [baseline] (1.158 s) : 0, 1158463
Total [baseline] (9.255 s) : 0, 9255011
Agent [candidate] (1.151 s) : 0, 1151379
Total [candidate] (9.28 s) : 0, 9279944
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.158 s 132.055 ms (12.9%)
Total tracing 8.708 s -
Total iast 9.255 s 546.983 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent iast 1.151 s 126.118 ms (12.3%)
Total tracing 8.676 s -
Total iast 9.28 s 603.863 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.472 ms) : 0, 1472
BytebuddyAgent [baseline] (698.51 ms) : 0, 698510
BytebuddyAgent [candidate] (697.911 ms) : 0, 697911
GlobalTracer [baseline] (244.461 ms) : 0, 244461
GlobalTracer [candidate] (244.51 ms) : 0, 244510
AppSec [baseline] (32.524 ms) : 0, 32524
AppSec [candidate] (32.892 ms) : 0, 32892
Debugger [baseline] (6.345 ms) : 0, 6345
Debugger [candidate] (6.387 ms) : 0, 6387
Remote Config [baseline] (683.021 µs) : 0, 683
Remote Config [candidate] (675.952 µs) : 0, 676
Telemetry [baseline] (9.337 ms) : 0, 9337
Telemetry [candidate] (9.381 ms) : 0, 9381
Flare Poller [baseline] (11.738 ms) : 0, 11738
Flare Poller [candidate] (10.798 ms) : 0, 10798
section iast
crashtracking [baseline] (1.48 ms) : 0, 1480
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (820.894 ms) : 0, 820894
BytebuddyAgent [candidate] (814.953 ms) : 0, 814953
GlobalTracer [baseline] (234.315 ms) : 0, 234315
GlobalTracer [candidate] (233.031 ms) : 0, 233031
IAST [baseline] (26.113 ms) : 0, 26113
IAST [candidate] (26.231 ms) : 0, 26231
AppSec [baseline] (34.783 ms) : 0, 34783
AppSec [candidate] (35.007 ms) : 0, 35007
Debugger [baseline] (6.21 ms) : 0, 6210
Debugger [candidate] (6.127 ms) : 0, 6127
Remote Config [baseline] (593.106 µs) : 0, 593
Remote Config [candidate] (593.268 µs) : 0, 593
Telemetry [baseline] (8.567 ms) : 0, 8567
Telemetry [candidate] (8.51 ms) : 0, 8510
Flare Poller [baseline] (4.228 ms) : 0, 4228
Flare Poller [candidate] (4.138 ms) : 0, 4138
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.022 s) : 0, 1021970
Total [baseline] (10.816 s) : 0, 10815843
Agent [candidate] (1.026 s) : 0, 1026493
Total [candidate] (10.766 s) : 0, 10766342
section appsec
Agent [baseline] (1.195 s) : 0, 1195355
Total [baseline] (11.011 s) : 0, 11011329
Agent [candidate] (1.191 s) : 0, 1191249
Total [candidate] (11.042 s) : 0, 11041874
section iast
Agent [baseline] (1.154 s) : 0, 1153523
Total [baseline] (10.903 s) : 0, 10902950
Agent [candidate] (1.158 s) : 0, 1158407
Total [candidate] (10.855 s) : 0, 10854943
section profiling
Agent [baseline] (1.163 s) : 0, 1163417
Total [baseline] (11.024 s) : 0, 11023614
Agent [candidate] (1.163 s) : 0, 1163131
Total [candidate] (11.035 s) : 0, 11035375
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent appsec 1.195 s 173.385 ms (17.0%)
Agent iast 1.154 s 131.553 ms (12.9%)
Agent profiling 1.163 s 141.446 ms (13.8%)
Total tracing 10.816 s -
Total appsec 11.011 s 195.486 ms (1.8%)
Total iast 10.903 s 87.107 ms (0.8%)
Total profiling 11.024 s 207.771 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent appsec 1.191 s 164.755 ms (16.1%)
Agent iast 1.158 s 131.913 ms (12.9%)
Agent profiling 1.163 s 136.637 ms (13.3%)
Total tracing 10.766 s -
Total appsec 11.042 s 275.532 ms (2.6%)
Total iast 10.855 s 88.601 ms (0.8%)
Total profiling 11.035 s 269.033 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.506 ms) : 0, 1506
BytebuddyAgent [baseline] (696.706 ms) : 0, 696706
BytebuddyAgent [candidate] (699.979 ms) : 0, 699979
GlobalTracer [baseline] (243.239 ms) : 0, 243239
GlobalTracer [candidate] (245.044 ms) : 0, 245044
AppSec [baseline] (32.275 ms) : 0, 32275
AppSec [candidate] (32.704 ms) : 0, 32704
Debugger [baseline] (6.32 ms) : 0, 6320
Debugger [candidate] (6.413 ms) : 0, 6413
Remote Config [baseline] (672.03 µs) : 0, 672
Remote Config [candidate] (672.847 µs) : 0, 673
Telemetry [baseline] (9.231 ms) : 0, 9231
Telemetry [candidate] (9.274 ms) : 0, 9274
Flare Poller [baseline] (10.767 ms) : 0, 10767
Flare Poller [candidate] (9.443 ms) : 0, 9443
section appsec
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (718.348 ms) : 0, 718348
BytebuddyAgent [candidate] (714.874 ms) : 0, 714874
GlobalTracer [baseline] (235.425 ms) : 0, 235425
GlobalTracer [candidate] (235.214 ms) : 0, 235214
IAST [baseline] (24.786 ms) : 0, 24786
IAST [candidate] (24.872 ms) : 0, 24872
AppSec [baseline] (170.703 ms) : 0, 170703
AppSec [candidate] (173.749 ms) : 0, 173749
Debugger [baseline] (6.143 ms) : 0, 6143
Debugger [candidate] (6.119 ms) : 0, 6119
Remote Config [baseline] (651.621 µs) : 0, 652
Remote Config [candidate] (636.109 µs) : 0, 636
Telemetry [baseline] (11.777 ms) : 0, 11777
Telemetry [candidate] (9.275 ms) : 0, 9275
Flare Poller [baseline] (4.81 ms) : 0, 4810
Flare Poller [candidate] (3.942 ms) : 0, 3942
section iast
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (816.027 ms) : 0, 816027
BytebuddyAgent [candidate] (819.237 ms) : 0, 819237
GlobalTracer [baseline] (233.576 ms) : 0, 233576
GlobalTracer [candidate] (234.595 ms) : 0, 234595
IAST [baseline] (26.407 ms) : 0, 26407
IAST [candidate] (26.54 ms) : 0, 26540
AppSec [baseline] (35.293 ms) : 0, 35293
AppSec [candidate] (35.761 ms) : 0, 35761
Debugger [baseline] (6.15 ms) : 0, 6150
Debugger [candidate] (6.16 ms) : 0, 6160
Remote Config [baseline] (593.83 µs) : 0, 594
Remote Config [candidate] (598.048 µs) : 0, 598
Telemetry [baseline] (8.531 ms) : 0, 8531
Telemetry [candidate] (8.481 ms) : 0, 8481
Flare Poller [baseline] (4.187 ms) : 0, 4187
Flare Poller [candidate] (4.233 ms) : 0, 4233
section profiling
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.412 ms) : 0, 1412
BytebuddyAgent [baseline] (721.612 ms) : 0, 721612
BytebuddyAgent [candidate] (721.811 ms) : 0, 721811
GlobalTracer [baseline] (219.094 ms) : 0, 219094
GlobalTracer [candidate] (218.766 ms) : 0, 218766
AppSec [baseline] (32.729 ms) : 0, 32729
AppSec [candidate] (32.641 ms) : 0, 32641
Debugger [baseline] (7.322 ms) : 0, 7322
Debugger [candidate] (6.538 ms) : 0, 6538
Remote Config [baseline] (771.793 µs) : 0, 772
Remote Config [candidate] (788.065 µs) : 0, 788
Telemetry [baseline] (15.968 ms) : 0, 15968
Telemetry [candidate] (16.697 ms) : 0, 16697
Flare Poller [baseline] (4.159 ms) : 0, 4159
Flare Poller [candidate] (4.081 ms) : 0, 4081
ProfilingAgent [baseline] (107.724 ms) : 0, 107724
ProfilingAgent [candidate] (107.712 ms) : 0, 107712
Profiling [baseline] (108.533 ms) : 0, 108533
Profiling [candidate] (108.673 ms) : 0, 108673
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/er-no-probe-status
git_commit_date 1759515098 1759517199
git_commit_sha 6549d20 1c380db
release_version 1.54.0-SNAPSHOT~6549d20548 1.54.0-SNAPSHOT~1c380dbb1f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1759518864 1759518864
ci_job_id 1163015380 1163015380
ci_pipeline_id 78352209 78352209
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-cl45qxlc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-cl45qxlc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 2 performance regressions! Performance is the same for 5 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-779.919µs; -423.900µs] or [-7.631%; -4.148%]		 unstable
[-23.941op/s; +80.191op/s] or [-5.267%; +17.640%]		 9.619ms 482.719op/s 10.221ms 454.594op/s
scenario:load:insecure-bank:tracing:high_load better
[-400.573µs; -179.483µs] or [-5.236%; -2.346%]		 unstable
[-47.971op/s; +95.408op/s] or [-7.928%; +15.768%]		 7.360ms 628.781op/s 7.650ms 605.062op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-1.426ms; -1.015ms] or [-12.644%; -9.000%]		 unstable
[+1.920op/s; +96.892op/s] or [+0.466%; +23.494%]		 10.058ms 461.812op/s 11.278ms 412.406op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+420.928µs; +1038.254µs] or [+3.007%; +7.417%]		 unstable
[-49.573op/s; +17.323op/s] or [-14.899%; +5.206%]		 14.728ms 316.594op/s 13.999ms 332.719op/s
scenario:load:petclinic:profiling:high_load worse
[+3.908ms; +4.884ms] or [+8.454%; +10.566%]		 unstable
[-15.572op/s; -2.003op/s] or [-15.382%; -1.979%]		 50.618ms 92.450op/s 46.222ms 101.237op/s
scenario:load:petclinic:code_origins:high_load better
[-1.959ms; -1.135ms] or [-4.319%; -2.502%]		 unstable
[-3.517op/s; +10.892op/s] or [-3.411%; +10.563%]		 43.820ms 106.800op/s 45.367ms 103.112op/s
scenario:load:petclinic:iast:high_load better
[-2.312ms; -1.481ms] or [-4.994%; -3.199%]		 unstable
[-3.040op/s; +11.615op/s] or [-3.008%; +11.493%]		 44.405ms 105.350op/s 46.302ms 101.062op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.32 ms) : 37018, 37621
.   : milestone, 37320,
appsec (45.748 ms) : 45345, 46150
.   : milestone, 45748,
code_origins (45.367 ms) : 44975, 45758
.   : milestone, 45367,
iast (46.302 ms) : 45898, 46706
.   : milestone, 46302,
profiling (46.222 ms) : 45805, 46639
.   : milestone, 46222,
tracing (44.518 ms) : 44125, 44911
.   : milestone, 44518,
section candidate
no_agent (37.747 ms) : 37442, 38052
.   : milestone, 37747,
appsec (46.547 ms) : 46142, 46952
.   : milestone, 46547,
code_origins (43.82 ms) : 43445, 44194
.   : milestone, 43820,
iast (44.405 ms) : 44037, 44772
.   : milestone, 44405,
profiling (50.618 ms) : 50131, 51105
.   : milestone, 50618,
tracing (44.821 ms) : 44439, 45202
.   : milestone, 44821,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.32 ms [37.018 ms, 37.621 ms] -
appsec 45.748 ms [45.345 ms, 46.15 ms] 8.428 ms (22.6%)
code_origins 45.367 ms [44.975 ms, 45.758 ms] 8.047 ms (21.6%)
iast 46.302 ms [45.898 ms, 46.706 ms] 8.982 ms (24.1%)
profiling 46.222 ms [45.805 ms, 46.639 ms] 8.902 ms (23.9%)
tracing 44.518 ms [44.125 ms, 44.911 ms] 7.198 ms (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.747 ms [37.442 ms, 38.052 ms] -
appsec 46.547 ms [46.142 ms, 46.952 ms] 8.8 ms (23.3%)
code_origins 43.82 ms [43.445 ms, 44.194 ms] 6.073 ms (16.1%)
iast 44.405 ms [44.037 ms, 44.772 ms] 6.658 ms (17.6%)
profiling 50.618 ms [50.131 ms, 51.105 ms] 12.871 ms (34.1%)
tracing 44.821 ms [44.439 ms, 45.202 ms] 7.074 ms (18.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.426 ms) : 4374, 4479
.   : milestone, 4426,
iast (10.221 ms) : 10047, 10394
.   : milestone, 10221,
iast_FULL (13.999 ms) : 13723, 14274
.   : milestone, 13999,
iast_GLOBAL (11.278 ms) : 11074, 11482
.   : milestone, 11278,
profiling (9.014 ms) : 8873, 9155
.   : milestone, 9014,
tracing (7.65 ms) : 7545, 7755
.   : milestone, 7650,
section candidate
no_agent (4.443 ms) : 4392, 4493
.   : milestone, 4443,
iast (9.619 ms) : 9462, 9776
.   : milestone, 9619,
iast_FULL (14.728 ms) : 14431, 15026
.   : milestone, 14728,
iast_GLOBAL (10.058 ms) : 9881, 10234
.   : milestone, 10058,
profiling (8.774 ms) : 8635, 8912
.   : milestone, 8774,
tracing (7.36 ms) : 7260, 7460
.   : milestone, 7360,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.426 ms [4.374 ms, 4.479 ms] -
iast 10.221 ms [10.047 ms, 10.394 ms] 5.794 ms (130.9%)
iast_FULL 13.999 ms [13.723 ms, 14.274 ms] 9.572 ms (216.3%)
iast_GLOBAL 11.278 ms [11.074 ms, 11.482 ms] 6.852 ms (154.8%)
profiling 9.014 ms [8.873 ms, 9.155 ms] 4.588 ms (103.6%)
tracing 7.65 ms [7.545 ms, 7.755 ms] 3.224 ms (72.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.443 ms [4.392 ms, 4.493 ms] -
iast 9.619 ms [9.462 ms, 9.776 ms] 5.176 ms (116.5%)
iast_FULL 14.728 ms [14.431 ms, 15.026 ms] 10.286 ms (231.5%)
iast_GLOBAL 10.058 ms [9.881 ms, 10.234 ms] 5.615 ms (126.4%)
profiling 8.774 ms [8.635 ms, 8.912 ms] 4.331 ms (97.5%)
tracing 7.36 ms [7.26 ms, 7.46 ms] 2.917 ms (65.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/er-no-probe-status
git_commit_date 1759515098 1759517199
git_commit_sha 6549d20 1c380db
release_version 1.54.0-SNAPSHOT~6549d20548 1.54.0-SNAPSHOT~1c380dbb1f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1759519523 1759519523
ci_job_id 1163015381 1163015381
ci_pipeline_id 78352209 78352209
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-q94w48q1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-q94w48q1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.882 s) : 14882000, 14882000
.   : milestone, 14882000,
appsec (15.143 s) : 15143000, 15143000
.   : milestone, 15143000,
iast (18.351 s) : 18351000, 18351000
.   : milestone, 18351000,
iast_GLOBAL (18.087 s) : 18087000, 18087000
.   : milestone, 18087000,
profiling (15.523 s) : 15523000, 15523000
.   : milestone, 15523000,
tracing (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
section candidate
no_agent (15.532 s) : 15532000, 15532000
.   : milestone, 15532000,
appsec (14.902 s) : 14902000, 14902000
.   : milestone, 14902000,
iast (18.791 s) : 18791000, 18791000
.   : milestone, 18791000,
iast_GLOBAL (18.065 s) : 18065000, 18065000
.   : milestone, 18065000,
profiling (15.436 s) : 15436000, 15436000
.   : milestone, 15436000,
tracing (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.882 s [14.882 s, 14.882 s] -
appsec 15.143 s [15.143 s, 15.143 s] 261.0 ms (1.8%)
iast 18.351 s [18.351 s, 18.351 s] 3.469 s (23.3%)
iast_GLOBAL 18.087 s [18.087 s, 18.087 s] 3.205 s (21.5%)
profiling 15.523 s [15.523 s, 15.523 s] 641.0 ms (4.3%)
tracing 15.138 s [15.138 s, 15.138 s] 256.0 ms (1.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.532 s [15.532 s, 15.532 s] -
appsec 14.902 s [14.902 s, 14.902 s] -630.0 ms (-4.1%)
iast 18.791 s [18.791 s, 18.791 s] 3.259 s (21.0%)
iast_GLOBAL 18.065 s [18.065 s, 18.065 s] 2.533 s (16.3%)
profiling 15.436 s [15.436 s, 15.436 s] -96.0 ms (-0.6%)
tracing 15.163 s [15.163 s, 15.163 s] -369.0 ms (-2.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1c380dbb1f, baseline=1.54.0-SNAPSHOT~6549d20548
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.738 ms) : 3517, 3958
.   : milestone, 3738,
iast (2.232 ms) : 2169, 2296
.   : milestone, 2232,
iast_GLOBAL (2.257 ms) : 2194, 2321
.   : milestone, 2257,
profiling (2.063 ms) : 2012, 2114
.   : milestone, 2063,
tracing (2.051 ms) : 2002, 2101
.   : milestone, 2051,
section candidate
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (3.678 ms) : 3462, 3894
.   : milestone, 3678,
iast (2.214 ms) : 2151, 2277
.   : milestone, 2214,
iast_GLOBAL (2.268 ms) : 2204, 2333
.   : milestone, 2268,
profiling (2.116 ms) : 2062, 2170
.   : milestone, 2116,
tracing (2.051 ms) : 2001, 2101
.   : milestone, 2051,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.738 ms [3.517 ms, 3.958 ms] 2.256 ms (152.2%)
iast 2.232 ms [2.169 ms, 2.296 ms] 750.293 µs (50.6%)
iast_GLOBAL 2.257 ms [2.194 ms, 2.321 ms] 775.65 µs (52.3%)
profiling 2.063 ms [2.012 ms, 2.114 ms] 581.29 µs (39.2%)
tracing 2.051 ms [2.002 ms, 2.101 ms] 569.449 µs (38.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 3.678 ms [3.462 ms, 3.894 ms] 2.198 ms (148.6%)
iast 2.214 ms [2.151 ms, 2.277 ms] 734.546 µs (49.6%)
iast_GLOBAL 2.268 ms [2.204 ms, 2.333 ms] 788.795 µs (53.3%)
profiling 2.116 ms [2.062 ms, 2.17 ms] 636.361 µs (43.0%)
tracing 2.051 ms [2.001 ms, 2.101 ms] 571.467 µs (38.6%)

@jpbempel
Fix Exception Probes to not emit any probe status
1c380db 
filter on probe definition type
@jpbempel jpbempel force-pushed the jpbempel/er-no-probe-status branch from 698665f to 1c380db Compare October 3, 2025 18:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@evanchooly evanchooly evanchooly approved these changes

@shatzi shatzi Awaiting requested review from shatzi shatzi is a code owner automatically assigned from DataDog/debugger-java

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jpbempel @evanchooly