Skip to content

Conversation

emmettbutler
Copy link
Collaborator

@emmettbutler emmettbutler commented Sep 26, 2025

This change updates the riotfile to run 3.14 tests for all suites that i was able to get working that were not already enabled in #14264.

wantsui and others added 30 commits August 8, 2025 16:41
Allow users to omit any traces they want by returning none in the
user_span_processor method.

Motivation:
I am trying to prevent some auto traces from cluttering my Datadog
observability dashboards. These traces create noise and make it harder
to focus on the more critical traces. My LLM observability overview is
filled with what is clustered as empty input which is incorrect. e.g.
all embedding traces are are just a spammer.

To do that, I am using the new span_processor, and the new way to omit
specific spans, will be to return null by the relevant span processor.

I have added a test for that.

The only risk is that there is no indication that span was omitted but I
was afraid that a debug log would be too spammy. But please let me know
if that will help. Also there are some telemetric collected about sent
span which might also need to be changed, will be great to hear your
thoughts

Co-authored-by: amirbenami <amir@linxsecurity.io>
Annotates LangGraph agents (compiled state graphs, even those created
through `create_react_agent`) with the following agent metadata
information:

- name (always)
- tools (always - best effort, depending on the presence of `ToolNode`s
within the agent)
- instructions (if done through `create_react_agent`)
- model name, provider, & settings (if done through
`create_react_agent`)
- handoffs (always - assuming the agent is directly a part of a
supergraph)
- framework (always)
- dependencies (since state should always be passed in, always)
- max_iterations (always, defaulting to 25 if not provided explicitly)

Additionally, to help accomplish this, we patch the `create_react_agent`
function to record agent manifest data on agent instance creation,
should it be invoked. The means of doing this is a bit strange, as it is
in completely different submodule (`langgraph.prebuilt`), and it
required me to do what I think are some pretty not normal things for
patching 😅 so, happy to discuss/change as needed!

MLOB-3102

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Remove importlib_metadata dependency since it is no longer needed.
Support for Python 3.7 has been dropped, and dd-trace-py now requires
Python 3.8 or later, which includes importlib.metadata in the standard
library.


## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Munir Abdinur <munir_abdinur@hotmail.com>
Co-authored-by: Munir Abdinur <munir.abdinur@datadoghq.com>
This PR introduces:
- remove of the `_appsec_processor` in the tracer. The appsec processor
is now part of the list of regular processors. This fixes several
problems.
- change the logic order of how appsec is enabled and loaded

This is removing 2 static import cycles, only 2 left (none with appsec).

Context: Before that PR, the appsec product was loaded through the
tracer, by creating an instance of AppSecSpanProcessor. After that PR,
the appsec product or the remote config layer will register the
AppSecSpanProcessor into the list of regular span processors of the
tracer.


**Bonus**:
As the appsec processor is not reset anymore at fork time by the respawn
of the tracer (because it does not depend on the tracer object anymore),
it looks like it's also fixing the gap time we could have where appsec
was back to factory setting at work respawn time.

APPSEC-57505

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
See builds here


https://app.readthedocs.org/projects/ddtrace/builds/?version__slug=taegyunkim-native-cargo-home

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
…nGroup (#14250)

## Description

When an Appsec `BlockingException` is raised within a fastapi
middleware, it can be aggregated and nested in a `BaseExceptionGroup`
multiple levels deep. The behaviour occurs when using http middlewares.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
fixing issue #14258

Also little change to the django app for threats tests to have a
regression test.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Brett Langdon <brett.langdon@datadoghq.com>
Follows #14248 and
DataDog/images#7477

Also adds parallelism to `azure_functions` tests since they were
finishing right around the 20 minute timeout following the upgrade of
`azure-functions-core-tools.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
CI Visibility: Fix for a bug introduced in
#14115 where session tags
would not have the proper count of tests skipped by ITR, counting the
suite number instead when ITR is configured at suite level skipping.

Regression tests added for both suite level skipping and test level
skipping.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Update celery lockfiles and dependency package lockfiles.
This performs the following updates:
1) Some celery lockfiles use celery `latest`. This will update celery
and dependencies.
2) Some celery lockfiles use a pinned (non-latest) version of celery,
but require the `latest` version of another package. This will update
all such packages.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

Co-authored-by: quinna-h <175135214+quinna-h@users.noreply.github.com>
Broken out from #14361 

`ddtrace.trace.Pin` is being deprecated

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Broken out from #14361 

`ddtrace.trace.Pin` is being deprecated

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
Following #14113, this PR
adds endpoint discovery at startup for Flask.
Also:
- add blueprints in Flask testing app for threat tests (to make sure
blueprints are properly supported)
- Improve endpoint discovery test to ensure that we get the expected
endpoint reported
- Moved endpoint_collection away from asm settings to neutral file
endpoints as this is a feature not directly related to security.
- Kept flag enabling/disabling this feature inside asm settings as
security team will maintain this feature.

This was also tested on new endpoint discovery system tests.

APPSEC-58374

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
There isn't much need for the Pin API anymore, we generally encourage
environment variable or backend controlled configuration.

The big benefit of deprecating and removing this API is because of the
performance impact it has on integrations, the operations to check for
Pins is very slow, when generally it is expected people to use sane
defaults or configure once via env variables.

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [ ] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)
## Description

This PR fixes the tracer flare when `DD_TRACE_AGENT_URL` is not set.
`ddtrace.config._trace_agent_url` is `None` when not set, which leads to
`Failed to send tracer flare to Zendesk ticket XXXXXXXXX: Unsupported
protocol 'b''' in intake URL 'None'. Must be one of: http, https, unix`
when sending a flare.

This PR makes sure to use the default.

## Motivation

Making tracer flares for Python work again

## Testing strategy
- Create a VM
- Install the agent
- Install the tracer with SSI
- Create a sample Flask app
- Start it with `DD_TRACE_DEBUG=true`
- Go to the Datadog UI & trigger a flare for your host (no need to force
debug logs)
- After a few minutes a Zendesk ticket should be created and contain
your tracer flare
- You should see a log starting with `Successfully sent the flare to
Zendesk ticket` 

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Brett Langdon <brett.langdon@datadoghq.com>
This PR adds improved tracking of tool results and definitions to the
LLMObs OpenAI integration

## Checklist
- [x] PR author has checked that all the criteria below are met
- The PR description includes an overview of the change
- The PR description articulates the motivation for the change
- The change includes tests OR the PR description describes a testing
strategy
- The PR description notes risks associated with the change, if any
- Newly-added code is easy to change
- The change follows the [library release note
guidelines](https://ddtrace.readthedocs.io/en/stable/releasenotes.html)
- The change includes or references documentation updates if necessary
- Backport labels are set (if
[applicable](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting))

## Reviewer Checklist
- [x] Reviewer has checked that all the criteria below are met 
- Title is accurate
- All changes are related to the pull request's stated goal
- Avoids breaking
[API](https://ddtrace.readthedocs.io/en/stable/versioning.html#interfaces)
changes
- Testing strategy adequately addresses listed risks
- Newly-added code is easy to change
- Release note makes sense to a user of the library
- If necessary, author has acknowledged and discussed the performance
implications of this PR as reported in the benchmarks PR comment
- Backport labels are set in a manner that is consistent with the
[release branch maintenance
policy](https://ddtrace.readthedocs.io/en/latest/contributing.html#backporting)

---------

Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com>
Copy link
Contributor

github-actions bot commented Sep 26, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 239 ± 3 ms.

The average import time from base is: 243 ± 3 ms.

The import time difference between this PR and base is: -3.8 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.141 ms (0.90%)
ddtrace.bootstrap.sitecustomize 1.460 ms (0.61%)
ddtrace.bootstrap.preload 1.460 ms (0.61%)
ddtrace.internal.remoteconfig.client 0.662 ms (0.28%)
ddtrace 0.682 ms (0.29%)
ddtrace.internal._unpatched 0.027 ms (0.01%)
json 0.027 ms (0.01%)
json.decoder 0.027 ms (0.01%)
re 0.027 ms (0.01%)
enum 0.027 ms (0.01%)
types 0.027 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Sep 26, 2025

Performance SLOs

Comparing candidate emmett.butler/enable-more-3.14-suites (d03d3ba) with baseline main (bc47ed9)

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ add_inplace_aspect

Time: ✅ 0.407µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ add_inplace_noaspect

Time: ✅ 0.314µs (SLO: <10.000µs 📉 -96.9%) vs baseline: -1.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ add_noaspect

Time: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: ~same

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.1%


✅ bytearray_aspect

Time: ✅ 1.485µs (SLO: <10.000µs 📉 -85.2%) vs baseline: 📈 +11.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ bytearray_extend_aspect

Time: ✅ 1.574µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +3.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ bytearray_extend_noaspect

Time: ✅ 0.610µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.6%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ bytearray_noaspect

Time: ✅ 0.481µs (SLO: <10.000µs 📉 -95.2%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ bytes_aspect

Time: ✅ 1.359µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +4.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ bytesio_aspect

Time: ✅ 1.364µs (SLO: <10.000µs 📉 -86.4%) vs baseline: -0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ bytesio_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -1.0%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ capitalize_aspect

Time: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ capitalize_noaspect

Time: ✅ 0.435µs (SLO: <10.000µs 📉 -95.6%) vs baseline: -0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ casefold_aspect

Time: ✅ 0.736µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ casefold_noaspect

Time: ✅ 0.375µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ decode_aspect

Time: ✅ 0.725µs (SLO: <10.000µs 📉 -92.7%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ decode_noaspect

Time: ✅ 0.419µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -1.2%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.0%


✅ encode_aspect

Time: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ encode_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ format_aspect

Time: ✅ 3.364µs (SLO: <10.000µs 📉 -66.4%) vs baseline: -0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ format_map_aspect

Time: ✅ 3.589µs (SLO: <10.000µs 📉 -64.1%) vs baseline: -1.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ format_map_noaspect

Time: ✅ 0.776µs (SLO: <10.000µs 📉 -92.2%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ format_noaspect

Time: ✅ 0.601µs (SLO: <10.000µs 📉 -94.0%) vs baseline: +1.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ index_aspect

Time: ✅ 0.362µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ index_noaspect

Time: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ join_aspect

Time: ✅ 1.365µs (SLO: <10.000µs 📉 -86.3%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ join_noaspect

Time: ✅ 0.491µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ ljust_aspect

Time: ✅ 2.549µs (SLO: <20.000µs 📉 -87.3%) vs baseline: -0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: +0.8%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ lower_aspect

Time: ✅ 2.395µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +8.7%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ lower_noaspect

Time: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ lstrip_aspect

Time: ✅ 2.495µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +12.3%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ lstrip_noaspect

Time: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ modulo_aspect

Time: ✅ 0.997µs (SLO: <10.000µs 📉 -90.0%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.543µs (SLO: <10.000µs 📉 -84.6%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ modulo_aspect_for_bytes

Time: ✅ 0.977µs (SLO: <10.000µs 📉 -90.2%) vs baseline: -0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.243µs (SLO: <10.000µs 📉 -87.6%) vs baseline: -0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ modulo_noaspect

Time: ✅ 0.633µs (SLO: <10.000µs 📉 -93.7%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%


✅ replace_aspect

Time: ✅ 4.836µs (SLO: <10.000µs 📉 -51.6%) vs baseline: +0.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ replace_noaspect

Time: ✅ 0.460µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ repr_aspect

Time: ✅ 0.910µs (SLO: <10.000µs 📉 -90.9%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ repr_noaspect

Time: ✅ 0.416µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ rstrip_aspect

Time: ✅ 1.934µs (SLO: <20.000µs 📉 -90.3%) vs baseline: +0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ rstrip_noaspect

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ slice_aspect

Time: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.3%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ slice_noaspect

Time: ✅ 0.448µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ stringio_aspect

Time: ✅ 1.569µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +0.6%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ stringio_noaspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ strip_aspect

Time: ✅ 2.511µs (SLO: <20.000µs 📉 -87.4%) vs baseline: 📈 +13.7%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.9%


✅ strip_noaspect

Time: ✅ 0.388µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ swapcase_aspect

Time: ✅ 2.571µs (SLO: <10.000µs 📉 -74.3%) vs baseline: +6.6%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ swapcase_noaspect

Time: ✅ 0.536µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -0.6%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%


✅ title_aspect

Time: ✅ 2.419µs (SLO: <10.000µs 📉 -75.8%) vs baseline: +3.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ title_noaspect

Time: ✅ 0.503µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6%


✅ translate_aspect

Time: ✅ 3.227µs (SLO: <10.000µs 📉 -67.7%) vs baseline: -0.4%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ translate_noaspect

Time: ✅ 1.048µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +0.5%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.4%


✅ upper_aspect

Time: ✅ 2.218µs (SLO: <10.000µs 📉 -77.8%) vs baseline: +0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ upper_noaspect

Time: ✅ 0.373µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +1.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.858µs (SLO: <10.000µs 📉 -51.4%) vs baseline: 📈 +16.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ ospathbasename_noaspect

Time: ✅ 1.078µs (SLO: <10.000µs 📉 -89.2%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ ospathjoin_aspect

Time: ✅ 6.168µs (SLO: <10.000µs 📉 -38.3%) vs baseline: +0.9%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ ospathjoin_noaspect

Time: ✅ 2.303µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ ospathnormcase_aspect

Time: ✅ 3.959µs (SLO: <10.000µs 📉 -60.4%) vs baseline: 📈 +14.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ ospathnormcase_noaspect

Time: ✅ 0.571µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ ospathsplit_aspect

Time: ✅ 4.723µs (SLO: <10.000µs 📉 -52.8%) vs baseline: -0.4%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ ospathsplit_noaspect

Time: ✅ 1.593µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.1%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ ospathsplitdrive_aspect

Time: ✅ 3.617µs (SLO: <10.000µs 📉 -63.8%) vs baseline: -0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.700µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.2%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ ospathsplitext_aspect

Time: ✅ 4.516µs (SLO: <10.000µs 📉 -54.8%) vs baseline: +1.9%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ ospathsplitext_noaspect

Time: ✅ 1.397µs (SLO: <10.000µs 📉 -86.0%) vs baseline: ~same

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.341µs (SLO: <20.000µs 📉 -83.3%) vs baseline: +8.1%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ 1-count-metrics-100-times

Time: ✅ 210.672µs (SLO: <250.000µs 📉 -15.7%) vs baseline: -0.7%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.1%


✅ 1-distribution-metric-1-times

Time: ✅ 3.211µs (SLO: <20.000µs 📉 -83.9%) vs baseline: 📈 +10.9%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.1%


✅ 1-distribution-metrics-100-times

Time: ✅ 191.436µs (SLO: <220.000µs 📉 -13.0%) vs baseline: +0.6%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%


✅ 1-gauge-metric-1-times

Time: ✅ 2.072µs (SLO: <20.000µs 📉 -89.6%) vs baseline: +0.8%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.8%


✅ 1-gauge-metrics-100-times

Time: ✅ 125.141µs (SLO: <150.000µs 📉 -16.6%) vs baseline: +0.4%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ 1-rate-metric-1-times

Time: ✅ 3.152µs (SLO: <20.000µs 📉 -84.2%) vs baseline: +0.7%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.0%


✅ 1-rate-metrics-100-times

Time: ✅ 211.635µs (SLO: <250.000µs 📉 -15.3%) vs baseline: -0.3%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%


✅ 100-count-metrics-100-times

Time: ✅ 21.428ms (SLO: <23.500ms -8.8%) vs baseline: ~same

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.8%


✅ 100-distribution-metrics-100-times

Time: ✅ 1.994ms (SLO: <2.250ms 📉 -11.4%) vs baseline: +0.6%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.9%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.289ms (SLO: <1.550ms 📉 -16.8%) vs baseline: +0.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ 100-rate-metrics-100-times

Time: ✅ 2.204ms (SLO: <2.550ms 📉 -13.5%) vs baseline: -0.3%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ flush-1-metric

Time: ✅ 4.552µs (SLO: <20.000µs 📉 -77.2%) vs baseline: 📈 +10.0%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.1%


✅ flush-100-metrics

Time: ✅ 180.890µs (SLO: <250.000µs 📉 -27.6%) vs baseline: -1.5%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ flush-1000-metrics

Time: ✅ 2.201ms (SLO: <2.500ms 📉 -11.9%) vs baseline: +0.4%

Memory: ✅ 32.873MB (SLO: <34.500MB -4.7%) vs baseline: +5.0%

🟡 Near SLO Breach (4 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.424ms (SLO: <22.300ms -8.4%) vs baseline: +0.1%

Memory: ✅ 65.468MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%


✅ exception-replay-enabled

Time: ✅ 1.348ms (SLO: <1.450ms -7.0%) vs baseline: +0.3%

Memory: ✅ 64.389MB (SLO: <67.000MB -3.9%) vs baseline: +4.6%


✅ iast

Time: ✅ 20.503ms (SLO: <22.250ms -7.9%) vs baseline: +0.3%

Memory: ✅ 65.517MB (SLO: <67.000MB -2.2%) vs baseline: +4.8%


✅ profiler

Time: ✅ 15.217ms (SLO: <16.550ms -8.1%) vs baseline: -0.8%

Memory: ✅ 53.703MB (SLO: <54.500MB 🟡 -1.5%) vs baseline: +4.7%


✅ resource-renaming

Time: ✅ 20.580ms (SLO: <21.750ms -5.4%) vs baseline: ~same

Memory: ✅ 65.493MB (SLO: <67.000MB -2.2%) vs baseline: +4.8%


✅ span-code-origin

Time: ✅ 26.233ms (SLO: <28.200ms -7.0%) vs baseline: +0.2%

Memory: ✅ 67.570MB (SLO: <69.500MB -2.8%) vs baseline: +4.8%


✅ tracer

Time: ✅ 20.440ms (SLO: <21.750ms -6.0%) vs baseline: -0.2%

Memory: ✅ 65.432MB (SLO: <67.000MB -2.3%) vs baseline: +4.7%


✅ tracer-and-profiler

Time: ✅ 21.959ms (SLO: <23.500ms -6.6%) vs baseline: -0.2%

Memory: ✅ 66.807MB (SLO: <67.500MB 🟡 -1.0%) vs baseline: +5.4%


✅ tracer-dont-create-db-spans

Time: ✅ 19.324ms (SLO: <21.500ms 📉 -10.1%) vs baseline: -0.1%

Memory: ✅ 65.495MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +4.8%


✅ tracer-minimal

Time: ✅ 16.571ms (SLO: <17.500ms -5.3%) vs baseline: -0.4%

Memory: ✅ 65.185MB (SLO: <66.000MB 🟡 -1.2%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 20.449ms (SLO: <21.750ms -6.0%) vs baseline: -0.2%

Memory: ✅ 71.498MB (SLO: <72.500MB 🟡 -1.4%) vs baseline: +4.9%


✅ tracer-no-caches

Time: ✅ 18.397ms (SLO: <19.650ms -6.4%) vs baseline: +0.3%

Memory: ✅ 65.232MB (SLO: <67.000MB -2.6%) vs baseline: +4.4%


✅ tracer-no-databases

Time: ✅ 18.790ms (SLO: <20.100ms -6.5%) vs baseline: ~same

Memory: ✅ 65.168MB (SLO: <67.000MB -2.7%) vs baseline: +4.9%


✅ tracer-no-middleware

Time: ✅ 20.109ms (SLO: <21.500ms -6.5%) vs baseline: ~same

Memory: ✅ 65.476MB (SLO: <67.000MB -2.3%) vs baseline: +4.7%


✅ tracer-no-templates

Time: ✅ 20.305ms (SLO: <22.000ms -7.7%) vs baseline: ~same

Memory: ✅ 65.491MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.138ms (SLO: <19.850ms -8.6%) vs baseline: +0.5%

Memory: ✅ 65.264MB (SLO: <66.500MB 🟡 -1.9%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 18.077ms (SLO: <19.400ms -6.8%) vs baseline: ~same

Memory: ✅ 65.313MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 18.065ms (SLO: <19.450ms -7.1%) vs baseline: +0.1%

Memory: ✅ 65.274MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.7%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.587ms (SLO: <4.750ms -3.4%) vs baseline: +0.6%

Memory: ✅ 61.971MB (SLO: <65.000MB -4.7%) vs baseline: +4.9%


✅ appsec-post

Time: ✅ 6.561ms (SLO: <6.750ms -2.8%) vs baseline: ~same

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +5.1%


✅ appsec-telemetry

Time: ✅ 4.566ms (SLO: <4.750ms -3.9%) vs baseline: ~same

Memory: ✅ 61.971MB (SLO: <65.000MB -4.7%) vs baseline: +4.8%


✅ debugger

Time: ✅ 1.853ms (SLO: <2.000ms -7.4%) vs baseline: -0.2%

Memory: ✅ 45.416MB (SLO: <47.000MB -3.4%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.885ms (SLO: <2.000ms -5.7%) vs baseline: +0.8%

Memory: ✅ 42.349MB (SLO: <49.000MB 📉 -13.6%) vs baseline: +4.8%


✅ profiler

Time: ✅ 1.910ms (SLO: <2.100ms -9.1%) vs baseline: ~same

Memory: ✅ 46.478MB (SLO: <47.000MB 🟡 -1.1%) vs baseline: +4.6%


✅ resource-renaming

Time: ✅ 3.379ms (SLO: <3.650ms -7.4%) vs baseline: -0.3%

Memory: ✅ 52.219MB (SLO: <53.500MB -2.4%) vs baseline: +4.7%


✅ tracer

Time: ✅ 3.372ms (SLO: <3.650ms -7.6%) vs baseline: ~same

Memory: ✅ 52.199MB (SLO: <53.500MB -2.4%) vs baseline: +4.7%


✅ tracer-native

Time: ✅ 3.366ms (SLO: <3.650ms -7.8%) vs baseline: ~same

Memory: ✅ 58.026MB (SLO: <60.000MB -3.3%) vs baseline: +4.7%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.227ms (SLO: <47.150ms -4.1%) vs baseline: +0.2%

Memory: ✅ 45.236MB (SLO: <47.000MB -3.8%) vs baseline: +4.8%


✅ add-metrics

Time: ✅ 320.076ms (SLO: <344.800ms -7.2%) vs baseline: -0.5%

Memory: ✅ 554.074MB (SLO: <562.000MB 🟡 -1.4%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 290.723ms (SLO: <314.000ms -7.4%) vs baseline: -0.3%

Memory: ✅ 555.327MB (SLO: <563.500MB 🟡 -1.5%) vs baseline: +5.1%


✅ get-context

Time: ✅ 82.725ms (SLO: <92.350ms 📉 -10.4%) vs baseline: ~same

Memory: ✅ 40.240MB (SLO: <46.500MB 📉 -13.5%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 42.926ms (SLO: <44.500ms -3.5%) vs baseline: ~same

Memory: ✅ 44.604MB (SLO: <47.500MB -6.1%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 61.549ms (SLO: <67.650ms -9.0%) vs baseline: ~same

Memory: ✅ 40.576MB (SLO: <47.000MB 📉 -13.7%) vs baseline: +4.6%


✅ set-status

Time: ✅ 48.692ms (SLO: <50.400ms -3.4%) vs baseline: +0.4%

Memory: ✅ 44.631MB (SLO: <47.000MB -5.0%) vs baseline: +4.8%


✅ start

Time: ✅ 42.096ms (SLO: <43.450ms -3.1%) vs baseline: ~same

Memory: ✅ 44.615MB (SLO: <47.000MB -5.1%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 83.183ms (SLO: <88.000ms -5.5%) vs baseline: ~same

Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +4.9%


✅ start-finish-telemetry

Time: ✅ 84.752ms (SLO: <89.000ms -4.8%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <46.500MB 📉 -25.7%) vs baseline: +4.7%


✅ update-name

Time: ✅ 44.120ms (SLO: <45.150ms -2.3%) vs baseline: +0.2%

Memory: ✅ 44.886MB (SLO: <47.000MB -4.5%) vs baseline: +4.6%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.318µs (SLO: <20.000µs 📉 -33.4%) vs baseline: +0.7%

Memory: ✅ 32.067MB (SLO: <33.500MB -4.3%) vs baseline: +4.6%


✅ context_with_data_no_listeners

Time: ✅ 3.264µs (SLO: <10.000µs 📉 -67.4%) vs baseline: ~same

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.9%


✅ get_item_exists

Time: ✅ 0.582µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.1%

Memory: ✅ 32.067MB (SLO: <33.500MB -4.3%) vs baseline: +4.8%


✅ get_item_missing

Time: ✅ 0.636µs (SLO: <10.000µs 📉 -93.6%) vs baseline: -0.5%

Memory: ✅ 32.106MB (SLO: <33.500MB -4.2%) vs baseline: +4.6%


✅ set_item

Time: ✅ 23.967µs (SLO: <30.000µs 📉 -20.1%) vs baseline: -0.8%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%

✅ All Tests Passing (16 suites)
errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.078ms (SLO: <2.300ms -9.6%) vs baseline: ~same

Memory: ✅ 52.160MB (SLO: <53.500MB -2.5%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 2.083ms (SLO: <2.250ms -7.4%) vs baseline: +0.3%

Memory: ✅ 52.140MB (SLO: <53.500MB -2.5%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 2.085ms (SLO: <2.300ms -9.3%) vs baseline: +0.5%

Memory: ✅ 52.180MB (SLO: <53.500MB -2.5%) vs baseline: +4.9%


flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.928ms (SLO: <4.200ms -6.5%) vs baseline: -0.4%

Memory: ✅ 62.128MB (SLO: <66.000MB -5.9%) vs baseline: +4.8%


✅ iast-enabled

Time: ✅ 2.442ms (SLO: <2.800ms 📉 -12.8%) vs baseline: -0.1%

Memory: ✅ 58.648MB (SLO: <60.000MB -2.3%) vs baseline: +4.8%


✅ tracer-enabled

Time: ✅ 2.069ms (SLO: <2.250ms -8.1%) vs baseline: ~same

Memory: ✅ 52.180MB (SLO: <54.500MB -4.3%) vs baseline: +4.7%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 85.233µs (SLO: <100.000µs 📉 -14.8%) vs baseline: +5.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ b3_headers

Time: ✅ 14.117µs (SLO: <20.000µs 📉 -29.4%) vs baseline: -0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ b3_single_headers

Time: ✅ 14.198µs (SLO: <20.000µs 📉 -29.0%) vs baseline: +6.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.043µs (SLO: <80.000µs 📉 -19.9%) vs baseline: +0.8%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 66.604µs (SLO: <80.000µs 📉 -16.7%) vs baseline: +1.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ empty_headers

Time: ✅ 1.586µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.4%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ full_t_id_datadog_headers

Time: ✅ 22.613µs (SLO: <30.000µs 📉 -24.6%) vs baseline: +0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ invalid_priority_header

Time: ✅ 6.471µs (SLO: <10.000µs 📉 -35.3%) vs baseline: -0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ invalid_span_id_header

Time: ✅ 6.484µs (SLO: <10.000µs 📉 -35.2%) vs baseline: -0.4%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ invalid_tags_header

Time: ✅ 6.506µs (SLO: <10.000µs 📉 -34.9%) vs baseline: +0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ invalid_trace_id_header

Time: ✅ 6.482µs (SLO: <10.000µs 📉 -35.2%) vs baseline: -0.4%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ large_header_no_matches

Time: ✅ 27.684µs (SLO: <30.000µs -7.7%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ large_valid_headers_all

Time: ✅ 28.671µs (SLO: <40.000µs 📉 -28.3%) vs baseline: ~same

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.842µs (SLO: <20.000µs 📉 -50.8%) vs baseline: -0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ medium_valid_headers_all

Time: ✅ 11.324µs (SLO: <20.000µs 📉 -43.4%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ none_propagation_style

Time: ✅ 1.701µs (SLO: <10.000µs 📉 -83.0%) vs baseline: +1.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ tracecontext_headers

Time: ✅ 35.792µs (SLO: <40.000µs 📉 -10.5%) vs baseline: +4.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ valid_headers_all

Time: ✅ 6.475µs (SLO: <10.000µs 📉 -35.3%) vs baseline: +0.2%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ valid_headers_basic

Time: ✅ 6.109µs (SLO: <10.000µs 📉 -38.9%) vs baseline: +0.8%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ wsgi_empty_headers

Time: ✅ 1.570µs (SLO: <10.000µs 📉 -84.3%) vs baseline: -1.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ wsgi_invalid_priority_header

Time: ✅ 6.535µs (SLO: <10.000µs 📉 -34.7%) vs baseline: ~same

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +1.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ wsgi_invalid_tags_header

Time: ✅ 6.577µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.7%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.8%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.550µs (SLO: <10.000µs 📉 -34.5%) vs baseline: -0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ wsgi_large_header_no_matches

Time: ✅ 28.679µs (SLO: <40.000µs 📉 -28.3%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.708µs (SLO: <40.000µs 📉 -25.7%) vs baseline: -0.5%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.208µs (SLO: <20.000µs 📉 -49.0%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.541µs (SLO: <20.000µs 📉 -42.3%) vs baseline: +0.2%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ wsgi_valid_headers_all

Time: ✅ 6.541µs (SLO: <10.000µs 📉 -34.6%) vs baseline: ~same

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%


✅ wsgi_valid_headers_basic

Time: ✅ 6.076µs (SLO: <10.000µs 📉 -39.2%) vs baseline: +0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.849µs (SLO: <30.000µs 📉 -27.2%) vs baseline: +1.2%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ with_all

Time: ✅ 28.761µs (SLO: <40.000µs 📉 -28.1%) vs baseline: -0.5%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ with_dd_origin

Time: ✅ 25.301µs (SLO: <30.000µs 📉 -15.7%) vs baseline: -0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ with_priority_and_origin

Time: ✅ 25.736µs (SLO: <40.000µs 📉 -35.7%) vs baseline: +3.9%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ with_sampling_priority

Time: ✅ 22.757µs (SLO: <30.000µs 📉 -24.1%) vs baseline: +5.7%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ with_tags

Time: ✅ 27.073µs (SLO: <40.000µs 📉 -32.3%) vs baseline: -0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +4.9%


✅ with_tags_invalid

Time: ✅ 29.921µs (SLO: <40.000µs 📉 -25.2%) vs baseline: +5.0%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ with_tags_max_size

Time: ✅ 28.794µs (SLO: <40.000µs 📉 -28.0%) vs baseline: +4.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 31.772µs (SLO: <40.000µs 📉 -20.6%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_expand_noaspect

Time: ✅ 28.599µs (SLO: <40.000µs 📉 -28.5%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_findall_aspect

Time: ✅ 2.923µs (SLO: <10.000µs 📉 -70.8%) vs baseline: +0.5%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_findall_noaspect

Time: ✅ 1.410µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_finditer_aspect

Time: ✅ 4.437µs (SLO: <10.000µs 📉 -55.6%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_finditer_noaspect

Time: ✅ 1.409µs (SLO: <10.000µs 📉 -85.9%) vs baseline: ~same

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_fullmatch_aspect

Time: ✅ 2.657µs (SLO: <10.000µs 📉 -73.4%) vs baseline: ~same

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ re_fullmatch_noaspect

Time: ✅ 1.301µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1%


✅ re_group_aspect

Time: ✅ 2.947µs (SLO: <10.000µs 📉 -70.5%) vs baseline: -0.1%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ re_group_noaspect

Time: ✅ 1.615µs (SLO: <10.000µs 📉 -83.9%) vs baseline: +1.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ re_groups_aspect

Time: ✅ 3.074µs (SLO: <10.000µs 📉 -69.3%) vs baseline: +0.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_groups_noaspect

Time: ✅ 1.696µs (SLO: <10.000µs 📉 -83.0%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_match_aspect

Time: ✅ 2.714µs (SLO: <10.000µs 📉 -72.9%) vs baseline: +0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ re_match_noaspect

Time: ✅ 1.305µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_search_aspect

Time: ✅ 2.568µs (SLO: <10.000µs 📉 -74.3%) vs baseline: +0.6%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_search_noaspect

Time: ✅ 1.198µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.5%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_sub_aspect

Time: ✅ 3.418µs (SLO: <10.000µs 📉 -65.8%) vs baseline: -1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_sub_noaspect

Time: ✅ 1.541µs (SLO: <10.000µs 📉 -84.6%) vs baseline: +0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_subn_aspect

Time: ✅ 3.663µs (SLO: <10.000µs 📉 -63.4%) vs baseline: +0.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1%


✅ re_subn_noaspect

Time: ✅ 1.614µs (SLO: <10.000µs 📉 -83.9%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.392µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.2%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ rsplit_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ split_aspect

Time: ✅ 1.381µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ split_noaspect

Time: ✅ 0.574µs (SLO: <10.000µs 📉 -94.3%) vs baseline: +1.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ splitlines_aspect

Time: ✅ 1.383µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ splitlines_noaspect

Time: ✅ 0.579µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -1.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.451µs (SLO: <60.000µs 📉 -17.6%) vs baseline: +0.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ propagation_enabled

Time: ✅ 172.375µs (SLO: <190.000µs -9.3%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ propagation_enabled_100

Time: ✅ 1.887ms (SLO: <2.300ms 📉 -18.0%) vs baseline: +0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ propagation_enabled_1000

Time: ✅ 32.322ms (SLO: <34.550ms -6.4%) vs baseline: -0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.702ms (SLO: <42.000ms -3.1%) vs baseline: +0.3%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.7%


✅ add-link

Time: ✅ 36.440ms (SLO: <38.550ms -5.5%) vs baseline: -0.6%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.6%


✅ add-metrics

Time: ✅ 222.686ms (SLO: <232.000ms -4.0%) vs baseline: +1.4%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 212.604ms (SLO: <221.600ms -4.1%) vs baseline: -0.7%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +5.0%


✅ get-context

Time: ✅ 29.172ms (SLO: <31.300ms -6.8%) vs baseline: ~same

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


✅ is-recording

Time: ✅ 29.123ms (SLO: <31.000ms -6.1%) vs baseline: +0.5%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +5.0%


✅ record-exception

Time: ✅ 63.314ms (SLO: <65.850ms -3.9%) vs baseline: -0.3%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.1%


✅ set-status

Time: ✅ 31.957ms (SLO: <34.150ms -6.4%) vs baseline: +0.1%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%


✅ start

Time: ✅ 28.804ms (SLO: <30.150ms -4.5%) vs baseline: -0.6%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%


✅ start-finish

Time: ✅ 33.996ms (SLO: <35.350ms -3.8%) vs baseline: -0.5%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 34.221ms (SLO: <35.450ms -3.5%) vs baseline: +0.6%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.9%


✅ update-name

Time: ✅ 31.182ms (SLO: <33.400ms -6.6%) vs baseline: -0.2%

Memory: ✅ 34.564MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 342.266ms (SLO: <354.300ms -3.4%) vs baseline: -0.3%

Memory: ✅ 38.657MB (SLO: <40.000MB -3.4%) vs baseline: +5.5%


✅ cache_on

Time: ✅ 0.395µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +1.5%

Memory: ✅ 37.552MB (SLO: <39.000MB -3.7%) vs baseline: +5.5%


packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 154.421µs (SLO: <170.000µs -9.2%) vs baseline: -0.9%

Memory: ✅ 36.619MB (SLO: <38.500MB -4.9%) vs baseline: +5.3%


✅ import_many_cached

Time: ✅ 121.853µs (SLO: <130.000µs -6.3%) vs baseline: +0.6%

Memory: ✅ 36.693MB (SLO: <38.500MB -4.7%) vs baseline: +5.0%


✅ import_many_stdlib

Time: ✅ 1.614ms (SLO: <1.750ms -7.8%) vs baseline: -0.8%

Memory: ✅ 36.752MB (SLO: <38.500MB -4.5%) vs baseline: +5.7%


✅ import_many_stdlib_cached

Time: ✅ 0.971ms (SLO: <1.100ms 📉 -11.7%) vs baseline: +0.3%

Memory: ✅ 36.734MB (SLO: <38.500MB -4.6%) vs baseline: +4.8%


✅ import_many_unknown

Time: ✅ 835.129µs (SLO: <890.000µs -6.2%) vs baseline: +0.5%

Memory: ✅ 37.233MB (SLO: <38.500MB -3.3%) vs baseline: +5.9%


✅ import_many_unknown_cached

Time: ✅ 797.794µs (SLO: <870.000µs -8.3%) vs baseline: +0.8%

Memory: ✅ 36.693MB (SLO: <38.500MB -4.7%) vs baseline: +4.6%


✅ import_one

Time: ✅ 19.714µs (SLO: <30.000µs 📉 -34.3%) vs baseline: -0.5%

Memory: ✅ 36.605MB (SLO: <39.000MB -6.1%) vs baseline: +4.8%


✅ import_one_cache

Time: ✅ 6.307µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.8%

Memory: ✅ 36.741MB (SLO: <38.500MB -4.6%) vs baseline: +4.9%


✅ import_one_stdlib

Time: ✅ 18.741µs (SLO: <20.000µs -6.3%) vs baseline: +0.4%

Memory: ✅ 36.696MB (SLO: <38.500MB -4.7%) vs baseline: +4.7%


✅ import_one_stdlib_cache

Time: ✅ 6.281µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.6%

Memory: ✅ 36.642MB (SLO: <38.500MB -4.8%) vs baseline: +5.6%


✅ import_one_unknown

Time: ✅ 45.442µs (SLO: <50.000µs -9.1%) vs baseline: ~same

Memory: ✅ 36.495MB (SLO: <38.500MB -5.2%) vs baseline: +5.2%


✅ import_one_unknown_cache

Time: ✅ 6.307µs (SLO: <10.000µs 📉 -36.9%) vs baseline: +0.7%

Memory: ✅ 36.761MB (SLO: <38.500MB -4.5%) vs baseline: +5.7%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.365µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.1%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%


✅ high_rate_limit

Time: ✅ 2.429µs (SLO: <10.000µs 📉 -75.7%) vs baseline: +1.1%

Memory: ✅ 31.831MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%


✅ long_window

Time: ✅ 2.375µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +1.1%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.5%


✅ low_rate_limit

Time: ✅ 2.388µs (SLO: <10.000µs 📉 -76.1%) vs baseline: +1.4%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +5.1%


✅ no_rate_limit

Time: ✅ 0.836µs (SLO: <10.000µs 📉 -91.6%) vs baseline: +1.2%

Memory: ✅ 31.792MB (SLO: <34.000MB -6.5%) vs baseline: +4.7%


✅ short_window

Time: ✅ 2.502µs (SLO: <10.000µs 📉 -75.0%) vs baseline: +1.6%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +5.0%


recursivecomputation - 8/8

✅ deep

Time: ✅ 308.801ms (SLO: <320.950ms -3.8%) vs baseline: -0.3%

Memory: ✅ 32.853MB (SLO: <34.500MB -4.8%) vs baseline: +4.8%


✅ deep-profiled

Time: ✅ 327.080ms (SLO: <359.150ms -8.9%) vs baseline: +0.2%

Memory: ✅ 37.218MB (SLO: <39.000MB -4.6%) vs baseline: +4.5%


✅ medium

Time: ✅ 7.040ms (SLO: <7.400ms -4.9%) vs baseline: -0.3%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.8%


✅ shallow

Time: ✅ 0.953ms (SLO: <1.050ms -9.3%) vs baseline: ~same

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


samplingrules - 8/8

✅ average_match

Time: ✅ 148.306µs (SLO: <290.000µs 📉 -48.9%) vs baseline: -1.0%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ high_match

Time: ✅ 192.706µs (SLO: <480.000µs 📉 -59.9%) vs baseline: -1.1%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ low_match

Time: ✅ 99.940µs (SLO: <120.000µs 📉 -16.7%) vs baseline: +0.6%

Memory: ✅ 632.557MB (SLO: <700.000MB -9.6%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.906ms (SLO: <8.500ms 📉 -65.8%) vs baseline: -0.2%

Memory: ✅ 70.273MB (SLO: <75.000MB -6.3%) vs baseline: +4.7%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.440µs (SLO: <20.000µs 📉 -47.8%) vs baseline: ~same

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ all-enabled

Time: ✅ 40.315µs (SLO: <50.000µs 📉 -19.4%) vs baseline: +0.8%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ collectipvariant_exists

Time: ✅ 40.607µs (SLO: <50.000µs 📉 -18.8%) vs baseline: -0.3%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.7%


✅ no-collectipvariant

Time: ✅ 39.716µs (SLO: <50.000µs 📉 -20.6%) vs baseline: -0.5%

Memory: ✅ 32.637MB (SLO: <34.000MB -4.0%) vs baseline: +5.2%


✅ no-useragentvariant

Time: ✅ 38.543µs (SLO: <50.000µs 📉 -22.9%) vs baseline: -0.4%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ obfuscation-no-query

Time: ✅ 40.153µs (SLO: <50.000µs 📉 -19.7%) vs baseline: -1.0%

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.8%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.634µs (SLO: <90.000µs 📉 -16.0%) vs baseline: +0.2%

Memory: ✅ 32.971MB (SLO: <34.000MB -3.0%) vs baseline: +4.7%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.116µs (SLO: <90.000µs 📉 -15.4%) vs baseline: +0.2%

Memory: ✅ 32.991MB (SLO: <34.000MB -3.0%) vs baseline: +5.0%


✅ obfuscation-send-querystring-disabled

Time: ✅ 154.694µs (SLO: <170.000µs -9.0%) vs baseline: +0.6%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +5.0%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 147.700µs (SLO: <160.000µs -7.7%) vs baseline: ~same

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 153.961µs (SLO: <170.000µs -9.4%) vs baseline: -0.1%

Memory: ✅ 32.991MB (SLO: <34.500MB -4.4%) vs baseline: +4.8%


✅ useragentvariant_exists_1

Time: ✅ 39.120µs (SLO: <50.000µs 📉 -21.8%) vs baseline: -0.5%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ useragentvariant_exists_2

Time: ✅ 40.347µs (SLO: <50.000µs 📉 -19.3%) vs baseline: -0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ useragentvariant_exists_3

Time: ✅ 39.708µs (SLO: <50.000µs 📉 -20.6%) vs baseline: -0.2%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


✅ useragentvariant_not_exists_1

Time: ✅ 38.991µs (SLO: <50.000µs 📉 -22.0%) vs baseline: -0.9%

Memory: ✅ 32.519MB (SLO: <34.000MB -4.4%) vs baseline: +4.7%


✅ useragentvariant_not_exists_2

Time: ✅ 39.266µs (SLO: <50.000µs 📉 -21.5%) vs baseline: -0.4%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


span - 26/26

✅ add-event

Time: ✅ 24.326ms (SLO: <26.200ms -7.2%) vs baseline: +0.5%

Memory: ✅ 51.617MB (SLO: <53.000MB -2.6%) vs baseline: +5.0%


✅ add-metrics

Time: ✅ 93.445ms (SLO: <98.350ms -5.0%) vs baseline: ~same

Memory: ✅ 605.391MB (SLO: <961.000MB 📉 -37.0%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 150.320ms (SLO: <168.550ms 📉 -10.8%) vs baseline: -0.3%

Memory: ✅ 605.765MB (SLO: <962.500MB 📉 -37.1%) vs baseline: +4.8%


✅ get-context

Time: ✅ 22.626ms (SLO: <23.700ms -4.5%) vs baseline: +0.5%

Memory: ✅ 50.439MB (SLO: <53.000MB -4.8%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 22.638ms (SLO: <23.900ms -5.3%) vs baseline: -1.0%

Memory: ✅ 50.524MB (SLO: <53.000MB -4.7%) vs baseline: +5.0%


✅ record-exception

Time: ✅ 42.480ms (SLO: <44.500ms -4.5%) vs baseline: +0.2%

Memory: ✅ 43.411MB (SLO: <53.000MB 📉 -18.1%) vs baseline: +4.9%


✅ set-status

Time: ✅ 24.320ms (SLO: <26.000ms -6.5%) vs baseline: -0.6%

Memory: ✅ 50.433MB (SLO: <53.000MB -4.8%) vs baseline: +4.8%


✅ start

Time: ✅ 22.377ms (SLO: <23.500ms -4.8%) vs baseline: -0.3%

Memory: ✅ 50.464MB (SLO: <53.000MB -4.8%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 52.434ms (SLO: <55.500ms -5.5%) vs baseline: +1.1%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 53.096ms (SLO: <58.300ms -8.9%) vs baseline: -0.7%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.5%


✅ start-finish-traceid128

Time: ✅ 55.285ms (SLO: <60.050ms -7.9%) vs baseline: -0.2%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ start-traceid128

Time: ✅ 22.635ms (SLO: <24.600ms -8.0%) vs baseline: -0.8%

Memory: ✅ 50.463MB (SLO: <53.000MB -4.8%) vs baseline: +4.7%


✅ update-name

Time: ✅ 23.397ms (SLO: <24.100ms -2.9%) vs baseline: +0.7%

Memory: ✅ 51.091MB (SLO: <53.000MB -3.6%) vs baseline: +4.7%


tracer - 6/6

✅ large

Time: ✅ 29.961ms (SLO: <32.950ms -9.1%) vs baseline: -0.9%

Memory: ✅ 33.207MB (SLO: <34.500MB -3.7%) vs baseline: +4.7%


✅ medium

Time: ✅ 2.981ms (SLO: <3.200ms -6.8%) vs baseline: +1.4%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +5.1%


✅ small

Time: ✅ 334.820µs (SLO: <370.000µs -9.5%) vs baseline: -0.1%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.8%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

@emmettbutler emmettbutler changed the title Emmett.butler/enable more 3.14 suites test: test more integrations and products under Python 3.14 Sep 29, 2025
@emmettbutler emmettbutler marked this pull request as draft September 29, 2025 18:10
emmettbutler added a commit that referenced this pull request Oct 1, 2025
This change runs most of the test suite against Python 3.14.0rc1. There
are additional suites enabled in
#14720

Exceptions: riot envs and products that are not tested under 3.14 for
various reasons
* Profiling - doesn't work with 3.14
* IAST - doesn't work with 3.14
* datastreams - integration incompatible
* dd_coverage - doesn't work with 3.14
* lib_injection - #14729
* vertica - hasn't been supported by ddtracepy since Python 3.9
* bottle - hasn't been supported by ddtracepy since Python 3.10
* django - django version 6.1, which will be compatible with Python
3.14, is not yet released
* django_hosts - django version 6.1, which will be compatible with
Python 3.14, is not yet released
* djangorestframework - django version 6.1, which will be compatible
with Python 3.14, is not yet released
* django:celery - django version 6.1, which will be compatible with
Python 3.14, is not yet released
* dramatiq - dramatiq doesn't yet have a release supporting 3.14
* pynamodb - tests aren't compatible with Python >= 3.12
* pytest - integration incompatible
* pytest_plugin_v2 - doesn't work with Python >= 3.13
* asynctest - untested since Python 3.9
* grpc_aio - some tests in the suite don't work with pytest-asyncio >=
1.0
* rq - integration incompatible
* rediscluster - untested since Python 3.11
* aredis - untested since Python 3.9
* yaaredis - untested since Python 3.10
* sqlite3 - pysqlite3-binary doesn't yet support python 3.14
* opentelemetry - opentelemetry-exporter-otlp doesn't yet work with
Python 3.14
* openai - tiktoken doesn't yet work with Python 3.14
* openai_agents - integration incompatible
* langchain - doesn't work with 3.14
* langgraph - tiktoken doesn't yet work with Python 3.14
* litellm - tiktoken doesn't yet work with Python 3.14
* google_generativeai - protobuf doesn't yet work with Python 3.14
* vertexai - integration incompatible
* crewai - tiktoken doesn't yet work with Python 3.14
* ray - ray doesn't yet work with Python 3.14
* kafka - confluent-kafka doesn't yet work with Python 3.14
* aws_lambda - datadog-lambda doesn't yet work with Python 3.14
* azure_functions - untested since Python 3.11
* llmobs - ragas doesn't yet work with Python 3.14
* ai_guard_langchain - tiktoken doesn't yet work with Python 3.14

---------

Co-authored-by: kyle <kyle@verhoog.ca>
Co-authored-by: amirbenami <amir@linxsecurity.io>
Co-authored-by: Sam Brenner <106700075+sabrenner@users.noreply.github.com>
Co-authored-by: Mohammad A Islam <73513662+chojomok@users.noreply.github.com>
Co-authored-by: Munir Abdinur <munir_abdinur@hotmail.com>
Co-authored-by: Munir Abdinur <munir.abdinur@datadoghq.com>
Co-authored-by: Christophe Papazian <114495376+christophe-papazian@users.noreply.github.com>
Co-authored-by: Taegyun Kim <taegyun.kim@datadoghq.com>
Co-authored-by: Florentin Labelle <florentin.labelle@datadoghq.com>
Co-authored-by: Brett Langdon <brett.langdon@datadoghq.com>
Co-authored-by: Duncan Harvey <35278470+duncanpharvey@users.noreply.github.com>
Co-authored-by: Federico Mon <federico.mon@datadoghq.com>
Co-authored-by: dd-octo-sts[bot] <200755185+dd-octo-sts[bot]@users.noreply.github.com>
Co-authored-by: quinna-h <175135214+quinna-h@users.noreply.github.com>
Co-authored-by: Emmett Butler <emmett.butler321@gmail.com>
Co-authored-by: Baptiste Foy <baptiste.foy@datadoghq.com>
Co-authored-by: maxzhangdd <max.zhang@datadoghq.com>
Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com>
Co-authored-by: Emmett Butler <723615+emmettbutler@users.noreply.github.com>
Co-authored-by: Taegyun Kim <k.taegyun@gmail.com>
Co-authored-by: Gabriele N. Tornetta <P403n1x87@users.noreply.github.com>
Base automatically changed from bump-3-14-riotfile to main October 1, 2025 16:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.