-
Notifications
You must be signed in to change notification settings - Fork 457
fix(ci_visibility): include imported modules in test code coverage #14719
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
Bootstrap import analysisComparison of import times between this PR and base. SummaryThe average import time from this PR is: 239 ± 2 ms. The average import time from base is: 241 ± 2 ms. The import time difference between this PR and base is: -1.33 ± 0.09 ms. Import time breakdownThe following import paths have shrunk:
|
Performance SLOsComparing candidate vitor-de-araujo/SDTEST-2724/import-coverage (27d1853) with baseline main (af46ad4) 📈 Performance Regressions (3 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ add_inplace_aspectTime: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.4% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8% ✅ add_inplace_noaspectTime: ✅ 0.320µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +2.1% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8% ✅ add_noaspectTime: ✅ 0.276µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -2.1% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ bytearray_aspectTime: ✅ 1.348µs (SLO: <10.000µs 📉 -86.5%) vs baseline: -0.2% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 1.489µs (SLO: <10.000µs 📉 -85.1%) vs baseline: +1.1% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ bytearray_extend_noaspectTime: ✅ 0.620µs (SLO: <10.000µs 📉 -93.8%) vs baseline: +1.3% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7% ✅ bytearray_noaspectTime: ✅ 0.479µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ bytes_aspectTime: ✅ 1.537µs (SLO: <10.000µs 📉 -84.6%) vs baseline: 📈 +17.2% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9% ✅ bytes_noaspectTime: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +0.3% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6% ✅ bytesio_aspectTime: ✅ 1.454µs (SLO: <10.000µs 📉 -85.5%) vs baseline: +7.0% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ bytesio_noaspectTime: ✅ 0.496µs (SLO: <10.000µs 📉 -95.0%) vs baseline: ~same Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ capitalize_aspectTime: ✅ 0.738µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.7% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ capitalize_noaspectTime: ✅ 0.437µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.5% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6% ✅ casefold_aspectTime: ✅ 0.734µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.8% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ casefold_noaspectTime: ✅ 0.365µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.9% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ decode_aspectTime: ✅ 0.735µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +1.4% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ decode_noaspectTime: ✅ 0.423µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.7% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ encode_aspectTime: ✅ 0.715µs (SLO: <10.000µs 📉 -92.8%) vs baseline: +1.1% Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ encode_noaspectTime: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.1% ✅ format_aspectTime: ✅ 3.458µs (SLO: <10.000µs 📉 -65.4%) vs baseline: ~same Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.9% ✅ format_map_aspectTime: ✅ 3.634µs (SLO: <10.000µs 📉 -63.7%) vs baseline: ~same Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.1% ✅ format_map_noaspectTime: ✅ 0.778µs (SLO: <10.000µs 📉 -92.2%) vs baseline: +0.5% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6% ✅ format_noaspectTime: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.7% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ index_aspectTime: ✅ 0.359µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.1% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +5.1% ✅ index_noaspectTime: ✅ 0.278µs (SLO: <10.000µs 📉 -97.2%) vs baseline: -0.4% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ join_aspectTime: ✅ 1.309µs (SLO: <10.000µs 📉 -86.9%) vs baseline: -1.9% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.1% ✅ join_noaspectTime: ✅ 0.488µs (SLO: <10.000µs 📉 -95.1%) vs baseline: ~same Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ ljust_aspectTime: ✅ 2.589µs (SLO: <20.000µs 📉 -87.1%) vs baseline: +0.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ ljust_noaspectTime: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.1% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ lower_aspectTime: ✅ 2.319µs (SLO: <10.000µs 📉 -76.8%) vs baseline: +3.3% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ lower_noaspectTime: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9% ✅ lstrip_aspectTime: ✅ 2.217µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +0.7% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ lstrip_noaspectTime: ✅ 0.380µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -2.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ modulo_aspectTime: ✅ 0.990µs (SLO: <10.000µs 📉 -90.1%) vs baseline: +0.2% Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.1% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 1.527µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.1% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ modulo_aspect_for_bytesTime: ✅ 0.964µs (SLO: <10.000µs 📉 -90.4%) vs baseline: -2.2% Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.7% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 1.248µs (SLO: <10.000µs 📉 -87.5%) vs baseline: +0.1% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.9% ✅ modulo_noaspectTime: ✅ 0.630µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.1% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ replace_aspectTime: ✅ 5.005µs (SLO: <10.000µs 📉 -49.9%) vs baseline: -0.3% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ replace_noaspectTime: ✅ 0.456µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -1.6% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 0.906µs (SLO: <10.000µs 📉 -90.9%) vs baseline: -0.2% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6% ✅ repr_noaspectTime: ✅ 0.418µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -1.0% Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ rstrip_aspectTime: ✅ 1.923µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.6% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8% ✅ rstrip_noaspectTime: ✅ 0.379µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.8% Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +5.2% ✅ slice_aspectTime: ✅ 0.492µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.6% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ slice_noaspectTime: ✅ 0.448µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.8% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.6% ✅ stringio_aspectTime: ✅ 1.585µs (SLO: <10.000µs 📉 -84.1%) vs baseline: +1.2% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 0.710µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ strip_aspectTime: ✅ 2.192µs (SLO: <20.000µs 📉 -89.0%) vs baseline: +1.1% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.7% ✅ strip_noaspectTime: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ swapcase_aspectTime: ✅ 2.466µs (SLO: <10.000µs 📉 -75.3%) vs baseline: +1.0% Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7% ✅ swapcase_noaspectTime: ✅ 0.536µs (SLO: <10.000µs 📉 -94.6%) vs baseline: ~same Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ title_aspectTime: ✅ 2.446µs (SLO: <10.000µs 📉 -75.5%) vs baseline: +2.1% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ title_noaspectTime: ✅ 0.505µs (SLO: <10.000µs 📉 -94.9%) vs baseline: ~same Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 3.381µs (SLO: <10.000µs 📉 -66.2%) vs baseline: +3.8% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8% ✅ translate_noaspectTime: ✅ 1.039µs (SLO: <10.000µs 📉 -89.6%) vs baseline: -0.4% Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7% ✅ upper_aspectTime: ✅ 2.248µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ upper_noaspectTime: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.5% Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.2% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 4.897µs (SLO: <10.000µs 📉 -51.0%) vs baseline: 📈 +16.0% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7% ✅ ospathbasename_noaspectTime: ✅ 1.081µs (SLO: <10.000µs 📉 -89.2%) vs baseline: +0.4% Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +5.0% ✅ ospathjoin_aspectTime: ✅ 6.083µs (SLO: <10.000µs 📉 -39.2%) vs baseline: -0.5% Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6% ✅ ospathjoin_noaspectTime: ✅ 2.295µs (SLO: <10.000µs 📉 -77.0%) vs baseline: +0.6% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ ospathnormcase_aspectTime: ✅ 3.495µs (SLO: <10.000µs 📉 -65.0%) vs baseline: +1.5% Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.1% ✅ ospathnormcase_noaspectTime: ✅ 0.562µs (SLO: <10.000µs 📉 -94.4%) vs baseline: -1.8% Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.0% ✅ ospathsplit_aspectTime: ✅ 5.242µs (SLO: <10.000µs 📉 -47.6%) vs baseline: +10.0% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.1% ✅ ospathsplit_noaspectTime: ✅ 1.588µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +5.0% ✅ ospathsplitdrive_aspectTime: ✅ 3.730µs (SLO: <10.000µs 📉 -62.7%) vs baseline: +1.0% Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ ospathsplitdrive_noaspectTime: ✅ 0.694µs (SLO: <10.000µs 📉 -93.1%) vs baseline: ~same Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ ospathsplitext_aspectTime: ✅ 4.594µs (SLO: <10.000µs 📉 -54.1%) vs baseline: +1.3% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 1.373µs (SLO: <10.000µs 📉 -86.3%) vs baseline: -0.5% Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9% 📈 telemetryaddmetric - 30/30✅ 1-count-metric-1-timesTime: ✅ 3.112µs (SLO: <20.000µs 📉 -84.4%) vs baseline: +0.6% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7% ✅ 1-count-metrics-100-timesTime: ✅ 212.025µs (SLO: <250.000µs 📉 -15.2%) vs baseline: -0.4% Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.9% ✅ 1-distribution-metric-1-timesTime: ✅ 3.295µs (SLO: <20.000µs 📉 -83.5%) vs baseline: 📈 +13.3% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.7% ✅ 1-distribution-metrics-100-timesTime: ✅ 190.189µs (SLO: <220.000µs 📉 -13.6%) vs baseline: +0.7% Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.5% ✅ 1-gauge-metric-1-timesTime: ✅ 2.076µs (SLO: <20.000µs 📉 -89.6%) vs baseline: +0.4% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.3% ✅ 1-gauge-metrics-100-timesTime: ✅ 124.551µs (SLO: <150.000µs 📉 -17.0%) vs baseline: +0.3% Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9% ✅ 1-rate-metric-1-timesTime: ✅ 3.107µs (SLO: <20.000µs 📉 -84.5%) vs baseline: -0.2% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 1-rate-metrics-100-timesTime: ✅ 214.449µs (SLO: <250.000µs 📉 -14.2%) vs baseline: +1.7% Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0% ✅ 100-count-metrics-100-timesTime: ✅ 21.437ms (SLO: <23.500ms -8.8%) vs baseline: -0.1% Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.9% ✅ 100-distribution-metrics-100-timesTime: ✅ 2.033ms (SLO: <2.250ms -9.6%) vs baseline: +2.7% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 100-gauge-metrics-100-timesTime: ✅ 1.281ms (SLO: <1.550ms 📉 -17.4%) vs baseline: -0.7% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9% ✅ 100-rate-metrics-100-timesTime: ✅ 2.178ms (SLO: <2.550ms 📉 -14.6%) vs baseline: ~same Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +4.8% ✅ flush-1-metricTime: ✅ 4.110µs (SLO: <20.000µs 📉 -79.5%) vs baseline: -0.1% Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +5.0% ✅ flush-100-metricsTime: ✅ 181.249µs (SLO: <250.000µs 📉 -27.5%) vs baseline: -1.0% Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.2% ✅ flush-1000-metricsTime: ✅ 2.205ms (SLO: <2.500ms 📉 -11.8%) vs baseline: +0.2% Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.9% 🟡 Near SLO Breach (4 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 20.486ms (SLO: <22.300ms -8.1%) vs baseline: ~same Memory: ✅ 65.536MB (SLO: <67.000MB -2.2%) vs baseline: +4.8% ✅ exception-replay-enabledTime: ✅ 1.347ms (SLO: <1.450ms -7.1%) vs baseline: +0.1% Memory: ✅ 64.552MB (SLO: <67.000MB -3.7%) vs baseline: +4.9% ✅ iastTime: ✅ 20.460ms (SLO: <22.250ms -8.0%) vs baseline: -0.3% Memory: ✅ 65.469MB (SLO: <67.000MB -2.3%) vs baseline: +4.8% ✅ profilerTime: ✅ 15.283ms (SLO: <16.550ms -7.7%) vs baseline: +0.1% Memory: ✅ 53.801MB (SLO: <54.500MB 🟡 -1.3%) vs baseline: +5.3% ✅ resource-renamingTime: ✅ 20.529ms (SLO: <21.750ms -5.6%) vs baseline: +0.1% Memory: ✅ 65.509MB (SLO: <67.000MB -2.2%) vs baseline: +4.9% ✅ span-code-originTime: ✅ 26.153ms (SLO: <28.200ms -7.3%) vs baseline: ~same Memory: ✅ 67.582MB (SLO: <69.500MB -2.8%) vs baseline: +4.9% ✅ tracerTime: ✅ 20.504ms (SLO: <21.750ms -5.7%) vs baseline: ~same Memory: ✅ 65.538MB (SLO: <67.000MB -2.2%) vs baseline: +4.9% ✅ tracer-and-profilerTime: ✅ 21.946ms (SLO: <23.500ms -6.6%) vs baseline: -0.1% Memory: ✅ 66.594MB (SLO: <67.500MB 🟡 -1.3%) vs baseline: +4.9% ✅ tracer-dont-create-db-spansTime: ✅ 19.356ms (SLO: <21.500ms -10.0%) vs baseline: ~same Memory: ✅ 65.534MB (SLO: <66.000MB 🟡 -0.7%) vs baseline: +4.9% ✅ tracer-minimalTime: ✅ 16.596ms (SLO: <17.500ms -5.2%) vs baseline: ~same Memory: ✅ 65.189MB (SLO: <66.000MB 🟡 -1.2%) vs baseline: +4.8% ✅ tracer-nativeTime: ✅ 20.506ms (SLO: <21.750ms -5.7%) vs baseline: -0.3% Memory: ✅ 71.455MB (SLO: <72.500MB 🟡 -1.4%) vs baseline: +4.9% ✅ tracer-no-cachesTime: ✅ 18.512ms (SLO: <19.650ms -5.8%) vs baseline: +0.9% Memory: ✅ 65.451MB (SLO: <67.000MB -2.3%) vs baseline: +4.8% ✅ tracer-no-databasesTime: ✅ 18.816ms (SLO: <20.100ms -6.4%) vs baseline: ~same Memory: ✅ 65.122MB (SLO: <67.000MB -2.8%) vs baseline: +4.8% ✅ tracer-no-middlewareTime: ✅ 20.194ms (SLO: <21.500ms -6.1%) vs baseline: +0.3% Memory: ✅ 65.559MB (SLO: <67.000MB -2.2%) vs baseline: +5.0% ✅ tracer-no-templatesTime: ✅ 20.360ms (SLO: <22.000ms -7.5%) vs baseline: +0.1% Memory: ✅ 65.562MB (SLO: <67.000MB -2.1%) vs baseline: +4.9% 🟡 errortrackingdjangosimple - 6/6✅ errortracking-enabled-allTime: ✅ 18.085ms (SLO: <19.850ms -8.9%) vs baseline: +0.2% Memory: ✅ 65.333MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +5.0% ✅ errortracking-enabled-userTime: ✅ 18.060ms (SLO: <19.400ms -6.9%) vs baseline: +0.3% Memory: ✅ 65.313MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9% ✅ tracer-enabledTime: ✅ 18.056ms (SLO: <19.450ms -7.2%) vs baseline: -0.1% Memory: ✅ 65.352MB (SLO: <66.500MB 🟡 -1.7%) vs baseline: +4.9% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 4.577ms (SLO: <4.750ms -3.6%) vs baseline: -0.3% Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.8% ✅ appsec-postTime: ✅ 6.580ms (SLO: <6.750ms -2.5%) vs baseline: -0.2% Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.9% ✅ appsec-telemetryTime: ✅ 4.572ms (SLO: <4.750ms -3.7%) vs baseline: -0.4% Memory: ✅ 61.932MB (SLO: <65.000MB -4.7%) vs baseline: +4.8% ✅ debuggerTime: ✅ 1.857ms (SLO: <2.000ms -7.2%) vs baseline: +0.3% Memory: ✅ 45.416MB (SLO: <47.000MB -3.4%) vs baseline: +4.8% ✅ iast-getTime: ✅ 1.865ms (SLO: <2.000ms -6.7%) vs baseline: +0.2% Memory: ✅ 42.271MB (SLO: <49.000MB 📉 -13.7%) vs baseline: +4.6% ✅ profilerTime: ✅ 1.908ms (SLO: <2.100ms -9.1%) vs baseline: ~same Memory: ✅ 46.478MB (SLO: <47.000MB 🟡 -1.1%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 3.380ms (SLO: <3.650ms -7.4%) vs baseline: -0.3% Memory: ✅ 52.219MB (SLO: <53.500MB -2.4%) vs baseline: +4.8% ✅ tracerTime: ✅ 3.373ms (SLO: <3.650ms -7.6%) vs baseline: -0.3% Memory: ✅ 52.239MB (SLO: <53.500MB -2.4%) vs baseline: +4.9% ✅ tracer-nativeTime: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: -0.3% Memory: ✅ 58.088MB (SLO: <60.000MB -3.2%) vs baseline: +4.7% 🟡 otelspan - 22/22✅ add-eventTime: ✅ 45.071ms (SLO: <47.150ms -4.4%) vs baseline: +0.1% Memory: ✅ 45.286MB (SLO: <47.000MB -3.6%) vs baseline: +4.9% ✅ add-metricsTime: ✅ 321.512ms (SLO: <344.800ms -6.8%) vs baseline: -0.6% Memory: ✅ 553.017MB (SLO: <562.000MB 🟡 -1.6%) vs baseline: +5.1% ✅ add-tagsTime: ✅ 292.104ms (SLO: <314.000ms -7.0%) vs baseline: +0.4% Memory: ✅ 554.181MB (SLO: <563.500MB 🟡 -1.7%) vs baseline: +4.8% ✅ get-contextTime: ✅ 83.092ms (SLO: <92.350ms 📉 -10.0%) vs baseline: +0.4% Memory: ✅ 40.254MB (SLO: <46.500MB 📉 -13.4%) vs baseline: +4.9% ✅ is-recordingTime: ✅ 43.178ms (SLO: <44.500ms -3.0%) vs baseline: +1.0% Memory: ✅ 44.613MB (SLO: <47.500MB -6.1%) vs baseline: +4.6% ✅ record-exceptionTime: ✅ 61.893ms (SLO: <67.650ms -8.5%) vs baseline: ~same Memory: ✅ 40.558MB (SLO: <47.000MB 📉 -13.7%) vs baseline: +4.7% ✅ set-statusTime: ✅ 48.944ms (SLO: <50.400ms -2.9%) vs baseline: +0.5% Memory: ✅ 44.633MB (SLO: <47.000MB -5.0%) vs baseline: +4.9% ✅ startTime: ✅ 42.006ms (SLO: <43.450ms -3.3%) vs baseline: -0.4% Memory: ✅ 44.605MB (SLO: <47.000MB -5.1%) vs baseline: +4.8% ✅ start-finishTime: ✅ 83.061ms (SLO: <88.000ms -5.6%) vs baseline: ~same Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +5.0% ✅ start-finish-telemetryTime: ✅ 84.474ms (SLO: <89.000ms -5.1%) vs baseline: -0.1% Memory: ✅ 34.603MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.9% ✅ update-nameTime: ✅ 44.287ms (SLO: <45.150ms 🟡 -1.9%) vs baseline: +0.3% Memory: ✅ 44.961MB (SLO: <47.000MB -4.3%) vs baseline: +4.8%
|
Description
CI Visibility: This fix resolves an issue where code imported at module level but not executed during a test would
not be considered by Test Impact Analysis as impacting the test. For example, a test using a constant imported from
some other module would not count the constant definition among its impacting lines, because the constant definition
is not executed during the test, but rather when the module was imported. With this change, code executed at import
time is also included among the impacted lines of a test.
Testing
Added unit test for the imported constant case. Modified existing coverage tests, as now they include more covered lines.
Also did some manual testing with a simple repo containing a test importing a constant from a different module and checking that a change in the constant triggers the test to be run.
Risks
We now include more lines among the impacted lines of a test, which means we will skip fewer tests. All lines executed at the top level of the imported modules are included, which is a bit coarse grained and means we might run tests that could theoretically be skipped, but this is safer than the opposite (skipping tests that should be run). Also it does not really matter because the backend does not care about the specific lines covered, only about the filenames covered by a test.
Additional Notes
None.