[Profiler] Update tests to save output to xunit.txt files #6160

chrisnas · 2024-10-16T09:43:26Z

Summary of changes

Update all tests to send output to console AND file

Reason for change

That way, it is possible to have the tests output visible in the CI with xunit.txt file to download

Implementation details

Update all tests

Test coverage

n/a

Other details

andrewlock · 2024-10-16T10:15:33Z

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (71ms)  : 63, 79
     .   : milestone, 71,
    master - mean (72ms)  : 64, 80
     .   : milestone, 72,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (1,110ms)  : 1088, 1131
     .   : milestone, 1110,
    master - mean (1,106ms)  : 1085, 1127
     .   : milestone, 1106,

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (108ms)  : 106, 110
     .   : milestone, 108,
    master - mean (108ms)  : 106, 111
     .   : milestone, 108,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (767ms)  : 746, 788
     .   : milestone, 767,
    master - mean (771ms)  : 736, 805
     .   : milestone, 771,

gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (92ms)  : 89, 94
     .   : milestone, 92,
    master - mean (92ms)  : 90, 94
     .   : milestone, 92,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (722ms)  : 705, 738
     .   : milestone, 722,
    master - mean (725ms)  : 709, 741
     .   : milestone, 725,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (191ms)  : 186, 195
     .   : milestone, 191,
    master - mean (191ms)  : 186, 197
     .   : milestone, 191,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (1,209ms)  : 1189, 1230
     .   : milestone, 1209,
    master - mean (1,211ms)  : 1187, 1235
     .   : milestone, 1211,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (276ms)  : 271, 281
     .   : milestone, 276,
    master - mean (276ms)  : 272, 281
     .   : milestone, 276,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (943ms)  : 924, 963
     .   : milestone, 943,
    master - mean (943ms)  : 927, 959
     .   : milestone, 943,

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6160) - mean (265ms)  : 260, 271
     .   : milestone, 265,
    master - mean (265ms)  : 261, 268
     .   : milestone, 265,

    section CallTarget+Inlining+NGEN
    This PR (6160) - mean (929ms)  : 911, 947
     .   : milestone, 929,
    master - mean (929ms)  : 911, 947
     .   : milestone, 929,

datadog-ddstaging · 2024-10-16T10:19:43Z

Datadog Report

Branch report: chrisnas/xunit_output_to_file
Commit report: d741755
Test service: dd-trace-dotnet

✅ 0 Failed, 456063 Passed, 3214 Skipped, 21h 18m 15.46s Total Time
⌛ 1 Performance Regression

⌛ Performance Regressions vs Default Branch (1)

Profiler_garbagecollections_cpu_walltime - scenarios 2.77s (+191.11ms, +7%) - Details

andrewlock · 2024-10-16T10:57:30Z

Benchmarks Report for tracer 🐌

Benchmarks for #6160 compared to master:

2 benchmarks are faster, with geometric mean 1.147
1 benchmarks have fewer allocations
1 benchmarks have more allocations

The following thresholds were used for comparing the benchmark speeds:

Mann–Whitney U test with statistical test for significance of 5%
Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`StartStopWithChild`	net6.0	7.93μs	44.8ns	304ns	0.0162	0.00809	0	5.61 KB
master	`StartStopWithChild`	netcoreapp3.1	10.1μs	53.4ns	366ns	0.0157	0.00522	0	5.8 KB
master	`StartStopWithChild`	net472	16.3μs	64.2ns	249ns	1.04	0.307	0.0969	6.22 KB
#6160	`StartStopWithChild`	net6.0	7.92μs	42.2ns	250ns	0.016	0.00798	0	5.62 KB
#6160	`StartStopWithChild`	netcoreapp3.1	9.85μs	54.1ns	329ns	0.0152	0.00507	0	5.8 KB
#6160	`StartStopWithChild`	net472	16.3μs	43.7ns	169ns	1.06	0.334	0.106	6.2 KB

Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	528μs	380ns	1.42μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	657μs	292ns	1.09μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	net472	859μs	402ns	1.39μs	0.428	3.3 KB
#6160	`WriteAndFlushEnrichedTraces`	net6.0	490μs	182ns	682ns	0	2.7 KB
#6160	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	661μs	402ns	1.5μs	0	2.7 KB
#6160	`WriteAndFlushEnrichedTraces`	net472	852μs	588ns	2.28μs	0.422	3.3 KB

Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendRequest`	net6.0	203μs	1.16μs	8.41μs	0.195	18.73 KB
master	`SendRequest`	netcoreapp3.1	222μs	1.31μs	12.5μs	0.208	20.89 KB
master	`SendRequest`	net472	0.00177ns	0.00122ns	0.00441ns	0	0 b
#6160	`SendRequest`	net6.0	202μs	1.08μs	8.11μs	0.218	18.73 KB
#6160	`SendRequest`	netcoreapp3.1	225μs	1.3μs	10.8μs	0.225	20.89 KB
#6160	`SendRequest`	net472	0.000212ns	0.000189ns	0.000709ns	0	0 b

Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations ⚠️

More allocations ⚠️ in #6160

Benchmark	Base Allocated	Diff Allocated	Change	Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net6.0	41.55 KB	41.87 KB	324 B	0.78%

Fewer allocations 🎉 in #6160

Benchmark	Base Allocated	Diff Allocated	Change	Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑netcoreapp3.1	41.89 KB	41.61 KB	-274 B	-0.65%

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	569μs	2.64μs	10.6μs	0.563	0	0	41.55 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	687μs	3.43μs	14.5μs	0.334	0	0	41.89 KB
master	`WriteAndFlushEnrichedTraces`	net472	868μs	2.87μs	10.7μs	8.56	2.57	0.428	53.26 KB
#6160	`WriteAndFlushEnrichedTraces`	net6.0	585μs	3.15μs	18.1μs	0.573	0	0	41.87 KB
#6160	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	661μs	3.26μs	13.8μs	0.338	0	0	41.61 KB
#6160	`WriteAndFlushEnrichedTraces`	net472	841μs	2.85μs	10.7μs	8.45	2.53	0.422	53.28 KB

Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`ExecuteNonQuery`	net6.0	1.27μs	1.08ns	4.05ns	0.014	0	1.02 KB
master	`ExecuteNonQuery`	netcoreapp3.1	1.75μs	1.44ns	5.37ns	0.0133	0	1.02 KB
master	`ExecuteNonQuery`	net472	2.07μs	1.94ns	7.25ns	0.157	0.00104	987 B
#6160	`ExecuteNonQuery`	net6.0	1.3μs	0.75ns	2.91ns	0.0144	0	1.02 KB
#6160	`ExecuteNonQuery`	netcoreapp3.1	1.71μs	1.28ns	4.97ns	0.0131	0	1.02 KB
#6160	`ExecuteNonQuery`	net472	2.11μs	2.41ns	9.03ns	0.156	0.00106	987 B

Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`CallElasticsearch`	net6.0	1.19μs	0.53ns	1.98ns	0.0137	976 B
master	`CallElasticsearch`	netcoreapp3.1	1.55μs	2.29ns	8.89ns	0.0131	976 B
master	`CallElasticsearch`	net472	2.6μs	1.76ns	6.59ns	0.158	995 B
master	`CallElasticsearchAsync`	net6.0	1.33μs	0.365ns	1.32ns	0.0133	952 B
master	`CallElasticsearchAsync`	netcoreapp3.1	1.56μs	0.603ns	2.34ns	0.014	1.02 KB
master	`CallElasticsearchAsync`	net472	2.6μs	0.546ns	1.97ns	0.167	1.05 KB
#6160	`CallElasticsearch`	net6.0	1.23μs	0.494ns	1.91ns	0.0136	976 B
#6160	`CallElasticsearch`	netcoreapp3.1	1.52μs	1.6ns	6.21ns	0.0133	976 B
#6160	`CallElasticsearch`	net472	2.48μs	1.11ns	4.31ns	0.157	995 B
#6160	`CallElasticsearchAsync`	net6.0	1.23μs	0.55ns	2.06ns	0.013	952 B
#6160	`CallElasticsearchAsync`	netcoreapp3.1	1.64μs	1.16ns	4.36ns	0.014	1.02 KB
#6160	`CallElasticsearchAsync`	net472	2.54μs	1.02ns	3.95ns	0.167	1.05 KB

Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`ExecuteAsync`	net6.0	1.26μs	0.434ns	1.63ns	0.0132	952 B
master	`ExecuteAsync`	netcoreapp3.1	1.62μs	1.23ns	4.61ns	0.0122	952 B
master	`ExecuteAsync`	net472	1.88μs	1.22ns	4.71ns	0.145	915 B
#6160	`ExecuteAsync`	net6.0	1.34μs	0.754ns	2.82ns	0.0134	952 B
#6160	`ExecuteAsync`	netcoreapp3.1	1.62μs	0.885ns	3.19ns	0.0131	952 B
#6160	`ExecuteAsync`	net472	1.83μs	0.891ns	3.21ns	0.145	915 B

Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendAsync`	net6.0	4.33μs	1.2ns	4.32ns	0.0325	2.31 KB
master	`SendAsync`	netcoreapp3.1	5.38μs	1.53ns	5.73ns	0.0375	2.85 KB
master	`SendAsync`	net472	7.49μs	1.11ns	4ns	0.496	3.12 KB
#6160	`SendAsync`	net6.0	4.45μs	2.39ns	8.94ns	0.0314	2.31 KB
#6160	`SendAsync`	netcoreapp3.1	5.35μs	1.39ns	5.19ns	0.0373	2.85 KB
#6160	`SendAsync`	net472	7.27μs	1.67ns	6.01ns	0.493	3.12 KB

Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	1.46μs	0.48ns	1.73ns	0.0229	1.64 KB
master	`EnrichedLog`	netcoreapp3.1	2.09μs	1.23ns	4.77ns	0.023	1.64 KB
master	`EnrichedLog`	net472	2.71μs	1.59ns	6.16ns	0.25	1.57 KB
#6160	`EnrichedLog`	net6.0	1.46μs	0.642ns	2.32ns	0.0227	1.64 KB
#6160	`EnrichedLog`	netcoreapp3.1	2.28μs	0.768ns	2.87ns	0.0217	1.64 KB
#6160	`EnrichedLog`	net472	2.65μs	1.26ns	4.71ns	0.249	1.57 KB

Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`EnrichedLog`	net6.0	121μs	185ns	715ns	0	0	4.28 KB
master	`EnrichedLog`	netcoreapp3.1	124μs	239ns	925ns	0	0	4.28 KB
master	`EnrichedLog`	net472	152μs	111ns	416ns	0.684	0.228	4.46 KB
#6160	`EnrichedLog`	net6.0	118μs	106ns	409ns	0	0	4.28 KB
#6160	`EnrichedLog`	netcoreapp3.1	122μs	209ns	782ns	0	0	4.28 KB
#6160	`EnrichedLog`	net472	152μs	102ns	396ns	0.68	0.227	4.46 KB

Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	2.96μs	0.889ns	3.33ns	0.031	2.2 KB
master	`EnrichedLog`	netcoreapp3.1	4.26μs	16.3ns	60.9ns	0.0289	2.2 KB
master	`EnrichedLog`	net472	4.94μs	1.02ns	3.82ns	0.32	2.02 KB
#6160	`EnrichedLog`	net6.0	3.16μs	15.4ns	63.6ns	0.0301	2.2 KB
#6160	`EnrichedLog`	netcoreapp3.1	4.22μs	1.72ns	6.67ns	0.0297	2.2 KB
#6160	`EnrichedLog`	net472	4.85μs	1.88ns	7.29ns	0.319	2.02 KB

Benchmarks.Trace.RedisBenchmark - Faster 🎉 Same allocations ✔️

Faster 🎉 in #6160

Benchmark	base/diff	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.RedisBenchmark.SendReceive‑net6.0	1.151	1,473.56	1,280.36

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendReceive`	net6.0	1.47μs	0.453ns	1.63ns	0.0162	1.14 KB
master	`SendReceive`	netcoreapp3.1	1.84μs	1.08ns	4.17ns	0.0155	1.14 KB
master	`SendReceive`	net472	2.17μs	0.769ns	2.98ns	0.183	1.16 KB
#6160	`SendReceive`	net6.0	1.28μs	0.894ns	3.34ns	0.016	1.14 KB
#6160	`SendReceive`	netcoreapp3.1	1.86μs	0.598ns	2.24ns	0.0157	1.14 KB
#6160	`SendReceive`	net472	2.17μs	0.568ns	2.12ns	0.183	1.16 KB

Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	2.61μs	0.941ns	3.64ns	0.0221	1.6 KB
master	`EnrichedLog`	netcoreapp3.1	3.95μs	1.48ns	5.12ns	0.0217	1.65 KB
master	`EnrichedLog`	net472	4.32μs	1.75ns	6.55ns	0.324	2.04 KB
#6160	`EnrichedLog`	net6.0	2.7μs	1.12ns	4.35ns	0.022	1.6 KB
#6160	`EnrichedLog`	netcoreapp3.1	3.98μs	1.21ns	4.7ns	0.0217	1.65 KB
#6160	`EnrichedLog`	net472	4.45μs	1.89ns	7.07ns	0.323	2.04 KB

Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`StartFinishSpan`	net6.0	397ns	0.217ns	0.841ns	0.00812	576 B
master	`StartFinishSpan`	netcoreapp3.1	559ns	0.447ns	1.73ns	0.00768	576 B
master	`StartFinishSpan`	net472	606ns	1.2ns	4.66ns	0.0917	578 B
master	`StartFinishScope`	net6.0	490ns	0.172ns	0.666ns	0.00987	696 B
master	`StartFinishScope`	netcoreapp3.1	765ns	0.77ns	2.98ns	0.00921	696 B
master	`StartFinishScope`	net472	857ns	0.977ns	3.78ns	0.104	658 B
#6160	`StartFinishSpan`	net6.0	414ns	0.289ns	1.12ns	0.0081	576 B
#6160	`StartFinishSpan`	netcoreapp3.1	549ns	0.28ns	1.09ns	0.0077	576 B
#6160	`StartFinishSpan`	net472	663ns	0.975ns	3.77ns	0.0917	578 B
#6160	`StartFinishScope`	net6.0	497ns	0.423ns	1.64ns	0.00977	696 B
#6160	`StartFinishScope`	netcoreapp3.1	803ns	0.894ns	3.46ns	0.0092	696 B
#6160	`StartFinishScope`	net472	917ns	1.13ns	4.39ns	0.104	658 B

Benchmarks.Trace.TraceAnnotationsBenchmark - Faster 🎉 Same allocations ✔️

Faster 🎉 in #6160

Benchmark	base/diff	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0	1.144	734.21	641.79

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`RunOnMethodBegin`	net6.0	734ns	0.618ns	2.39ns	0.0099	696 B
master	`RunOnMethodBegin`	netcoreapp3.1	942ns	0.844ns	3.27ns	0.00947	696 B
master	`RunOnMethodBegin`	net472	1.05μs	1.25ns	4.85ns	0.104	658 B
#6160	`RunOnMethodBegin`	net6.0	642ns	0.365ns	1.41ns	0.0096	696 B
#6160	`RunOnMethodBegin`	netcoreapp3.1	887ns	0.634ns	2.45ns	0.00941	696 B
#6160	`RunOnMethodBegin`	net472	1.12μs	0.793ns	3.07ns	0.104	658 B

andrewlock · 2024-10-16T11:17:34Z

Throughput/Crank Report ⚡

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6160) (11.235M)   : 0, 11235418
    master (11.120M)   : 0, 11120201
    benchmarks/2.9.0 (11.033M)   : 0, 11032866

    section Automatic
    This PR (6160) (7.191M)   : 0, 7191074
    master (7.143M)   : 0, 7143247
    benchmarks/2.9.0 (7.786M)   : 0, 7785853

    section Trace stats
    master (7.563M)   : 0, 7562834

    section Manual
    master (11.052M)   : 0, 11051540

    section Manual + Automatic
    This PR (6160) (6.649M)   : 0, 6649215
    master (6.532M)   : 0, 6532471

    section DD_TRACE_ENABLED=0
    master (10.176M)   : 0, 10176174

gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6160) (9.522M)   : 0, 9522441
    master (9.435M)   : 0, 9435139
    benchmarks/2.9.0 (9.495M)   : 0, 9494821

    section Automatic
    This PR (6160) (6.420M)   : 0, 6419518
    master (6.301M)   : 0, 6300608

    section Trace stats
    master (6.646M)   : 0, 6646045

    section Manual
    master (9.564M)   : 0, 9563833

    section Manual + Automatic
    This PR (6160) (5.996M)   : 0, 5995764
    master (5.897M)   : 0, 5897193

    section DD_TRACE_ENABLED=0
    master (8.862M)   : 0, 8862065

gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6160) (9.718M)   : 0, 9717936
    master (9.832M)   : 0, 9832351
    benchmarks/2.9.0 (10.020M)   : 0, 10019592

    section Automatic
    This PR (6160) (6.302M)   : 0, 6302290
    master (6.258M)   : 0, 6258447
    benchmarks/2.9.0 (7.255M)   : 0, 7255257

    section Trace stats
    master (6.950M)   : 0, 6950057

    section Manual
    master (9.945M)   : 0, 9945109

    section Manual + Automatic
    This PR (6160) (5.816M)   : 0, 5816254
    master (5.742M)   : 0, 5742033

    section DD_TRACE_ENABLED=0
    master (9.091M)   : 0, 9091089

…taDog/dd-trace-dotnet into chrisnas/xunit_output_to_file

Update tests to save output to xunit.txt files

3e9822a

chrisnas requested a review from a team as a code owner October 16, 2024 09:43

github-actions bot added the area:profiler Issues related to the continous-profiler label Oct 16, 2024

Merge remote-tracking branch 'origin' into chrisnas/xunit_output_to_file

4604300

gleocadie approved these changes Oct 28, 2024

View reviewed changes

Update tests to save output to xunit.txt files

714e946

gleocadie force-pushed the chrisnas/xunit_output_to_file branch from 4604300 to 714e946 Compare October 28, 2024 08:12

chrisnas and others added 5 commits November 13, 2024 15:00

Merge branch 'chrisnas/xunit_output_to_file' of https://github.com/Da…

75ee2c4

…taDog/dd-trace-dotnet into chrisnas/xunit_output_to_file

Merge remote-tracking branch 'origin' into chrisnas/xunit_output_to_file

453a732

Merge branch 'master' into chrisnas/xunit_output_to_file

233ea17

Merge branch 'master' into chrisnas/xunit_output_to_file

ad5c9f6

Merge branch 'master' into chrisnas/xunit_output_to_file

d741755

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Profiler] Update tests to save output to xunit.txt files #6160

[Profiler] Update tests to save output to xunit.txt files #6160

chrisnas commented Oct 16, 2024

andrewlock commented Oct 16, 2024 •

edited

Loading

datadog-ddstaging bot commented Oct 16, 2024 •

edited

Loading

andrewlock commented Oct 16, 2024 •

edited

Loading

Raw results

Raw results

Raw results

More allocations ⚠️ in #6160

Fewer allocations 🎉 in #6160

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Faster 🎉 in #6160

Raw results

Raw results

Raw results

Faster 🎉 in #6160

Raw results

andrewlock commented Oct 16, 2024 •

edited

Loading

[Profiler] Update tests to save output to xunit.txt files #6160

Are you sure you want to change the base?

[Profiler] Update tests to save output to xunit.txt files #6160

Conversation

chrisnas commented Oct 16, 2024

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

andrewlock commented Oct 16, 2024 • edited Loading

Execution-Time Benchmarks Report ⏱️

datadog-ddstaging bot commented Oct 16, 2024 • edited Loading

Datadog Report

⌛ Performance Regressions vs Default Branch (1)

andrewlock commented Oct 16, 2024 • edited Loading

Benchmarks Report for tracer 🐌

Benchmark details

Raw results

Raw results

Raw results

More allocations ⚠️ in #6160

Fewer allocations 🎉 in #6160

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Faster 🎉 in #6160

Raw results

Raw results

Raw results

Faster 🎉 in #6160

Raw results

andrewlock commented Oct 16, 2024 • edited Loading

Throughput/Crank Report ⚡

andrewlock commented Oct 16, 2024 •

edited

Loading

datadog-ddstaging bot commented Oct 16, 2024 •

edited

Loading

andrewlock commented Oct 16, 2024 •

edited

Loading

andrewlock commented Oct 16, 2024 •

edited

Loading