[Profiler] Update benchmarks definitions#7970
Conversation
Disable profilers by default
|
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (7970) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (69ms) : 67, 70
master - mean (69ms) : 67, 70
section Bailout
This PR (7970) - mean (73ms) : 71, 74
master - mean (72ms) : 71, 74
section CallTarget+Inlining+NGEN
This PR (7970) - mean (1,016ms) : 967, 1065
master - mean (1,018ms) : 964, 1073
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (106ms) : 103, 109
master - mean (106ms) : 103, 109
section Bailout
This PR (7970) - mean (107ms) : 106, 108
master - mean (107ms) : 106, 108
section CallTarget+Inlining+NGEN
This PR (7970) - mean (730ms) : 672, 788
master - mean (751ms) : 690, 813
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (94ms) : 92, 96
master - mean (94ms) : 92, 96
section Bailout
This PR (7970) - mean (95ms) : 94, 96
master - mean (95ms) : 94, 96
section CallTarget+Inlining+NGEN
This PR (7970) - mean (713ms) : 674, 753
master - mean (705ms) : 646, 765
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (93ms) : 90, 95
master - mean (93ms) : 91, 95
section Bailout
This PR (7970) - mean (93ms) : 92, 94
master - mean (93ms) : 92, 95
section CallTarget+Inlining+NGEN
This PR (7970) - mean (638ms) : 620, 657
master - mean (635ms) : 617, 653
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (193ms) : 189, 198
master - mean (193ms) : 189, 198
section Bailout
This PR (7970) - mean (197ms) : 193, 200
master - mean (198ms) : 194, 201
section CallTarget+Inlining+NGEN
This PR (7970) - mean (1,120ms) : 1065, 1175
master - mean (1,124ms) : 1052, 1197
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (276ms) : 271, 280
master - mean (277ms) : 271, 283
section Bailout
This PR (7970) - mean (276ms) : 273, 280
master - mean (279ms) : 272, 286
section CallTarget+Inlining+NGEN
This PR (7970) - mean (927ms) : 876, 977
master - mean (929ms) : 888, 970
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (270ms) : 266, 273
master - mean (270ms) : 266, 275
section Bailout
This PR (7970) - mean (269ms) : 266, 272
master - mean (270ms) : 267, 273
section CallTarget+Inlining+NGEN
This PR (7970) - mean (926ms) : 886, 966
master - mean (928ms) : 879, 976
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7970) - mean (269ms) : 263, 274
master - mean (270ms) : 265, 275
section Bailout
This PR (7970) - mean (269ms) : 265, 272
master - mean (270ms) : 264, 276
section CallTarget+Inlining+NGEN
This PR (7970) - mean (825ms) : 803, 848
master - mean (824ms) : 804, 844
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
BenchmarksBenchmark execution time: 2026-01-09 23:13:34 Comparing candidate commit d426c4a in PR branch Found 10 performance improvements and 2 performance regressions! Performance is the same for 159 metrics, 15 unstable metrics. scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack netcoreapp3.1
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0
scenario:Benchmarks.Trace.HttpClientBenchmark.SendAsync net472
scenario:Benchmarks.Trace.RedisBenchmark.SendReceive netcoreapp3.1
|
Summary of changes
Reason for change
Ensure that new profilers that are enabled by default are disabled for targetted benchmarks
Get new numbers for .NET 10 LTS version
Implementation details
Test coverage
Manual validation
Other details