Update .gitlab/one-pipeline.locked.yaml#7836
Conversation
8cf8685 to
8899e57
Compare
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (7836) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (75ms) : 70, 80
master - mean (75ms) : 70, 81
section Bailout
This PR (7836) - mean (79ms) : 73, 85
master - mean (81ms) : 76, 86
section CallTarget+Inlining+NGEN
This PR (7836) - mean (1,119ms) : 1037, 1201
master - mean (1,133ms) : 1042, 1224
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (118ms) : 111, 124
master - mean (119ms) : 114, 123
section Bailout
This PR (7836) - mean (121ms) : 113, 129
master - mean (121ms) : 114, 127
section CallTarget+Inlining+NGEN
This PR (7836) - mean (806ms) : 761, 850
master - mean (799ms) : 758, 839
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (105ms) : 98, 113
master - mean (106ms) : 100, 113
section Bailout
This PR (7836) - mean (106ms) : 100, 111
master - mean (106ms) : 99, 113
section CallTarget+Inlining+NGEN
This PR (7836) - mean (760ms) : 708, 811
master - mean (750ms) : 719, 781
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (104ms) : 98, 109
master - mean (104ms) : 99, 110
section Bailout
This PR (7836) - mean (106ms) : 100, 113
master - mean (106ms) : 99, 113
section CallTarget+Inlining+NGEN
This PR (7836) - mean (722ms) : 691, 752
master - mean (724ms) : 687, 760
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (192ms) : 188, 197
master - mean (193ms) : 189, 197
section Bailout
This PR (7836) - mean (197ms) : 193, 201
master - mean (198ms) : 193, 203
section CallTarget+Inlining+NGEN
This PR (7836) - mean (1,177ms) : 1102, 1251
master - mean (1,170ms) : 1114, 1225
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (277ms) : 271, 284
master - mean (278ms) : 270, 287
section Bailout
This PR (7836) - mean (277ms) : 273, 282
master - mean (280ms) : 275, 284
section CallTarget+Inlining+NGEN
This PR (7836) - mean (950ms) : 900, 1000
master - mean (943ms) : 901, 986
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (273ms) : 263, 283
master - mean (271ms) : 267, 276
section Bailout
This PR (7836) - mean (270ms) : 266, 275
master - mean (271ms) : 267, 275
section CallTarget+Inlining+NGEN
This PR (7836) - mean (934ms) : 887, 981
master - mean (929ms) : 876, 983
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (7836) - mean (269ms) : 263, 276
master - mean (270ms) : 265, 275
section Bailout
This PR (7836) - mean (269ms) : 265, 273
master - mean (269ms) : 267, 272
section CallTarget+Inlining+NGEN
This PR (7836) - mean (858ms) : 836, 880
master - mean (864ms) : 840, 888
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
BenchmarksBenchmarks Report for benchmark platform 🐌Benchmarks for #7836 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored. Benchmark detailsBenchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecBodyBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecEncoderBenchmark - Same speed ✔️ Same allocations ✔️Raw results
Benchmarks.Trace.Asm.AppSecWafBenchmark - Slower
|
| Benchmark | diff/base | Base Median (ns) | Diff Median (ns) | Modality |
|---|---|---|---|---|
| Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack‑netcoreapp3.1 | 2.463 | 296,613.95 | 730,598.55 |
| Benchmark | base/diff | Base Median (ns) | Diff Median (ns) | Modality |
|---|---|---|---|---|
| Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark‑netcoreapp3.1 | 2.046 | 852,884.17 | 416,883.75 |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | RunWafRealisticBenchmark |
net6.0 | 390μs | 111ns | 415ns | 0 | 0 | 0 | 4.55 KB |
| master | RunWafRealisticBenchmark |
netcoreapp3.1 | 847μs | 4.23μs | 18.5μs | 0 | 0 | 0 | 4.48 KB |
| master | RunWafRealisticBenchmark |
net472 | 427μs | 57.6ns | 223ns | 0 | 0 | 0 | 4.66 KB |
| master | RunWafRealisticBenchmarkWithAttack |
net6.0 | 287μs | 47.7ns | 179ns | 0 | 0 | 0 | 2.24 KB |
| master | RunWafRealisticBenchmarkWithAttack |
netcoreapp3.1 | 297μs | 473ns | 1.83μs | 0 | 0 | 0 | 2.22 KB |
| master | RunWafRealisticBenchmarkWithAttack |
net472 | 311μs | 18.8ns | 73ns | 0 | 0 | 0 | 2.29 KB |
| #7836 | RunWafRealisticBenchmark |
net6.0 | 391μs | 91.8ns | 331ns | 0 | 0 | 0 | 4.55 KB |
| #7836 | RunWafRealisticBenchmark |
netcoreapp3.1 | 415μs | 937ns | 3.63μs | 0 | 0 | 0 | 4.48 KB |
| #7836 | RunWafRealisticBenchmark |
net472 | 433μs | 69ns | 267ns | 0 | 0 | 0 | 4.66 KB |
| #7836 | RunWafRealisticBenchmarkWithAttack |
net6.0 | 287μs | 26.2ns | 98.2ns | 0 | 0 | 0 | 2.24 KB |
| #7836 | RunWafRealisticBenchmarkWithAttack |
netcoreapp3.1 | 729μs | 1.44μs | 5.4μs | 0 | 0 | 0 | 2.22 KB |
| #7836 | RunWafRealisticBenchmarkWithAttack |
net472 | 309μs | 31.8ns | 123ns | 0 | 0 | 0 | 2.29 KB |
Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendRequest |
net6.0 | 61.2μs | 297ns | 1.19μs | 0 | 0 | 0 | 14.52 KB |
| master | SendRequest |
netcoreapp3.1 | 72.2μs | 52ns | 202ns | 0 | 0 | 0 | 17.42 KB |
| master | SendRequest |
net472 | 0.00135ns | 0.000767ns | 0.00297ns | 0 | 0 | 0 | 0 b |
| #7836 | SendRequest |
net6.0 | 61.9μs | 93.7ns | 338ns | 0 | 0 | 0 | 14.52 KB |
| #7836 | SendRequest |
netcoreapp3.1 | 71.3μs | 97.4ns | 365ns | 0 | 0 | 0 | 17.42 KB |
| #7836 | SendRequest |
net472 | 0.000917ns | 0.000675ns | 0.00261ns | 0 | 0 | 0 | 0 b |
Benchmarks.Trace.CharSliceBenchmark - Same speed ✔️ More allocations ⚠️
More allocations ⚠️ in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool‑netcoreapp3.1
0 b
1 B
1 B
∞
Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice‑net6.0
2 B
4 B
2 B
100.00%
Fewer allocations 🎉 in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice‑net472
73 B
0 b
-73 B
-100.00%
Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool‑net472
47 B
0 b
-47 B
-100.00%
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool‑netcoreapp3.1 | 0 b | 1 B | 1 B | ∞ |
| Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice‑net6.0 | 2 B | 4 B | 2 B | 100.00% |
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice‑net472 | 73 B | 0 b | -73 B | -100.00% |
| Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool‑net472 | 47 B | 0 b | -47 B | -100.00% |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | OriginalCharSlice |
net6.0 | 1.88ms | 272ns | 1.06μs | 0 | 0 | 0 | 640.01 KB |
| master | OriginalCharSlice |
netcoreapp3.1 | 2.13ms | 7.18μs | 25.9μs | 0 | 0 | 0 | 640 KB |
| master | OriginalCharSlice |
net472 | 2.61ms | 118ns | 456ns | 100 | 0 | 0 | 641.95 KB |
| master | OptimizedCharSlice |
net6.0 | 1.41ms | 106ns | 409ns | 0 | 0 | 0 | 2 B |
| master | OptimizedCharSlice |
netcoreapp3.1 | 1.74ms | 980ns | 3.79μs | 0 | 0 | 0 | 1 B |
| master | OptimizedCharSlice |
net472 | 1.94ms | 240ns | 930ns | 0 | 0 | 0 | 73 B |
| master | OptimizedCharSliceWithPool |
net6.0 | 803μs | 45ns | 174ns | 0 | 0 | 0 | 2 B |
| master | OptimizedCharSliceWithPool |
netcoreapp3.1 | 815μs | 60.6ns | 235ns | 0 | 0 | 0 | 0 b |
| master | OptimizedCharSliceWithPool |
net472 | 1.14ms | 73.2ns | 284ns | 0 | 0 | 0 | 47 B |
| #7836 | OriginalCharSlice |
net6.0 | 1.92ms | 419ns | 1.51μs | 0 | 0 | 0 | 640.01 KB |
| #7836 | OriginalCharSlice |
netcoreapp3.1 | 2.21ms | 5.18μs | 18.7μs | 0 | 0 | 0 | 640 KB |
| #7836 | OriginalCharSlice |
net472 | 2.7ms | 219ns | 789ns | 100 | 0 | 0 | 641.95 KB |
| #7836 | OptimizedCharSlice |
net6.0 | 1.42ms | 275ns | 1.03μs | 0 | 0 | 0 | 4 B |
| #7836 | OptimizedCharSlice |
netcoreapp3.1 | 1.86ms | 256ns | 991ns | 0 | 0 | 0 | 1 B |
| #7836 | OptimizedCharSlice |
net472 | 1.92ms | 605ns | 2.34μs | 0 | 0 | 0 | 0 b |
| #7836 | OptimizedCharSliceWithPool |
net6.0 | 802μs | 36.3ns | 131ns | 0 | 0 | 0 | 2 B |
| #7836 | OptimizedCharSliceWithPool |
netcoreapp3.1 | 834μs | 111ns | 430ns | 0 | 0 | 0 | 1 B |
| #7836 | OptimizedCharSliceWithPool |
net472 | 1.13ms | 129ns | 499ns | 0 | 0 | 0 | 0 b |
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ More allocations ⚠️
More allocations ⚠️ in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net6.0
41.66 KB
42.35 KB
691 B
1.66%
Fewer allocations 🎉 in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472
56.61 KB
56.17 KB
-439 B
-0.78%
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net6.0 | 41.66 KB | 42.35 KB | 691 B | 1.66% |
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces‑net472 | 56.61 KB | 56.17 KB | -439 B | -0.78% |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | WriteAndFlushEnrichedTraces |
net6.0 | 677μs | 649ns | 2.51μs | 0 | 0 | 0 | 41.66 KB |
| master | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 735μs | 2.84μs | 14.2μs | 0 | 0 | 0 | 42.31 KB |
| master | WriteAndFlushEnrichedTraces |
net472 | 975μs | 4.81μs | 19.8μs | 8.93 | 0 | 0 | 56.61 KB |
| #7836 | WriteAndFlushEnrichedTraces |
net6.0 | 690μs | 3.95μs | 30.1μs | 0 | 0 | 0 | 42.35 KB |
| #7836 | WriteAndFlushEnrichedTraces |
netcoreapp3.1 | 701μs | 725ns | 2.61μs | 0 | 0 | 0 | 42.13 KB |
| #7836 | WriteAndFlushEnrichedTraces |
net472 | 997μs | 5.21μs | 26.5μs | 4.46 | 0 | 0 | 56.17 KB |
Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteNonQuery |
net6.0 | 1.92μs | 9.66ns | 42.1ns | 0 | 0 | 0 | 1.02 KB |
| master | ExecuteNonQuery |
netcoreapp3.1 | 2.58μs | 5.4ns | 20.9ns | 0 | 0 | 0 | 1.02 KB |
| master | ExecuteNonQuery |
net472 | 2.8μs | 3.69ns | 14.3ns | 0.157 | 0.0142 | 0 | 987 B |
| #7836 | ExecuteNonQuery |
net6.0 | 1.8μs | 6.07ns | 23.5ns | 0 | 0 | 0 | 1.02 KB |
| #7836 | ExecuteNonQuery |
netcoreapp3.1 | 2.58μs | 0.966ns | 3.61ns | 0 | 0 | 0 | 1.02 KB |
| #7836 | ExecuteNonQuery |
net472 | 2.84μs | 1.79ns | 6.71ns | 0.156 | 0.0142 | 0 | 987 B |
Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | CallElasticsearch |
net6.0 | 1.79μs | 8.64ns | 33.5ns | 0 | 0 | 0 | 1.03 KB |
| master | CallElasticsearch |
netcoreapp3.1 | 2.21μs | 10.4ns | 40.4ns | 0 | 0 | 0 | 1.03 KB |
| master | CallElasticsearch |
net472 | 3.48μs | 2.11ns | 8.17ns | 0.157 | 0 | 0 | 1.04 KB |
| master | CallElasticsearchAsync |
net6.0 | 1.85μs | 8.67ns | 33.6ns | 0 | 0 | 0 | 1.01 KB |
| master | CallElasticsearchAsync |
netcoreapp3.1 | 2.38μs | 12.5ns | 62.7ns | 0 | 0 | 0 | 1.08 KB |
| master | CallElasticsearchAsync |
net472 | 3.79μs | 5.19ns | 20.1ns | 0.172 | 0 | 0 | 1.1 KB |
| #7836 | CallElasticsearch |
net6.0 | 1.73μs | 9.15ns | 43.9ns | 0 | 0 | 0 | 1.03 KB |
| #7836 | CallElasticsearch |
netcoreapp3.1 | 2.26μs | 10.3ns | 40ns | 0 | 0 | 0 | 1.03 KB |
| #7836 | CallElasticsearch |
net472 | 3.5μs | 1.31ns | 4.89ns | 0.158 | 0 | 0 | 1.04 KB |
| #7836 | CallElasticsearchAsync |
net6.0 | 1.86μs | 7.9ns | 30.6ns | 0 | 0 | 0 | 1.01 KB |
| #7836 | CallElasticsearchAsync |
netcoreapp3.1 | 2.47μs | 7.42ns | 28.7ns | 0 | 0 | 0 | 1.08 KB |
| #7836 | CallElasticsearchAsync |
net472 | 3.64μs | 3.87ns | 14.5ns | 0.163 | 0 | 0 | 1.1 KB |
Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | ExecuteAsync |
net6.0 | 1.91μs | 7.95ns | 28.7ns | 0 | 0 | 0 | 952 B |
| master | ExecuteAsync |
netcoreapp3.1 | 2.49μs | 8ns | 31ns | 0 | 0 | 0 | 952 B |
| master | ExecuteAsync |
net472 | 2.54μs | 0.785ns | 3.04ns | 0.14 | 0 | 0 | 915 B |
| #7836 | ExecuteAsync |
net6.0 | 1.92μs | 2.75ns | 10.6ns | 0 | 0 | 0 | 952 B |
| #7836 | ExecuteAsync |
netcoreapp3.1 | 2.43μs | 3.91ns | 13.5ns | 0 | 0 | 0 | 952 B |
| #7836 | ExecuteAsync |
net472 | 2.61μs | 2.48ns | 9.3ns | 0.143 | 0 | 0 | 915 B |
Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendAsync |
net6.0 | 6.84μs | 26.5ns | 103ns | 0 | 0 | 0 | 2.36 KB |
| master | SendAsync |
netcoreapp3.1 | 8.54μs | 23.6ns | 91.3ns | 0 | 0 | 0 | 2.9 KB |
| master | SendAsync |
net472 | 12.4μs | 9.25ns | 35.8ns | 0.499 | 0 | 0 | 3.18 KB |
| #7836 | SendAsync |
net6.0 | 6.93μs | 8.84ns | 30.6ns | 0 | 0 | 0 | 2.36 KB |
| #7836 | SendAsync |
netcoreapp3.1 | 8.76μs | 26ns | 101ns | 0 | 0 | 0 | 2.9 KB |
| #7836 | SendAsync |
net472 | 12.4μs | 11.8ns | 45.6ns | 0.494 | 0 | 0 | 3.18 KB |
Benchmarks.Trace.Iast.StringAspectsBenchmark - Same speed ✔️ More allocations ⚠️
More allocations ⚠️ in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net472
285.82 KB
352.3 KB
66.49 KB
23.26%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑netcoreapp3.1
42.8 KB
52.03 KB
9.23 KB
21.57%
Fewer allocations 🎉 in #7836
Benchmark
Base Allocated
Diff Allocated
Change
Change %
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0
279.94 KB
278.35 KB
-1.58 KB
-0.57%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net6.0
44.48 KB
43.47 KB
-1.01 KB
-2.27%
Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1
274.31 KB
258.38 KB
-15.93 KB
-5.81%
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net472 | 285.82 KB | 352.3 KB | 66.49 KB | 23.26% |
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑netcoreapp3.1 | 42.8 KB | 52.03 KB | 9.23 KB | 21.57% |
| Benchmark | Base Allocated | Diff Allocated | Change | Change % |
|---|---|---|---|---|
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑net6.0 | 279.94 KB | 278.35 KB | -1.58 KB | -0.57% |
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatBenchmark‑net6.0 | 44.48 KB | 43.47 KB | -1.01 KB | -2.27% |
| Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark‑netcoreapp3.1 | 274.31 KB | 258.38 KB | -15.93 KB | -5.81% |
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StringConcatBenchmark |
net6.0 | 41.6μs | 182ns | 657ns | 0 | 0 | 0 | 44.48 KB |
| master | StringConcatBenchmark |
netcoreapp3.1 | 49.2μs | 255ns | 1.51μs | 0 | 0 | 0 | 42.8 KB |
| master | StringConcatBenchmark |
net472 | 55.8μs | 207ns | 774ns | 0 | 0 | 0 | 57.34 KB |
| master | StringConcatAspectBenchmark |
net6.0 | 526μs | 1.98μs | 9.5μs | 0 | 0 | 0 | 279.94 KB |
| master | StringConcatAspectBenchmark |
netcoreapp3.1 | 513μs | 2.33μs | 8.72μs | 0 | 0 | 0 | 274.31 KB |
| master | StringConcatAspectBenchmark |
net472 | 407μs | 2.13μs | 10.4μs | 0 | 0 | 0 | 285.82 KB |
| #7836 | StringConcatBenchmark |
net6.0 | 44.8μs | 219ns | 1.2μs | 0 | 0 | 0 | 43.47 KB |
| #7836 | StringConcatBenchmark |
netcoreapp3.1 | 49.6μs | 230ns | 1.72μs | 0 | 0 | 0 | 52.03 KB |
| #7836 | StringConcatBenchmark |
net472 | 57.2μs | 289ns | 1.32μs | 0 | 0 | 0 | 57.34 KB |
| #7836 | StringConcatAspectBenchmark |
net6.0 | 474μs | 1.74μs | 6.28μs | 0 | 0 | 0 | 278.35 KB |
| #7836 | StringConcatAspectBenchmark |
netcoreapp3.1 | 548μs | 1.6μs | 5.77μs | 0 | 0 | 0 | 258.38 KB |
| #7836 | StringConcatAspectBenchmark |
net472 | 416μs | 2.19μs | 11.6μs | 0 | 0 | 0 | 352.3 KB |
Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 2.7μs | 12.7ns | 49.3ns | 0 | 0 | 0 | 1.7 KB |
| master | EnrichedLog |
netcoreapp3.1 | 3.56μs | 18.1ns | 70.3ns | 0 | 0 | 0 | 1.7 KB |
| master | EnrichedLog |
net472 | 3.91μs | 4.42ns | 17.1ns | 0.253 | 0 | 0 | 1.64 KB |
| #7836 | EnrichedLog |
net6.0 | 2.66μs | 13.7ns | 68.4ns | 0 | 0 | 0 | 1.7 KB |
| #7836 | EnrichedLog |
netcoreapp3.1 | 3.62μs | 17.4ns | 69.4ns | 0 | 0 | 0 | 1.7 KB |
| #7836 | EnrichedLog |
net472 | 3.93μs | 4.35ns | 16.8ns | 0.257 | 0 | 0 | 1.64 KB |
Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 122μs | 44.8ns | 161ns | 0 | 0 | 0 | 4.31 KB |
| master | EnrichedLog |
netcoreapp3.1 | 126μs | 45.8ns | 171ns | 0 | 0 | 0 | 4.31 KB |
| master | EnrichedLog |
net472 | 166μs | 109ns | 420ns | 0 | 0 | 0 | 4.51 KB |
| #7836 | EnrichedLog |
net6.0 | 125μs | 179ns | 621ns | 0 | 0 | 0 | 4.31 KB |
| #7836 | EnrichedLog |
netcoreapp3.1 | 129μs | 187ns | 700ns | 0 | 0 | 0 | 4.31 KB |
| #7836 | EnrichedLog |
net472 | 167μs | 26.7ns | 103ns | 0 | 0 | 0 | 4.51 KB |
Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 5.24μs | 17.3ns | 67ns | 0 | 0 | 0 | 2.26 KB |
| master | EnrichedLog |
netcoreapp3.1 | 6.81μs | 25.6ns | 99.2ns | 0 | 0 | 0 | 2.26 KB |
| master | EnrichedLog |
net472 | 7.57μs | 5.71ns | 20.6ns | 0.304 | 0 | 0 | 2.08 KB |
| #7836 | EnrichedLog |
net6.0 | 5.37μs | 15.9ns | 59.6ns | 0 | 0 | 0 | 2.26 KB |
| #7836 | EnrichedLog |
netcoreapp3.1 | 6.69μs | 9.4ns | 33.9ns | 0 | 0 | 0 | 2.26 KB |
| #7836 | EnrichedLog |
net472 | 7.61μs | 10.3ns | 39.7ns | 0.305 | 0 | 0 | 2.08 KB |
Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | SendReceive |
net6.0 | 2.01μs | 10.1ns | 45ns | 0 | 0 | 0 | 1.2 KB |
| master | SendReceive |
netcoreapp3.1 | 2.67μs | 10.9ns | 42.3ns | 0 | 0 | 0 | 1.2 KB |
| master | SendReceive |
net472 | 3.13μs | 8.16ns | 31.6ns | 0.186 | 0 | 0 | 1.2 KB |
| #7836 | SendReceive |
net6.0 | 1.97μs | 10.2ns | 48.8ns | 0 | 0 | 0 | 1.2 KB |
| #7836 | SendReceive |
netcoreapp3.1 | 2.66μs | 13.5ns | 61.7ns | 0 | 0 | 0 | 1.2 KB |
| #7836 | SendReceive |
net472 | 3.1μs | 4.69ns | 17.5ns | 0.186 | 0 | 0 | 1.2 KB |
Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | EnrichedLog |
net6.0 | 4.2μs | 9.85ns | 36.9ns | 0 | 0 | 0 | 1.58 KB |
| master | EnrichedLog |
netcoreapp3.1 | 5.56μs | 16.7ns | 64.8ns | 0 | 0 | 0 | 1.63 KB |
| master | EnrichedLog |
net472 | 6.69μs | 10.7ns | 41.4ns | 0.301 | 0 | 0 | 2.03 KB |
| #7836 | EnrichedLog |
net6.0 | 4.36μs | 1.56ns | 5.63ns | 0 | 0 | 0 | 1.58 KB |
| #7836 | EnrichedLog |
netcoreapp3.1 | 5.55μs | 20.2ns | 78.2ns | 0 | 0 | 0 | 1.63 KB |
| #7836 | EnrichedLog |
net472 | 6.39μs | 9.55ns | 37ns | 0.32 | 0 | 0 | 2.03 KB |
Benchmarks.Trace.SpanBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | StartFinishSpan |
net6.0 | 777ns | 0.329ns | 1.23ns | 0 | 0 | 0 | 576 B |
| master | StartFinishSpan |
netcoreapp3.1 | 973ns | 0.642ns | 2.49ns | 0 | 0 | 0 | 576 B |
| master | StartFinishSpan |
net472 | 955ns | 0.25ns | 0.934ns | 0.0907 | 0 | 0 | 578 B |
| master | StartFinishScope |
net6.0 | 906ns | 3.92ns | 15.2ns | 0 | 0 | 0 | 696 B |
| master | StartFinishScope |
netcoreapp3.1 | 1.21μs | 6.07ns | 27.8ns | 0 | 0 | 0 | 696 B |
| master | StartFinishScope |
net472 | 1.12μs | 0.203ns | 0.76ns | 0.101 | 0 | 0 | 658 B |
| #7836 | StartFinishSpan |
net6.0 | 785ns | 4.25ns | 23.3ns | 0 | 0 | 0 | 576 B |
| #7836 | StartFinishSpan |
netcoreapp3.1 | 958ns | 5.07ns | 25.4ns | 0 | 0 | 0 | 576 B |
| #7836 | StartFinishSpan |
net472 | 949ns | 0.272ns | 1.02ns | 0.0912 | 0 | 0 | 578 B |
| #7836 | StartFinishScope |
net6.0 | 918ns | 4.88ns | 23.9ns | 0 | 0 | 0 | 696 B |
| #7836 | StartFinishScope |
netcoreapp3.1 | 1.19μs | 5.84ns | 24.8ns | 0 | 0 | 0 | 696 B |
| #7836 | StartFinishScope |
net472 | 1.12μs | 0.0923ns | 0.357ns | 0.101 | 0 | 0 | 658 B |
Benchmarks.Trace.TraceAnnotationsBenchmark - Same speed ✔️ Same allocations ✔️
Raw results
| Branch | Method | Toolchain | Mean | StdError | StdDev | Gen 0 | Gen 1 | Gen 2 | Allocated |
|---|---|---|---|---|---|---|---|---|---|
| master | RunOnMethodBegin |
net6.0 | 1.07μs | 5.83ns | 28.6ns | 0 | 0 | 0 | 696 B |
| master | RunOnMethodBegin |
netcoreapp3.1 | 1.44μs | 7.36ns | 32.9ns | 0 | 0 | 0 | 697 B |
| master | RunOnMethodBegin |
net472 | 1.47μs | 3.74ns | 14.5ns | 0.103 | 0 | 0 | 658 B |
| #7836 | RunOnMethodBegin |
net6.0 | 1.06μs | 5.07ns | 20.9ns | 0 | 0 | 0 | 696 B |
| #7836 | RunOnMethodBegin |
netcoreapp3.1 | 1.44μs | 5.68ns | 22ns | 0 | 0 | 0 | 696 B |
| #7836 | RunOnMethodBegin |
net472 | 1.51μs | 2.53ns | 9.79ns | 0.0981 | 0 | 0 | 658 B |
andrewlock
left a comment
There was a problem hiding this comment.
Just going to block this until we know what it does - these updates are dangerous without knowing the implications
@andrewlock Sorry, I should have added more info to the PR description (auto-generated PR). I added 2 CI Checks for Config Registry to support a new format for the supported-configurations.json file (ref1, ref2). I manually triggered the job to update the hash in our dd-trace-* libraries to allow tracers to migrate to using the new CI checks and new format for the supported-configurations.json file. |
Automatic PR. Updates .gitlab/one-pipeline.locked.yaml