Fetch Windows macrobenchmark artifacts from S3#8112
Conversation
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (8112) and master.
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Metric | Master (Mean ± 95% CI) | Current (Mean ± 95% CI) | Change | Status |
|---|---|---|---|---|
| .NET Framework 4.8 - Baseline | ||||
| duration | 68.24 ± (68.22 - 68.44) ms | 74.74 ± (74.67 - 75.14) ms | +9.5% | ❌⬆️ |
| .NET Framework 4.8 - Bailout | ||||
| duration | 72.39 ± (72.30 - 72.51) ms | 79.38 ± (79.18 - 79.58) ms | +9.6% | ❌⬆️ |
Full Metrics Comparison
FakeDbCommand
| Metric | Master (Mean ± 95% CI) | Current (Mean ± 95% CI) | Change | Status |
|---|---|---|---|---|
| .NET Framework 4.8 - Baseline | ||||
| duration | 68.24 ± (68.22 - 68.44) ms | 74.74 ± (74.67 - 75.14) ms | +9.5% | ❌⬆️ |
| .NET Framework 4.8 - Bailout | ||||
| duration | 72.39 ± (72.30 - 72.51) ms | 79.38 ± (79.18 - 79.58) ms | +9.6% | ❌⬆️ |
| .NET Framework 4.8 - CallTarget+Inlining+NGEN | ||||
| duration | 1017.46 ± (1018.62 - 1024.83) ms | 1069.51 ± (1070.17 - 1077.61) ms | +5.1% | ✅⬆️ |
| .NET Core 3.1 - Baseline | ||||
| process.internal_duration_ms | 21.80 ± (21.77 - 21.84) ms | 23.11 ± (23.06 - 23.16) ms | +6.0% | ✅⬆️ |
| process.time_to_main_ms | 78.61 ± (78.45 - 78.77) ms | 87.92 ± (87.69 - 88.15) ms | +11.8% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 10.89 ± (10.89 - 10.90) MB | 10.92 ± (10.92 - 10.92) MB | +0.3% | ✅⬆️ |
| runtime.dotnet.threads.count | 12 ± (12 - 12) | 12 ± (12 - 12) | +0.0% | ✅ |
| .NET Core 3.1 - Bailout | ||||
| process.internal_duration_ms | 21.85 ± (21.83 - 21.87) ms | 23.01 ± (22.96 - 23.06) ms | +5.3% | ✅⬆️ |
| process.time_to_main_ms | 79.91 ± (79.82 - 79.99) ms | 89.62 ± (89.39 - 89.85) ms | +12.2% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 10.93 ± (10.93 - 10.94) MB | 10.97 ± (10.96 - 10.97) MB | +0.3% | ✅⬆️ |
| runtime.dotnet.threads.count | 13 ± (13 - 13) | 13 ± (13 - 13) | +0.0% | ✅ |
| .NET Core 3.1 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 241.41 ± (237.86 - 244.96) ms | 240.34 ± (236.35 - 244.33) ms | -0.4% | ✅ |
| process.time_to_main_ms | 473.96 ± (473.36 - 474.57) ms | 509.40 ± (508.28 - 510.52) ms | +7.5% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 48.52 ± (48.50 - 48.54) MB | 48.52 ± (48.50 - 48.54) MB | -0.0% | ✅ |
| runtime.dotnet.threads.count | 28 ± (28 - 28) | 28 ± (28 - 28) | -0.8% | ✅ |
| .NET 6 - Baseline | ||||
| process.internal_duration_ms | 20.58 ± (20.55 - 20.61) ms | 21.82 ± (21.77 - 21.87) ms | +6.0% | ✅⬆️ |
| process.time_to_main_ms | 68.19 ± (68.07 - 68.32) ms | 76.52 ± (76.34 - 76.71) ms | +12.2% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 10.61 ± (10.60 - 10.61) MB | 10.64 ± (10.64 - 10.65) MB | +0.4% | ✅⬆️ |
| runtime.dotnet.threads.count | 10 ± (10 - 10) | 10 ± (10 - 10) | +0.0% | ✅ |
| .NET 6 - Bailout | ||||
| process.internal_duration_ms | 20.56 ± (20.53 - 20.58) ms | 21.76 ± (21.71 - 21.80) ms | +5.8% | ✅⬆️ |
| process.time_to_main_ms | 69.13 ± (69.07 - 69.19) ms | 78.05 ± (77.84 - 78.27) ms | +12.9% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 10.65 ± (10.65 - 10.66) MB | 10.75 ± (10.74 - 10.75) MB | +0.9% | ✅⬆️ |
| runtime.dotnet.threads.count | 11 ± (11 - 11) | 11 ± (11 - 11) | +0.0% | ✅ |
| .NET 6 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 248.88 ± (247.53 - 250.23) ms | 242.56 ± (238.41 - 246.71) ms | -2.5% | ✅ |
| process.time_to_main_ms | 451.03 ± (450.61 - 451.44) ms | 483.84 ± (483.04 - 484.64) ms | +7.3% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 49.30 ± (49.27 - 49.33) MB | 49.25 ± (49.23 - 49.27) MB | -0.1% | ✅ |
| runtime.dotnet.threads.count | 28 ± (28 - 28) | 28 ± (28 - 28) | +0.1% | ✅⬆️ |
| .NET 8 - Baseline | ||||
| process.internal_duration_ms | 18.76 ± (18.74 - 18.79) ms | 19.75 ± (19.72 - 19.79) ms | +5.3% | ✅⬆️ |
| process.time_to_main_ms | 67.36 ± (67.26 - 67.47) ms | 74.95 ± (74.77 - 75.12) ms | +11.3% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 7.68 ± (7.67 - 7.69) MB | 7.69 ± (7.68 - 7.69) MB | +0.1% | ✅⬆️ |
| runtime.dotnet.threads.count | 10 ± (10 - 10) | 10 ± (10 - 10) | +0.0% | ✅ |
| .NET 8 - Bailout | ||||
| process.internal_duration_ms | 18.71 ± (18.68 - 18.73) ms | 19.98 ± (19.94 - 20.03) ms | +6.8% | ✅⬆️ |
| process.time_to_main_ms | 68.47 ± (68.40 - 68.54) ms | 77.37 ± (77.19 - 77.56) ms | +13.0% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 7.72 ± (7.71 - 7.73) MB | 7.75 ± (7.74 - 7.76) MB | +0.5% | ✅⬆️ |
| runtime.dotnet.threads.count | 11 ± (11 - 11) | 11 ± (11 - 11) | +0.0% | ✅ |
| .NET 8 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 178.50 ± (177.61 - 179.39) ms | 190.45 ± (189.66 - 191.24) ms | +6.7% | ✅⬆️ |
| process.time_to_main_ms | 434.45 ± (433.81 - 435.10) ms | 462.84 ± (462.12 - 463.57) ms | +6.5% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 0 ± (0 - 0) | 0 ± (0 - 0) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 36.64 ± (36.61 - 36.67) MB | 36.81 ± (36.77 - 36.85) MB | +0.5% | ✅⬆️ |
| runtime.dotnet.threads.count | 27 ± (26 - 27) | 27 ± (27 - 27) | +0.2% | ✅⬆️ |
HttpMessageHandler
| Metric | Master (Mean ± 95% CI) | Current (Mean ± 95% CI) | Change | Status |
|---|---|---|---|---|
| .NET Framework 4.8 - Baseline | ||||
| duration | 194.59 ± (194.42 - 195.18) ms | 193.89 ± (193.66 - 194.50) ms | -0.4% | ✅ |
| .NET Framework 4.8 - Bailout | ||||
| duration | 198.07 ± (198.11 - 198.75) ms | 196.81 ± (196.67 - 197.32) ms | -0.6% | ✅ |
| .NET Framework 4.8 - CallTarget+Inlining+NGEN | ||||
| duration | 1144.63 ± (1143.59 - 1151.59) ms | 1137.65 ± (1139.46 - 1147.10) ms | -0.6% | ✅ |
| .NET Core 3.1 - Baseline | ||||
| process.internal_duration_ms | 188.30 ± (187.94 - 188.67) ms | 187.96 ± (187.58 - 188.34) ms | -0.2% | ✅ |
| process.time_to_main_ms | 81.07 ± (80.87 - 81.26) ms | 81.36 ± (81.09 - 81.64) ms | +0.4% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 3 ± (3 - 3) | 3 ± (3 - 3) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 16.08 ± (16.06 - 16.10) MB | 16.17 ± (16.14 - 16.20) MB | +0.6% | ✅⬆️ |
| runtime.dotnet.threads.count | 20 ± (20 - 20) | 20 ± (19 - 20) | -0.3% | ✅ |
| .NET Core 3.1 - Bailout | ||||
| process.internal_duration_ms | 187.20 ± (186.84 - 187.56) ms | 187.41 ± (187.14 - 187.67) ms | +0.1% | ✅⬆️ |
| process.time_to_main_ms | 82.47 ± (82.30 - 82.64) ms | 82.60 ± (82.45 - 82.76) ms | +0.2% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 3 ± (3 - 3) | 3 ± (3 - 3) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 16.13 ± (16.10 - 16.15) MB | 16.15 ± (16.12 - 16.18) MB | +0.1% | ✅⬆️ |
| runtime.dotnet.threads.count | 21 ± (20 - 21) | 21 ± (21 - 21) | +0.3% | ✅⬆️ |
| .NET Core 3.1 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 431.62 ± (429.02 - 434.22) ms | 431.45 ± (428.22 - 434.68) ms | -0.0% | ✅ |
| process.time_to_main_ms | 479.81 ± (479.26 - 480.36) ms | 480.29 ± (479.63 - 480.94) ms | +0.1% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 3 ± (3 - 3) | 3 ± (3 - 3) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 59.00 ± (58.90 - 59.11) MB | 58.67 ± (58.54 - 58.80) MB | -0.6% | ✅ |
| runtime.dotnet.threads.count | 29 ± (29 - 29) | 29 ± (29 - 29) | +0.1% | ✅⬆️ |
| .NET 6 - Baseline | ||||
| process.internal_duration_ms | 191.63 ± (191.33 - 191.93) ms | 192.35 ± (192.01 - 192.68) ms | +0.4% | ✅⬆️ |
| process.time_to_main_ms | 70.51 ± (70.32 - 70.71) ms | 70.80 ± (70.62 - 70.97) ms | +0.4% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 16.39 ± (16.37 - 16.42) MB | 16.14 ± (16.02 - 16.26) MB | -1.6% | ✅ |
| runtime.dotnet.threads.count | 19 ± (19 - 19) | 18 ± (18 - 19) | -3.3% | ✅ |
| .NET 6 - Bailout | ||||
| process.internal_duration_ms | 190.78 ± (190.51 - 191.06) ms | 191.85 ± (191.54 - 192.16) ms | +0.6% | ✅⬆️ |
| process.time_to_main_ms | 71.11 ± (70.99 - 71.24) ms | 71.51 ± (71.36 - 71.65) ms | +0.6% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 16.10 ± (15.95 - 16.25) MB | 16.35 ± (16.26 - 16.45) MB | +1.6% | ✅⬆️ |
| runtime.dotnet.threads.count | 19 ± (19 - 19) | 20 ± (20 - 20) | +3.9% | ✅⬆️ |
| .NET 6 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 441.73 ± (438.29 - 445.16) ms | 441.20 ± (437.89 - 444.51) ms | -0.1% | ✅ |
| process.time_to_main_ms | 458.06 ± (457.46 - 458.65) ms | 459.02 ± (458.39 - 459.65) ms | +0.2% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 58.89 ± (58.77 - 59.01) MB | 59.16 ± (59.03 - 59.28) MB | +0.5% | ✅⬆️ |
| runtime.dotnet.threads.count | 29 ± (29 - 29) | 29 ± (29 - 29) | -0.2% | ✅ |
| .NET 8 - Baseline | ||||
| process.internal_duration_ms | 190.18 ± (189.84 - 190.51) ms | 190.13 ± (189.87 - 190.39) ms | -0.0% | ✅ |
| process.time_to_main_ms | 69.65 ± (69.49 - 69.81) ms | 69.74 ± (69.57 - 69.91) ms | +0.1% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 11.81 ± (11.79 - 11.84) MB | 11.78 ± (11.75 - 11.81) MB | -0.2% | ✅ |
| runtime.dotnet.threads.count | 18 ± (18 - 18) | 18 ± (18 - 18) | -0.2% | ✅ |
| .NET 8 - Bailout | ||||
| process.internal_duration_ms | 189.48 ± (189.21 - 189.74) ms | 190.86 ± (190.37 - 191.35) ms | +0.7% | ✅⬆️ |
| process.time_to_main_ms | 71.02 ± (70.90 - 71.15) ms | 71.24 ± (71.09 - 71.40) ms | +0.3% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 11.85 ± (11.82 - 11.88) MB | 11.80 ± (11.76 - 11.83) MB | -0.5% | ✅ |
| runtime.dotnet.threads.count | 19 ± (19 - 19) | 19 ± (19 - 19) | +0.0% | ✅⬆️ |
| .NET 8 - CallTarget+Inlining+NGEN | ||||
| process.internal_duration_ms | 366.11 ± (364.75 - 367.47) ms | 366.71 ± (365.22 - 368.21) ms | +0.2% | ✅⬆️ |
| process.time_to_main_ms | 441.01 ± (440.19 - 441.83) ms | 442.89 ± (441.88 - 443.90) ms | +0.4% | ✅⬆️ |
| runtime.dotnet.exceptions.count | 4 ± (4 - 4) | 4 ± (4 - 4) | +0.0% | ✅ |
| runtime.dotnet.mem.committed | 48.42 ± (48.39 - 48.45) MB | 48.37 ± (48.35 - 48.40) MB | -0.1% | ✅ |
| runtime.dotnet.threads.count | 29 ± (29 - 29) | 29 ± (28 - 29) | -0.3% | ✅ |
Comparison explanation
Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
- Welch test with statistical test for significance of 5%
- Only results indicating a difference greater than 5% and 5 ms are considered.
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.
Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).
Duration charts
FakeDbCommand (.NET Framework 4.8)
gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (75ms) : 71, 79
master - mean (68ms) : 67, 70
section Bailout
This PR (8112) - mean (79ms) : crit, 77, 82
master - mean (72ms) : 71, 73
section CallTarget+Inlining+NGEN
This PR (8112) - mean (1,074ms) : 1020, 1128
master - mean (1,022ms) : 978, 1066
FakeDbCommand (.NET Core 3.1)
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (118ms) : 114, 122
master - mean (106ms) : 103, 109
section Bailout
This PR (8112) - mean (120ms) : crit, 117, 123
master - mean (107ms) : 106, 108
section CallTarget+Inlining+NGEN
This PR (8112) - mean (792ms) : crit, 719, 864
master - mean (742ms) : 691, 793
FakeDbCommand (.NET 6)
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (105ms) : 101, 109
master - mean (93ms) : 91, 96
section Bailout
This PR (8112) - mean (106ms) : crit, 103, 109
master - mean (94ms) : 93, 95
section CallTarget+Inlining+NGEN
This PR (8112) - mean (764ms) : 695, 833
master - mean (723ms) : 694, 752
FakeDbCommand (.NET 8)
gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (103ms) : 99, 106
master - mean (92ms) : 90, 94
section Bailout
This PR (8112) - mean (106ms) : crit, 103, 108
master - mean (93ms) : 92, 94
section CallTarget+Inlining+NGEN
This PR (8112) - mean (695ms) : crit, 677, 713
master - mean (640ms) : 623, 657
HttpMessageHandler (.NET Framework 4.8)
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (194ms) : 190, 198
master - mean (195ms) : 191, 198
section Bailout
This PR (8112) - mean (197ms) : 194, 200
master - mean (198ms) : 195, 202
section CallTarget+Inlining+NGEN
This PR (8112) - mean (1,143ms) : 1088, 1198
master - mean (1,148ms) : 1090, 1205
HttpMessageHandler (.NET Core 3.1)
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (278ms) : 273, 283
master - mean (278ms) : 272, 284
section Bailout
This PR (8112) - mean (278ms) : 274, 282
master - mean (278ms) : 274, 282
section CallTarget+Inlining+NGEN
This PR (8112) - mean (941ms) : 890, 992
master - mean (940ms) : 904, 976
HttpMessageHandler (.NET 6)
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (271ms) : 266, 277
master - mean (270ms) : 266, 274
section Bailout
This PR (8112) - mean (271ms) : 267, 275
master - mean (270ms) : 266, 273
section CallTarget+Inlining+NGEN
This PR (8112) - mean (929ms) : 877, 982
master - mean (929ms) : 872, 986
HttpMessageHandler (.NET 8)
gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8112) - mean (269ms) : 266, 273
master - mean (270ms) : 265, 275
section Bailout
This PR (8112) - mean (272ms) : 265, 278
master - mean (270ms) : 266, 275
section CallTarget+Inlining+NGEN
This PR (8112) - mean (840ms) : 821, 859
master - mean (839ms) : 817, 861
This reverts commit 6692f4f.
BenchmarksBenchmark execution time: 2026-01-29 13:21:07 Comparing candidate commit 7da736a in PR branch Found 16 performance improvements and 11 performance regressions! Performance is the same for 154 metrics, 11 unstable metrics. scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0
scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeArgs net6.0
scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmark net6.0
scenario:Benchmarks.Trace.Asm.AppSecWafBenchmark.RunWafRealisticBenchmarkWithAttack netcoreapp3.1
scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net472
scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice netcoreapp3.1
scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net472
scenario:Benchmarks.Trace.CharSliceBenchmark.OriginalCharSlice net6.0
scenario:Benchmarks.Trace.GraphQLBenchmark.ExecuteAsync netcoreapp3.1
scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1
scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0
scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore netcoreapp3.1
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net472
|
dotnet/macrobefore merging.Summary of changes
Add
fetch-results.shstep to download benchmark artifacts from S3 after Windows macrobenchmarks complete.Reason for change
https://datadoghq.atlassian.net/browse/APMSP-2519
Implementation details
Depends on https://github.com/DataDog/benchmarking-platform/pull/223
Test coverage
https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-dotnet/-/jobs/1382839906/artifacts/browse/platform/artifacts/
https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-dotnet/-/jobs/1383829780/artifacts/browse/platform/artifacts/ (most recent pipeline's artifacts)
Other details