Conversation
|
If this is using gradual release, do we need to update our release documentation? 🤔 |
BenchmarksBenchmark execution time: 2026-01-13 15:43:57 Comparing candidate commit 03b0425 in PR branch Found 7 performance improvements and 6 performance regressions! Performance is the same for 164 metrics, 9 unstable metrics. scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0
scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1
scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472
scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1
scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0
scenario:Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope net6.0
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1
scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net6.0
|
Execution-Time Benchmarks Report ⏱️Execution-time results for samples comparing This PR (8053) and master. ✅ No regressions detected - check the details below Full Metrics ComparisonFakeDbCommand
HttpMessageHandler
Comparison explanationExecution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard. Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph). Duration chartsFakeDbCommand (.NET Framework 4.8)gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (78ms) : 75, 82
master - mean (74ms) : 72, 77
section Bailout
This PR (8053) - mean (83ms) : 81, 85
master - mean (78ms) : 76, 80
section CallTarget+Inlining+NGEN
This PR (8053) - mean (1,093ms) : 1044, 1142
master - mean (1,048ms) : 996, 1100
FakeDbCommand (.NET Core 3.1)gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (122ms) : 117, 127
master - mean (115ms) : 111, 118
section Bailout
This PR (8053) - mean (123ms) : crit, 119, 128
master - mean (116ms) : 113, 119
section CallTarget+Inlining+NGEN
This PR (8053) - mean (805ms) : 742, 867
master - mean (773ms) : 715, 832
FakeDbCommand (.NET 6)gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (107ms) : 103, 110
master - mean (101ms) : 98, 104
section Bailout
This PR (8053) - mean (108ms) : 106, 109
master - mean (102ms) : 100, 105
section CallTarget+Inlining+NGEN
This PR (8053) - mean (766ms) : 691, 840
master - mean (737ms) : 670, 805
FakeDbCommand (.NET 8)gantt
title Execution time (ms) FakeDbCommand (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (108ms) : 104, 111
master - mean (100ms) : 97, 102
section Bailout
This PR (8053) - mean (106ms) : 104, 109
master - mean (101ms) : 99, 103
section CallTarget+Inlining+NGEN
This PR (8053) - mean (702ms) : 673, 732
master - mean (668ms) : 647, 689
HttpMessageHandler (.NET Framework 4.8)gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (195ms) : 190, 200
master - mean (193ms) : 188, 198
section Bailout
This PR (8053) - mean (201ms) : 198, 204
master - mean (197ms) : 193, 201
section CallTarget+Inlining+NGEN
This PR (8053) - mean (1,135ms) : 1070, 1201
master - mean (1,122ms) : 1054, 1191
HttpMessageHandler (.NET Core 3.1)gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (279ms) : 273, 285
master - mean (276ms) : 269, 282
section Bailout
This PR (8053) - mean (282ms) : 276, 287
master - mean (276ms) : 272, 280
section CallTarget+Inlining+NGEN
This PR (8053) - mean (940ms) : 898, 981
master - mean (931ms) : 890, 972
HttpMessageHandler (.NET 6)gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (276ms) : 265, 288
master - mean (270ms) : 264, 276
section Bailout
This PR (8053) - mean (273ms) : 265, 280
master - mean (269ms) : 266, 272
section CallTarget+Inlining+NGEN
This PR (8053) - mean (930ms) : 887, 974
master - mean (929ms) : 884, 973
HttpMessageHandler (.NET 8)gantt
title Execution time (ms) HttpMessageHandler (.NET 8)
dateFormat x
axisFormat %Q
todayMarker off
section Baseline
This PR (8053) - mean (275ms) : 266, 284
master - mean (270ms) : 264, 276
section Bailout
This PR (8053) - mean (275ms) : 266, 284
master - mean (269ms) : 265, 273
section CallTarget+Inlining+NGEN
This PR (8053) - mean (841ms) : 817, 864
master - mean (827ms) : 808, 845
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
This pull request updates one-pipeline to a newer version.
Recent changes:
The pull request switches the library release to adopt the gradual rollout model for k8s SSI artifacts. With this change, the release of k8s SSI artifacts will only be publishing the canonical tags (with complete semantic versioning), but NOT those mutable tags (ie. "latest"). After gradual rollout to our customers, those mutable tags will be updated by another separated pipeline.
Some of these changes may have already applied depending on your previous version of one-pipeline. See the libdatadog-build repository for all changes