Skip to content

Update local smoke testing docs#8311

Merged
andrewlock merged 4 commits into
masterfrom
andrew/update-smoke-test-docs
Mar 19, 2026
Merged

Update local smoke testing docs#8311
andrewlock merged 4 commits into
masterfrom
andrew/update-smoke-test-docs

Conversation

@andrewlock

Copy link
Copy Markdown
Member

Summary of changes

Updates the local smoke-testing docs to explain required steps

Reason for change

In #8271 we updated the smoke tests to be orchestrated by Nuke, which makes running the tests locally much easier, and makes these docs out of date

Implementation details

Wrote the doc. It currently only shows the Windows instructions, as that's all I can test...

Test coverage

I ran it, and tested that it worked

Other details

Would be great if someone could try these on macos and update them 😄 This may not work quite as expected, seeing as that's not a scenario we run in CI, and I can't test it 😅

@andrewlock andrewlock requested a review from a team as a code owner March 16, 2026 12:17
@pr-commenter

pr-commenter Bot commented Mar 16, 2026

Copy link
Copy Markdown

Benchmarks

Benchmark execution time: 2026-03-19 08:57:40

Comparing candidate commit fdda3ce in PR branch andrew/update-smoke-test-docs with baseline commit 31d5db8 in branch master.

Found 14 performance improvements and 2 performance regressions! Performance is the same for 157 metrics, 19 unstable metrics.

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1

  • 🟩 execution_time [-22.191ms; -15.745ms] or [-10.273%; -7.289%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0

  • 🟩 execution_time [-25.590ms; -24.809ms] or [-12.527%; -12.145%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0

  • 🟥 execution_time [+10.447ms; +16.269ms] or [+13.116%; +20.425%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • 🟩 execution_time [-40.803ms; -37.531ms] or [-19.008%; -17.484%]
  • 🟩 throughput [+132.604op/s; +150.838op/s] or [+12.706%; +14.453%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • 🟩 execution_time [-53.943ms; -50.385ms] or [-26.285%; -24.551%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net472

  • 🟩 execution_time [-121.115µs; -116.191µs] or [-5.945%; -5.703%]
  • 🟩 throughput [+29.737op/s; +30.969op/s] or [+6.058%; +6.309%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice netcoreapp3.1

  • 🟩 execution_time [-944.667µs; -683.556µs] or [-33.863%; -24.503%]

scenario:Benchmarks.Trace.DbCommandBenchmark.ExecuteNonQuery netcoreapp3.1

  • 🟩 throughput [+22186.682op/s; +31459.395op/s] or [+6.020%; +8.535%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

  • 🟩 throughput [+23909.847op/s; +31756.391op/s] or [+5.261%; +6.987%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

  • 🟩 execution_time [-35.110ms; -32.642ms] or [-17.412%; -16.188%]

scenario:Benchmarks.Trace.RedisBenchmark.SendReceive netcoreapp3.1

  • 🟩 throughput [+21393.244op/s; +29167.661op/s] or [+5.545%; +7.560%]

scenario:Benchmarks.Trace.SerilogBenchmark.EnrichedLog netcoreapp3.1

  • 🟩 execution_time [-35.961ms; -34.217ms] or [-17.846%; -16.981%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan net6.0

  • 🟩 execution_time [-24.904ms; -20.759ms] or [-11.318%; -9.434%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishTwoScopes net472

  • 🟥 throughput [-27049.393op/s; -24045.370op/s] or [-5.790%; -5.147%]

Comment thread docs/development/CI/RunSmokeTestsLocally.md Outdated
Comment thread docs/development/CI/RunSmokeTestsLocally.md Outdated
Co-authored-by: Andrew Lock <andrewlock.net@gmail.com>
Comment thread docs/development/CI/RunSmokeTestsLocally.md Outdated
@andrewlock andrewlock enabled auto-merge (squash) March 19, 2026 08:13
@andrewlock andrewlock merged commit ed8f743 into master Mar 19, 2026
97 of 100 checks passed
@andrewlock andrewlock deleted the andrew/update-smoke-test-docs branch March 19, 2026 08:59
@github-actions github-actions Bot added this to the vNext-v3 milestone Mar 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants