Skip to content

[FFE] Ruggerize integration tests Remote Config retrieval#8129

Merged
daniel-romano-DD merged 2 commits intomasterfrom
dani/ffe/test_flakiness
Feb 2, 2026
Merged

[FFE] Ruggerize integration tests Remote Config retrieval#8129
daniel-romano-DD merged 2 commits intomasterfrom
dani/ffe/test_flakiness

Conversation

@daniel-romano-DD
Copy link
Contributor

Summary of changes

Increase timeout and change logic order to try to minimize test flakiness

Reason for change

Flakiness is bad

Implementation details

Test coverage

Other details

Copy link
Collaborator

@NachoEchevarria NachoEchevarria left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

return;
}
Console.WriteLine($"Waiting for RC...");
System.Threading.Thread.Sleep(1000);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit, threads are precious in CI, we should prob use await Task.Delay(1_000) 😄

if (e.Value.PathAndQuery.EndsWith("api/v2/exposures"))
{
Interlocked.Increment(ref eventsReceived);
e.Value.Headers["Content-Encoding"].Should().Be(MimeTypes.Json);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did we change something here? Because it looks like this probably was failing before, but it wasn't causing the test to fail :sus: I'm assuming that exceptions here are just swallowed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep, the assert was failing but not halting the process, as it was happening in the RC handler. It was just showing an ugly message in the console output

Copy link

@sameerank sameerank left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing this test flakiness!

@daniel-romano-DD daniel-romano-DD enabled auto-merge (squash) February 2, 2026 16:27
@pr-commenter
Copy link

pr-commenter bot commented Feb 2, 2026

Benchmarks

Benchmark execution time: 2026-02-02 17:06:26

Comparing candidate commit ae61d1d in PR branch dani/ffe/test_flakiness with baseline commit c9cca03 in branch master.

Found 8 performance improvements and 11 performance regressions! Performance is the same for 158 metrics, 15 unstable metrics.

scenario:Benchmarks.Trace.AgentWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • 🟥 execution_time [+85.726ms; +85.890ms] or [+70.872%; +71.008%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleMoreComplexBody net6.0

  • 🟩 execution_time [-16.526ms; -11.752ms] or [-7.752%; -5.512%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody net6.0

  • 🟩 execution_time [-20.646ms; -17.908ms] or [-9.396%; -8.150%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.ObjectExtractorSimpleBody net6.0

  • 🟥 execution_time [+11.314ms; +15.714ms] or [+5.649%; +7.846%]

scenario:Benchmarks.Trace.Asm.AppSecEncoderBenchmark.EncodeLegacyArgs net6.0

  • 🟥 execution_time [+24.178ms; +24.776ms] or [+13.544%; +13.879%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • 🟥 execution_time [+19.108ms; +23.879ms] or [+9.730%; +12.160%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • 🟩 execution_time [-13.959ms; -9.723ms] or [-7.810%; -5.440%]
  • 🟩 throughput [+174.148op/s; +210.792op/s] or [+12.116%; +14.665%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces netcoreapp3.1

  • 🟥 execution_time [+8.556ms; +12.693ms] or [+6.494%; +9.634%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSlice net6.0

  • 🟩 execution_time [-152.546µs; -149.054µs] or [-9.729%; -9.506%]
  • 🟩 throughput [+67.076op/s; +68.650op/s] or [+10.517%; +10.764%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

  • 🟥 throughput [-45270.599op/s; -35475.223op/s] or [-9.996%; -7.833%]

scenario:Benchmarks.Trace.Iast.StringAspectsBenchmark.StringConcatAspectBenchmark net6.0

  • 🟥 throughput [-1178.155op/s; -1042.185op/s] or [-62.201%; -55.023%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

  • 🟩 execution_time [-37.387ms; -32.630ms] or [-18.559%; -16.198%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore net6.0

  • 🟥 execution_time [+106.697ms; +108.605ms] or [+117.455%; +119.556%]

scenario:Benchmarks.Trace.SingleSpanAspNetCoreBenchmark.SingleSpanAspNetCore netcoreapp3.1

  • 🟩 throughput [+14662078.537op/s; +16217538.883op/s] or [+6.499%; +7.189%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishSpan netcoreapp3.1

  • 🟥 execution_time [+12.385ms; +18.214ms] or [+6.319%; +9.294%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin net6.0

  • 🟥 execution_time [+11.722ms; +15.866ms] or [+5.895%; +7.980%]

scenario:Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin netcoreapp3.1

  • 🟥 execution_time [+10.855ms; +16.405ms] or [+5.576%; +8.426%]

@daniel-romano-DD daniel-romano-DD merged commit aab6df7 into master Feb 2, 2026
140 of 141 checks passed
@daniel-romano-DD daniel-romano-DD deleted the dani/ffe/test_flakiness branch February 2, 2026 17:41
@github-actions github-actions bot added this to the vNext-v3 milestone Feb 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:ffe area:tests unit tests, integration tests feature_flags

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants