Skip to content

Marked as flaky.#10525

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
alexeyk/mark-as-flaky-virtual-tread-submit-runnable
Feb 4, 2026
Merged

Marked as flaky.#10525
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
alexeyk/mark-as-flaky-virtual-tread-submit-runnable

Conversation

@AlexeyKuznetsov-DD

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD commented Feb 4, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

Mark test as flaky.

Motivation

Green CI.

Additional Notes

For quite a long time this test behaves flaky on CI with error like:

Condition not satisfied after 30.00 seconds and 31 attempts

Condition not satisfied after 30.00 seconds and 31 attempts
	at app//spock.util.concurrent.PollingConditions.within(PollingConditions.java:206)
	at app//spock.util.concurrent.PollingConditions.eventually(PollingConditions.java:158)
	at app//datadog.smoketest.AbstractSmokeTest.waitForTrace(AbstractSmokeTest.groovy:327)
	at app//datadog.smoketest.concurrent.AbstractConcurrentTest.receivedCorrectTrace(AbstractConcurrentTest.groovy:68)
	at datadog.smoketest.concurrent.VirtualThreadSubmitRunnableTest.test VirtualThread submit runnable(VirtualThreadTest.groovy:59)
Caused by: Condition not satisfied:

decodeTraces.find { predicate.apply(it) } != null
|            |                            |
[]           null                         false

	at datadog.smoketest.AbstractSmokeTest.waitForTrace_closure2(AbstractSmokeTest.groovy:331)
	at datadog.smoketest.AbstractSmokeTest.waitForTrace_closure2(AbstractSmokeTest.groovy)
	at app//spock.util.concurrent.PollingConditions.within(PollingConditions.java:186)
	... 4 more

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Feb 4, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests inst: java Core Java language instrumentation labels Feb 4, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review February 4, 2026 18:53
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from a team as a code owner February 4, 2026 18:53
@PerfectSlayer

PerfectSlayer commented Feb 4, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

That's not a good sign. That might be a deadlock but not sure if it comes from the CI setup or the instrumentation. Any opinion?
Anyway, thanks for flagging it!

@AlexeyKuznetsov-DD

AlexeyKuznetsov-DD commented Feb 4, 2026

Copy link
Copy Markdown
Contributor Author

That's not a good sign. That might be a deadlock but not sure if it comes from the CI setup or the instrumentation. Any opinion? Anyway, thanks for flagging it!

No strong opinion yet, but I agree it looks suspicious.

Since we have retries at the Gradle level, the test always ends up passing on CI. That could point to some flakiness — possibly something not fully initialized or only partially loaded on the first run, then succeeding on the retry.

I vaguely recall a similar issue that was fixed by @amarziali (see #9808), though I’m speculating here.

@AlexeyKuznetsov-DD

AlexeyKuznetsov-DD commented Feb 4, 2026

Copy link
Copy Markdown
Contributor Author

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351 Bot commented Feb 4, 2026 •
edited
Loading

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-02-04 19:11:49 UTC ℹ️ Start processing command /merge

2026-02-04 19:12:00 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-02-04 19:44:34 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-02-04 20:38:09 UTC ℹ️ MergeQueue: This merge request was merged

@pr-commenter

pr-commenter Bot commented Feb 4, 2026

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-as-flaky-virtual-tread-submit-runnable
git_commit_date 1770229287 1770230806
git_commit_sha a14f6ad d236334
release_version 1.60.0-SNAPSHOT~a14f6ada18 1.60.0-SNAPSHOT~d23633457b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770232860 1770232860
ci_job_id 1401740065 1401740065
ci_pipeline_id 94692379 94692379
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8ox4xng8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8ox4xng8 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065079
Total [baseline] (8.758 s) : 0, 8757927
Agent [candidate] (1.061 s) : 0, 1061470
Total [candidate] (8.744 s) : 0, 8743809
section iast
Agent [baseline] (1.234 s) : 0, 1233529
Total [baseline] (9.449 s) : 0, 9449161
Agent [candidate] (1.231 s) : 0, 1231059
Total [candidate] (9.376 s) : 0, 9375571
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent iast 1.234 s 168.449 ms (15.8%)
Total tracing 8.758 s -
Total iast 9.449 s 691.234 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.231 s 169.589 ms (16.0%)
Total tracing 8.744 s -
Total iast 9.376 s 631.761 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (628.642 ms) : 0, 628642
BytebuddyAgent [candidate] (627.811 ms) : 0, 627811
AgentMeter [baseline] (28.678 ms) : 0, 28678
AgentMeter [candidate] (28.63 ms) : 0, 28630
GlobalTracer [baseline] (257.654 ms) : 0, 257654
GlobalTracer [candidate] (257.619 ms) : 0, 257619
AppSec [baseline] (32.916 ms) : 0, 32916
AppSec [candidate] (32.781 ms) : 0, 32781
Debugger [baseline] (62.038 ms) : 0, 62038
Debugger [candidate] (60.618 ms) : 0, 60618
Remote Config [baseline] (611.108 µs) : 0, 611
Remote Config [candidate] (617.432 µs) : 0, 617
Telemetry [baseline] (14.098 ms) : 0, 14098
Telemetry [candidate] (10.761 ms) : 0, 10761
Flare Poller [baseline] (3.831 ms) : 0, 3831
Flare Poller [candidate] (6.048 ms) : 0, 6048
section iast
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (797.288 ms) : 0, 797288
BytebuddyAgent [candidate] (795.471 ms) : 0, 795471
AgentMeter [baseline] (11.256 ms) : 0, 11256
AgentMeter [candidate] (11.178 ms) : 0, 11178
GlobalTracer [baseline] (248.87 ms) : 0, 248870
GlobalTracer [candidate] (247.88 ms) : 0, 247880
IAST [baseline] (27.152 ms) : 0, 27152
IAST [candidate] (27.028 ms) : 0, 27028
AppSec [baseline] (33.34 ms) : 0, 33340
AppSec [candidate] (33.9 ms) : 0, 33900
Debugger [baseline] (66.207 ms) : 0, 66207
Debugger [candidate] (66.227 ms) : 0, 66227
Remote Config [baseline] (552.969 µs) : 0, 553
Remote Config [candidate] (550.488 µs) : 0, 550
Telemetry [baseline] (8.703 ms) : 0, 8703
Telemetry [candidate] (8.689 ms) : 0, 8689
Flare Poller [baseline] (3.532 ms) : 0, 3532
Flare Poller [candidate] (3.508 ms) : 0, 3508
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070770
Total [baseline] (10.928 s) : 0, 10928430
Agent [candidate] (1.074 s) : 0, 1073517
Total [candidate] (10.853 s) : 0, 10853173
section appsec
Agent [baseline] (1.248 s) : 0, 1247594
Total [baseline] (11.183 s) : 0, 11182863
Agent [candidate] (1.241 s) : 0, 1241158
Total [candidate] (11.093 s) : 0, 11093328
section iast
Agent [baseline] (1.234 s) : 0, 1234464
Total [baseline] (11.152 s) : 0, 11151828
Agent [candidate] (1.237 s) : 0, 1236697
Total [candidate] (11.223 s) : 0, 11222912
section profiling
Agent [baseline] (1.192 s) : 0, 1191986
Total [baseline] (11.003 s) : 0, 11002699
Agent [candidate] (1.196 s) : 0, 1195570
Total [candidate] (10.969 s) : 0, 10968704
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.248 s 176.824 ms (16.5%)
Agent iast 1.234 s 163.694 ms (15.3%)
Agent profiling 1.192 s 121.217 ms (11.3%)
Total tracing 10.928 s -
Total appsec 11.183 s 254.433 ms (2.3%)
Total iast 11.152 s 223.398 ms (2.0%)
Total profiling 11.003 s 74.27 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.074 s -
Agent appsec 1.241 s 167.641 ms (15.6%)
Agent iast 1.237 s 163.18 ms (15.2%)
Agent profiling 1.196 s 122.053 ms (11.4%)
Total tracing 10.853 s -
Total appsec 11.093 s 240.155 ms (2.2%)
Total iast 11.223 s 369.739 ms (3.4%)
Total profiling 10.969 s 115.531 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (632.164 ms) : 0, 632164
BytebuddyAgent [candidate] (633.989 ms) : 0, 633989
AgentMeter [baseline] (28.976 ms) : 0, 28976
AgentMeter [candidate] (28.995 ms) : 0, 28995
GlobalTracer [baseline] (259.104 ms) : 0, 259104
GlobalTracer [candidate] (260.145 ms) : 0, 260145
AppSec [baseline] (32.912 ms) : 0, 32912
AppSec [candidate] (33.309 ms) : 0, 33309
Debugger [baseline] (61.593 ms) : 0, 61593
Debugger [candidate] (62.625 ms) : 0, 62625
Remote Config [baseline] (845.846 µs) : 0, 846
Remote Config [candidate] (621.198 µs) : 0, 621
Telemetry [baseline] (12.35 ms) : 0, 12350
Telemetry [candidate] (11.666 ms) : 0, 11666
Flare Poller [baseline] (6.134 ms) : 0, 6134
Flare Poller [candidate] (5.368 ms) : 0, 5368
section appsec
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (662.524 ms) : 0, 662524
BytebuddyAgent [candidate] (659.269 ms) : 0, 659269
AgentMeter [baseline] (11.832 ms) : 0, 11832
AgentMeter [candidate] (11.787 ms) : 0, 11787
GlobalTracer [baseline] (260.128 ms) : 0, 260128
GlobalTracer [candidate] (258.946 ms) : 0, 258946
IAST [baseline] (25.494 ms) : 0, 25494
IAST [candidate] (25.337 ms) : 0, 25337
AppSec [baseline] (168.546 ms) : 0, 168546
AppSec [candidate] (168.042 ms) : 0, 168042
Debugger [baseline] (68.463 ms) : 0, 68463
Debugger [candidate] (67.566 ms) : 0, 67566
Remote Config [baseline] (693.255 µs) : 0, 693
Remote Config [candidate] (673.804 µs) : 0, 674
Telemetry [baseline] (9.337 ms) : 0, 9337
Telemetry [candidate] (9.209 ms) : 0, 9209
Flare Poller [baseline] (3.826 ms) : 0, 3826
Flare Poller [candidate] (3.685 ms) : 0, 3685
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (797.288 ms) : 0, 797288
BytebuddyAgent [candidate] (799.526 ms) : 0, 799526
AgentMeter [baseline] (11.161 ms) : 0, 11161
AgentMeter [candidate] (11.232 ms) : 0, 11232
GlobalTracer [baseline] (248.397 ms) : 0, 248397
GlobalTracer [candidate] (248.978 ms) : 0, 248978
IAST [baseline] (27.12 ms) : 0, 27120
IAST [candidate] (27.214 ms) : 0, 27214
AppSec [baseline] (32.276 ms) : 0, 32276
AppSec [candidate] (34.791 ms) : 0, 34791
Debugger [baseline] (68.939 ms) : 0, 68939
Debugger [candidate] (65.535 ms) : 0, 65535
Remote Config [baseline] (556.334 µs) : 0, 556
Remote Config [candidate] (546.131 µs) : 0, 546
Telemetry [baseline] (8.718 ms) : 0, 8718
Telemetry [candidate] (8.737 ms) : 0, 8737
Flare Poller [baseline] (3.448 ms) : 0, 3448
Flare Poller [candidate] (3.429 ms) : 0, 3429
section profiling
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (682.444 ms) : 0, 682444
BytebuddyAgent [candidate] (685.089 ms) : 0, 685089
AgentMeter [baseline] (8.631 ms) : 0, 8631
AgentMeter [candidate] (8.613 ms) : 0, 8613
GlobalTracer [baseline] (216.306 ms) : 0, 216306
GlobalTracer [candidate] (216.365 ms) : 0, 216365
AppSec [baseline] (32.549 ms) : 0, 32549
AppSec [candidate] (32.511 ms) : 0, 32511
Debugger [baseline] (67.775 ms) : 0, 67775
Debugger [candidate] (67.859 ms) : 0, 67859
Remote Config [baseline] (593.178 µs) : 0, 593
Remote Config [candidate] (602.392 µs) : 0, 602
Telemetry [baseline] (8.844 ms) : 0, 8844
Telemetry [candidate] (8.861 ms) : 0, 8861
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.787 ms) : 0, 3787
ProfilingAgent [baseline] (99.964 ms) : 0, 99964
ProfilingAgent [candidate] (100.388 ms) : 0, 100388
Profiling [baseline] (100.542 ms) : 0, 100542
Profiling [candidate] (100.968 ms) : 0, 100968
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-as-flaky-virtual-tread-submit-runnable
git_commit_date 1770229287 1770230806
git_commit_sha a14f6ad d236334
release_version 1.60.0-SNAPSHOT~a14f6ada18 1.60.0-SNAPSHOT~d23633457b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1770233344 1770233344
ci_job_id 1401740066 1401740066
ci_pipeline_id 94692379 94692379
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-5k3dd7us 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-5k3dd7us 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+179.444µs; +283.026µs] or [+6.782%; +10.697%]		 worse
[+158.500µs; +603.576µs] or [+2.054%; +7.821%]		 unstable
[-250.882op/s; +41.444op/s] or [-18.486%; +3.054%]		 2.877ms 8.098ms 1252.406op/s 2.646ms 7.717ms 1357.125op/s
scenario:load:insecure-bank:profiling:high_load better
[-158.620µs; -46.116µs] or [-9.129%; -2.654%]		 unstable
[-1142.342µs; -447.956µs] or [-20.843%; -8.173%]		 unstable
[-3.729op/s; +494.229op/s] or [-0.186%; +24.645%]		 1.635ms 4.686ms 2250.656op/s 1.738ms 5.481ms 2005.406op/s
scenario:load:petclinic:no_agent:high_load better
[-1.900ms; -0.608ms] or [-10.206%; -3.267%]		 unsure
[-3.658ms; -0.576ms] or [-11.770%; -1.854%]		 unstable
[-7.185op/s; +45.435op/s] or [-2.954%; +18.678%]		 17.362ms 28.962ms 262.375op/s 18.616ms 31.079ms 243.250op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.209 ms) : 1198, 1221
.   : milestone, 1209,
iast (3.258 ms) : 3215, 3301
.   : milestone, 3258,
iast_FULL (6.161 ms) : 6098, 6224
.   : milestone, 6161,
iast_GLOBAL (3.374 ms) : 3329, 3418
.   : milestone, 3374,
profiling (2.26 ms) : 2239, 2281
.   : milestone, 2260,
tracing (1.826 ms) : 1810, 1842
.   : milestone, 1826,
section candidate
no_agent (1.2 ms) : 1188, 1212
.   : milestone, 1200,
iast (3.259 ms) : 3213, 3306
.   : milestone, 3259,
iast_FULL (6.021 ms) : 5960, 6082
.   : milestone, 6021,
iast_GLOBAL (3.664 ms) : 3604, 3724
.   : milestone, 3664,
profiling (2.005 ms) : 1988, 2022
.   : milestone, 2005,
tracing (1.811 ms) : 1796, 1826
.   : milestone, 1811,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.209 ms [1.198 ms, 1.221 ms] -
iast 3.258 ms [3.215 ms, 3.301 ms] 2.049 ms (169.4%)
iast_FULL 6.161 ms [6.098 ms, 6.224 ms] 4.951 ms (409.4%)
iast_GLOBAL 3.374 ms [3.329 ms, 3.418 ms] 2.164 ms (178.9%)
profiling 2.26 ms [2.239 ms, 2.281 ms] 1.05 ms (86.8%)
tracing 1.826 ms [1.81 ms, 1.842 ms] 616.039 µs (50.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.2 ms [1.188 ms, 1.212 ms] -
iast 3.259 ms [3.213 ms, 3.306 ms] 2.059 ms (171.6%)
iast_FULL 6.021 ms [5.96 ms, 6.082 ms] 4.82 ms (401.6%)
iast_GLOBAL 3.664 ms [3.604 ms, 3.724 ms] 2.464 ms (205.3%)
profiling 2.005 ms [1.988 ms, 2.022 ms] 804.639 µs (67.0%)
tracing 1.811 ms [1.796 ms, 1.826 ms] 611.111 µs (50.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.192 ms) : 18991, 19392
.   : milestone, 19192,
appsec (18.35 ms) : 18164, 18536
.   : milestone, 18350,
code_origins (17.757 ms) : 17583, 17932
.   : milestone, 17757,
iast (17.594 ms) : 17419, 17768
.   : milestone, 17594,
profiling (18.598 ms) : 18413, 18783
.   : milestone, 18598,
tracing (17.75 ms) : 17575, 17925
.   : milestone, 17750,
section candidate
no_agent (17.782 ms) : 17602, 17961
.   : milestone, 17782,
appsec (18.508 ms) : 18321, 18696
.   : milestone, 18508,
code_origins (17.958 ms) : 17778, 18138
.   : milestone, 17958,
iast (17.467 ms) : 17294, 17641
.   : milestone, 17467,
profiling (18.356 ms) : 18173, 18540
.   : milestone, 18356,
tracing (17.679 ms) : 17504, 17854
.   : milestone, 17679,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.192 ms [18.991 ms, 19.392 ms] -
appsec 18.35 ms [18.164 ms, 18.536 ms] -841.85 µs (-4.4%)
code_origins 17.757 ms [17.583 ms, 17.932 ms] -1.434 ms (-7.5%)
iast 17.594 ms [17.419 ms, 17.768 ms] -1.598 ms (-8.3%)
profiling 18.598 ms [18.413 ms, 18.783 ms] -593.34 µs (-3.1%)
tracing 17.75 ms [17.575 ms, 17.925 ms] -1.442 ms (-7.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.782 ms [17.602 ms, 17.961 ms] -
appsec 18.508 ms [18.321 ms, 18.696 ms] 726.641 µs (4.1%)
code_origins 17.958 ms [17.778 ms, 18.138 ms] 176.527 µs (1.0%)
iast 17.467 ms [17.294 ms, 17.641 ms] -314.195 µs (-1.8%)
profiling 18.356 ms [18.173 ms, 18.54 ms] 574.795 µs (3.2%)
tracing 17.679 ms [17.504 ms, 17.854 ms] -102.733 µs (-0.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/mark-as-flaky-virtual-tread-submit-runnable
git_commit_date 1770229287 1770230806
git_commit_sha a14f6ad d236334
release_version 1.60.0-SNAPSHOT~a14f6ada18 1.60.0-SNAPSHOT~d23633457b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1770233061 1770233061
ci_job_id 1401740067 1401740067
ci_pipeline_id 94692379 94692379
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ihvcn7qm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ihvcn7qm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.988 s) : 14988000, 14988000
.   : milestone, 14988000,
appsec (14.522 s) : 14522000, 14522000
.   : milestone, 14522000,
iast (18.367 s) : 18367000, 18367000
.   : milestone, 18367000,
iast_GLOBAL (17.9 s) : 17900000, 17900000
.   : milestone, 17900000,
profiling (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
tracing (15.003 s) : 15003000, 15003000
.   : milestone, 15003000,
section candidate
no_agent (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
appsec (14.473 s) : 14473000, 14473000
.   : milestone, 14473000,
iast (18.06 s) : 18060000, 18060000
.   : milestone, 18060000,
iast_GLOBAL (18.038 s) : 18038000, 18038000
.   : milestone, 18038000,
profiling (14.812 s) : 14812000, 14812000
.   : milestone, 14812000,
tracing (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.988 s [14.988 s, 14.988 s] -
appsec 14.522 s [14.522 s, 14.522 s] -466.0 ms (-3.1%)
iast 18.367 s [18.367 s, 18.367 s] 3.379 s (22.5%)
iast_GLOBAL 17.9 s [17.9 s, 17.9 s] 2.912 s (19.4%)
profiling 14.867 s [14.867 s, 14.867 s] -121.0 ms (-0.8%)
tracing 15.003 s [15.003 s, 15.003 s] 15.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.101 s [15.101 s, 15.101 s] -
appsec 14.473 s [14.473 s, 14.473 s] -628.0 ms (-4.2%)
iast 18.06 s [18.06 s, 18.06 s] 2.959 s (19.6%)
iast_GLOBAL 18.038 s [18.038 s, 18.038 s] 2.937 s (19.4%)
profiling 14.812 s [14.812 s, 14.812 s] -289.0 ms (-1.9%)
tracing 14.853 s [14.853 s, 14.853 s] -248.0 ms (-1.6%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~d23633457b, baseline=1.60.0-SNAPSHOT~a14f6ada18
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.765 ms) : 3544, 3987
.   : milestone, 3765,
iast (2.259 ms) : 2190, 2329
.   : milestone, 2259,
iast_GLOBAL (2.302 ms) : 2232, 2373
.   : milestone, 2302,
profiling (2.098 ms) : 2041, 2154
.   : milestone, 2098,
tracing (2.057 ms) : 2004, 2111
.   : milestone, 2057,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (3.761 ms) : 3537, 3984
.   : milestone, 3761,
iast (2.25 ms) : 2181, 2319
.   : milestone, 2250,
iast_GLOBAL (2.295 ms) : 2225, 2364
.   : milestone, 2295,
profiling (2.077 ms) : 2023, 2132
.   : milestone, 2077,
tracing (2.049 ms) : 1996, 2102
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.765 ms [3.544 ms, 3.987 ms] 2.293 ms (155.7%)
iast 2.259 ms [2.19 ms, 2.329 ms] 786.595 µs (53.4%)
iast_GLOBAL 2.302 ms [2.232 ms, 2.373 ms] 829.633 µs (56.3%)
profiling 2.098 ms [2.041 ms, 2.154 ms] 624.988 µs (42.4%)
tracing 2.057 ms [2.004 ms, 2.111 ms] 584.728 µs (39.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 3.761 ms [3.537 ms, 3.984 ms] 2.288 ms (155.4%)
iast 2.25 ms [2.181 ms, 2.319 ms] 777.704 µs (52.8%)
iast_GLOBAL 2.295 ms [2.225 ms, 2.364 ms] 821.972 µs (55.8%)
profiling 2.077 ms [2.023 ms, 2.132 ms] 604.929 µs (41.1%)
tracing 2.049 ms [1.996 ms, 2.102 ms] 576.409 µs (39.1%)

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot merged commit 9c3d035 into master Feb 4, 2026
559 of 561 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d Bot deleted the alexeyk/mark-as-flaky-virtual-tread-submit-runnable branch February 4, 2026 20:38
@github-actions github-actions Bot added this to the 1.60.0 milestone Feb 4, 2026
@PerfectSlayer

PerfectSlayer commented Feb 5, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

I vaguely recall a similar issue that was fixed by @amarziali (see #9808), though I’m speculating here.

I would have expected smoke test to be more robust to this kind of issue as they are spawning a new VM for every new tests. I need to keep an eye on it then, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels

inst: java Core Java language instrumentation tag: flaky test Flaky tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.60.0

Development

Successfully merging this pull request may close these issues.

2 participants

@AlexeyKuznetsov-DD @PerfectSlayer