Skip to content

Conversation

@Bouncheck
Copy link

Removes DropwizardMetricsIT, MicroProfileMetricsIT, MicrometerMetricsIT from parallelizable tests category, making them serial. Additionally enables MicrometerMetricsIT which was previously ignored due to flakiness.

should_evict_down_node_metrics_when_timeout_fires in MetricsITBase relies on setting static field MIN_EXPIRE_AFTER in AbstractMetricUpdater and then setting it back to 5 minutes.
Those three test classes inherit this test method and when they run concurrently it sometimes results in setting the minimal expire time back to 5 minutes before another test initializes its session with expire time set to 1 second. This can be evidenced by the appearance of lines like

 c.d.o.d.i.c.m.AbstractMetricUpdater - [s6] Value too low for advanced.metrics.node.expire-after: PT1S. Forcing to PT5M instead.

whenever that method fails. It does not appear when the test passes (due to lucky schedule).
Making those tests serial seems to be the simplest solution.

Removes DropwizardMetricsIT, MicroProfileMetricsIT, MicrometerMetricsIT
from parallelizable tests category, making them serial.
Additionally enables MicrometerMetricsIT which was previously ignored
due to flakiness.

`should_evict_down_node_metrics_when_timeout_fires` in MetricsITBase
relies on setting static field `MIN_EXPIRE_AFTER` in AbstractMetricUpdater
and then setting it back to 5 minutes.
Those three test classes inherit this test method and when they run
concurrently it sometimes results in setting the minimal expire time back
to 5 minutes before another test initializes its session with expire time
set to 1 second. This can be evidenced by the appearance of lines like
```
 c.d.o.d.i.c.m.AbstractMetricUpdater - [s6] Value too low for advanced.metrics.node.expire-after: PT1S. Forcing to PT5M instead.
```
whenever that method fails. It does not appear when the test passes (due to
lucky schedule).
Making those tests serial seems to be the simplest solution.
@Bouncheck Bouncheck self-assigned this Jul 8, 2025
@Bouncheck Bouncheck changed the title Stabilize metrics integration tests 4.x: Stabilize metrics integration tests Jul 8, 2025
@Bouncheck Bouncheck requested a review from dkropachev July 8, 2025 11:55
@dkropachev dkropachev merged commit 0f278dc into scylladb:scylla-4.x Jul 8, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants