Skip to content

[Backport 2.x] Fixing flakiness of ShuffleForcedMergePolicyTests#3592

Merged
dblock merged 1 commit into2.xfrom
backport/backport-3591-to-2.x
Jun 15, 2022
Merged

[Backport 2.x] Fixing flakiness of ShuffleForcedMergePolicyTests#3592
dblock merged 1 commit into2.xfrom
backport/backport-3591-to-2.x

Conversation

@opensearch-trigger-bot
Copy link
Copy Markdown
Contributor

@opensearch-trigger-bot opensearch-trigger-bot bot commented Jun 15, 2022

Backport 055a9fc from #3591

@reta @github-actions
Fixing flakiness of ShuffleForcedMergePolicyTests (#3591)
51cdfb7 
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
(cherry picked from commit 055a9fc)
@opensearch-trigger-bot opensearch-trigger-bot bot requested review from a team and reta as code owners June 15, 2022 16:22
@tlfeng tlfeng added :test Adding or fixing a test v2.1.0 Issues and PRs related to version 2.1.0 labels Jun 15, 2022
@tlfeng tlfeng added the backport PRs or issues specific to backporting features or enhancments label Jun 15, 2022
@opensearch-ci-bot
Copy link
Copy Markdown
Collaborator

opensearch-ci-bot commented Jun 15, 2022

❌   Gradle Check failure 51cdfb7
Log 6029

Reports 6029

@reta
Copy link
Copy Markdown
Contributor

reta commented Jun 15, 2022

start gradle check

@opensearch-ci-bot
Copy link
Copy Markdown
Collaborator

opensearch-ci-bot commented Jun 15, 2022

❌   Gradle Check failure 51cdfb7
Log 6034

Reports 6034

@tlfeng
Copy link
Copy Markdown
Contributor

tlfeng commented Jun 15, 2022 •
edited
Loading

In log 6034:
2 test failures, one is reported in issue #3579, and the other is the same test with #2538 but different error message.

> Task :server:internalClusterTest

REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.testHighWatermarkNotExceeded" -Dtests.seed=749F1E98272C04CB -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=es-CR -Dtests.timezone=Africa/Timbuktu -Druntime.java=17

org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT > testHighWatermarkNotExceeded FAILED
    java.lang.AssertionError: Mismatching shard routings: []
    Expected: a collection with size <1>
         but: collection size was <0>
        at __randomizedtesting.SeedInfo.seed([749F1E98272C04CB:9DBEFF2AA7EACD25]:0)
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
        at org.junit.Assert.assertThat(Assert.java:964)
        at org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.lambda$assertBusyWithDiskUsageRefresh$5(DiskThresholdDeciderIT.java:362)
        at org.opensearch.test.OpenSearchTestCase.assertBusy(OpenSearchTestCase.java:1049)
        at org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.assertBusyWithDiskUsageRefresh(DiskThresholdDeciderIT.java:355)
        at org.opensearch.cluster.routing.allocation.decider.DiskThresholdDeciderIT.testHighWatermarkNotExceeded(DiskThresholdDeciderIT.java:188)

REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.discovery.SnapshotDisruptionIT.testDisruptionAfterFinalization" -Dtests.seed=749F1E98272C04CB -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=vi -Dtests.timezone=Antarctica/Casey -Druntime.java=17

org.opensearch.discovery.SnapshotDisruptionIT > testDisruptionAfterFinalization FAILED
    java.lang.AssertionError: 
    Expected: an empty iterable
         but: [<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[FailedToCommitClusterStateException[publication failed]; nested: OpenSearchException[publication cancelled before committing: timed out after 5s];]; nested: FailedToCommitClusterStateException[publication failed]; nested: OpenSearchException[publication cancelled before committing: timed out after 5s];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>,<RemoteTransportException[[node_t0][127.0.0.1:39205][indices:admin/mapping/auto_put]]; nested: MasterNotDiscoveredException[NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]]]; nested: NotMasterException[no longer cluster-manager. source: [put-mapping [test/LvnH10cZSFCKmAt5-SdRMA]]];>]
        at __randomizedtesting.SeedInfo.seed([749F1E98272C04CB:180B89EE9E64634F]:0)
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
        at org.junit.Assert.assertThat(Assert.java:964)
        at org.junit.Assert.assertThat(Assert.java:930)
        at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1616)
        at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1530)
        at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1514)
        at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1491)
        at org.opensearch.discovery.SnapshotDisruptionIT.createRandomIndex(SnapshotDisruptionIT.java:299)
        at org.opensearch.discovery.SnapshotDisruptionIT.testDisruptionAfterFinalization(SnapshotDisruptionIT.java:93)

@tlfeng
Copy link
Copy Markdown
Contributor

tlfeng commented Jun 15, 2022

start gradle check

@opensearch-ci-bot
Copy link
Copy Markdown
Collaborator

opensearch-ci-bot commented Jun 15, 2022

✅   Gradle Check success 51cdfb7
Log 6036

Reports 6036

@dblock dblock merged commit 7b13c24 into 2.x Jun 15, 2022
@github-actions github-actions bot deleted the backport/backport-3591-to-2.x branch June 15, 2022 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@reta reta reta approved these changes

+1 more reviewer

@dblock dblock dblock approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

backport PRs or issues specific to backporting features or enhancments :test Adding or fixing a test v2.1.0 Issues and PRs related to version 2.1.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@opensearch-ci-bot @reta @tlfeng @dblock