Skip to content

hack/unit: Rerun failed flaky libnetwork tests#47553

Merged
vvoland merged 2 commits intomoby:masterfrom
vvoland:testing-libnetwork-rerun-flaky
Oct 30, 2024
Merged

hack/unit: Rerun failed flaky libnetwork tests#47553
vvoland merged 2 commits intomoby:masterfrom
vvoland:testing-libnetwork-rerun-flaky

Conversation

@vvoland
Copy link
Contributor

@vvoland vvoland commented Mar 12, 2024

libnetwork tests tend to be flaky (namely TestNetworkDBIslands and TestNetworkDBCRUDTableEntries).

Move execution of tests which name has TestFlaky prefix to a separate gotestsum pass which allows them to be reran 4 times.

On Windows, the libnetwork test execution is not split into a separate pass.

- What I did
Restored joy in creating PRs (hopefully).

- How I did it

- How to verify it
CI

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

@vvoland vvoland added status/2-code-review kind/enhancement Enhancements are not bugs or new features but can improve usability or performance. area/networking Networking area/testing labels Mar 12, 2024
@vvoland vvoland added this to the 26.0.0 milestone Mar 12, 2024
@vvoland vvoland self-assigned this Mar 12, 2024
@vvoland vvoland requested a review from tianon as a code owner March 12, 2024 11:58
@vvoland vvoland force-pushed the testing-libnetwork-rerun-flaky branch from 90378b1 to 8ee717d Compare March 14, 2024 10:17
@vvoland vvoland modified the milestones: 26.0.0, 27.0.0 Mar 14, 2024
@vvoland vvoland force-pushed the testing-libnetwork-rerun-flaky branch 2 times, most recently from a932e50 to ed56844 Compare March 14, 2024 12:18
@vvoland vvoland changed the title hack/unit: Rerun failed libnetwork tests hack/unit: Rerun failed flaky libnetwork tests Mar 14, 2024
@vvoland
Copy link
Contributor Author

vvoland commented Mar 14, 2024

Meh, this breaks passing custom -run flags via TESTFLAGS
Fixed

@vvoland vvoland marked this pull request as draft March 14, 2024 12:47
@vvoland vvoland force-pushed the testing-libnetwork-rerun-flaky branch 3 times, most recently from baeb165 to 57b97ab Compare March 14, 2024 15:07
vvoland added 2 commits March 19, 2024 12:35
libnetwork tests tend to be flaky (namely `TestNetworkDBIslands` and
`TestNetworkDBCRUDTableEntries`).

Move execution of tests which name has `TestFlaky` prefix to a separate
gotestsum pass which allows them to be reran 4 times.

On Windows, the libnetwork test execution is not split into a separate
pass.

Signed-off-by: Paweł Gronowski <pawel.gronowski@docker.com>
Mark the following tests as flaky:
- TestNetworkDBCRUDTableEntry
- TestNetworkDBCRUDTableEntries
- TestNetworkDBIslands
- TestNetworkDBNodeLeave

Signed-off-by: Paweł Gronowski <pawel.gronowski@docker.com>
@vvoland vvoland force-pushed the testing-libnetwork-rerun-flaky branch from 57b97ab to 9893520 Compare March 19, 2024 11:35
@vvoland vvoland marked this pull request as ready for review March 19, 2024 12:24
@vvoland vvoland modified the milestones: 26.1.0, 27.0.0 Apr 10, 2024
@vvoland vvoland requested a review from thaJeztah April 23, 2024 10:19
@akerouanton akerouanton modified the milestones: 27.0.0, 28.0.0 Jun 4, 2024
@vvoland vvoland requested a review from cpuguy83 October 29, 2024 10:16
@vvoland vvoland requested a review from akerouanton October 29, 2024 10:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/networking Networking area/testing kind/enhancement Enhancements are not bugs or new features but can improve usability or performance. status/2-code-review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants