Skip to content

Flaky integration tests check is flaky #69126

@arthurpassos

Description

@arthurpassos

Flaky check description states integration tests are executed 10 times in parallel, see below:

Checks if new added or modified tests are flaky by running them repeatedly, in parallel, with more randomization. Functional tests are run 100 times with address sanitizer, and additional randomization of thread scheduling. Integration tests are run up to 10 times. If at least once a new test has failed, or was too long, this check will be red. We don't allow flaky tests, read the doc

This is a problem for integration tests that do not randomize entity names, it causes execeptions like: Code: 57. DB::Exception: Received from 172.16.3.2:9000. DB::Exception: Table test.view_2 already exists. Stack trace: and Code: 493. DB::Exception: Received from 172.16.5.2:9000. DB::Exception: user emma: cannot insert because user emma already exists in local_directory. Stack trace:.

https://s3.amazonaws.com/clickhouse-test-reports/65277/a22f9fd91f66d1e89e89eb8e70b2784351f6e776/integration_tests_flaky_check__asan_/integration_run_flaky_0.log

Metadata

Metadata

Assignees

No one assigned

    Labels

    flaky testflaky test found by CItestingSpecial issue with list of bugs found by CI

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions