Skip to content

CI: Fix integration test detection for bugfix/flaky job flavors#91194

Merged
maxknv merged 2 commits intomasterfrom
ci_fix_flaky_bugfix_it
Dec 1, 2025
Merged

CI: Fix integration test detection for bugfix/flaky job flavors#91194
maxknv merged 2 commits intomasterfrom
ci_fix_flaky_bugfix_it

Conversation

@maxknv
Copy link
Copy Markdown
Member

@maxknv maxknv commented Dec 1, 2025

Changelog category (leave one):

  • Not for changelog (changelog entry is not required)

follow up #90360

@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh bot commented Dec 1, 2025

Workflow [PR], commit [a64b58a]

Summary:

job_name test_name status info comment
Integration tests (amd_binary, 5/5) failure
test_refreshable_mat_view_replicated/test.py::test_real_wait_refresh[to_clause0-True-False] FAIL cidb
Integration tests (amd_tsan, 1/6) failure
test_storage_nats/test_nats_jet_stream.py::test_nats_overloaded_insert FAIL cidb

@clickhouse-gh clickhouse-gh bot added the pr-not-for-changelog This PR should not be mentioned in the changelog label Dec 1, 2025
if (
file.startswith("tests/integration/test")
and Path(file).name.startswith("test_")
and Path(file).name.startswith("test")
Copy link
Copy Markdown
Member

@azat azat Dec 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm, so we will not run test on config changes? We should

Also initial problem was with stateless tests, how it will help?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it should be implemented then (not in scope of this change), now there is no logic to derive changed tests from changed configs

)

if is_bugfix_validation or is_flaky_check:
assert changed_test_modules, "No changed test modules found, either job must be skipped or bug in changed test search logic"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

And this will fail the job completely instead of skipping it, should it do something like

            Result.create_from(
                status=Result.Status.SKIPPED,
                info="...",
            ).complete_job()

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then we won't notice a bug in the changed test detection logic, like the one fixed in this PR.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If no tests were changed, the job is supposed to be skipped in the CI hook filter_job.py

@azat azat self-assigned this Dec 1, 2025
@maxknv maxknv added this pull request to the merge queue Dec 1, 2025
Merged via the queue into master with commit 2771f08 Dec 1, 2025
127 of 130 checks passed
@maxknv maxknv deleted the ci_fix_flaky_bugfix_it branch December 1, 2025 23:34
@robot-clickhouse-ci-2 robot-clickhouse-ci-2 added the pr-synced-to-cloud The PR is synced to the cloud repo label Dec 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-not-for-changelog This PR should not be mentioned in the changelog pr-synced-to-cloud The PR is synced to the cloud repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants