Skip to content

testing: reduce flakiness of tests#3393

Merged
PhongChuong merged 1 commit intogoogleapis:mainfrom
shollyman:test-fixes
Jul 17, 2024
Merged

testing: reduce flakiness of tests#3393
PhongChuong merged 1 commit intogoogleapis:mainfrom
shollyman:test-fixes

Conversation

@shollyman
Copy link
Contributor

@shollyman shollyman commented Jul 16, 2024

This PR addresses recent flakes observed in two tests. In the first, we change validation for a DML test to examine DML stats rather then rescanning row data. In the second, we switch a test query used for faster query to be deterministic, as the suspicion is that stale cached results are impacting assertions about how the query was run.

Fixes: #3386
Fixes: #3391

This PR addresses recent flakes observed in two tests.  In the first, we
change validation for a DML test to examine DML stats rather then
rescanning row data.  In the second, we switch a test query used for
faster query to be deterministic, as the suspicion is that stale cached
results are impacting assertions about how the query was run.
@product-auto-label product-auto-label bot added size: s Pull request size is small. api: bigquery Issues related to the googleapis/java-bigquery API. labels Jul 16, 2024
@shollyman shollyman requested a review from PhongChuong July 16, 2024 23:29
@shollyman shollyman marked this pull request as ready for review July 16, 2024 23:29
@shollyman shollyman requested a review from a team July 16, 2024 23:29
@PhongChuong PhongChuong added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 17, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 17, 2024
@PhongChuong
Copy link
Contributor

Thanks for the fix.

@PhongChuong PhongChuong merged commit 2dd9067 into googleapis:main Jul 17, 2024
@shollyman shollyman deleted the test-fixes branch July 17, 2024 16:49
lqiu96 pushed a commit that referenced this pull request Aug 28, 2024
This PR addresses recent flakes observed in two tests.  In the first, we
change validation for a DML test to examine DML stats rather then
rescanning row data.  In the second, we switch a test query used for
faster query to be deterministic, as the suspicion is that stale cached
results are impacting assertions about how the query was run.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: bigquery Issues related to the googleapis/java-bigquery API. size: s Pull request size is small.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bigquery.it.ITBigQueryTest: testFastDMLQuery failed bigquery.it.ITBigQueryTest: testStatelessQueries failed

2 participants