Skip to content

[WIP]#1490

Closed
hongyunyan wants to merge 1 commit intopingcap:masterfrom
hongyunyan:0701
Closed

[WIP]#1490
hongyunyan wants to merge 1 commit intopingcap:masterfrom
hongyunyan:0701

Conversation

@hongyunyan
Copy link
Collaborator

What problem does this PR solve?

Issue Number: close #1477

What is changed and how it works?

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Questions

Will it cause performance regression or break compatibility?
Do you need to update user documentation, design documentation or monitoring documentation?

Release note

Please refer to [Release Notes Language Style Guide](https://pingcap.github.io/tidb-dev-guide/contribute-to-tidb/release-notes-style-guide.html) to write a quality release note.

If you don't think this PR needs a release note then fill it with `None`.

@ti-chi-bot ti-chi-bot bot added do-not-merge/needs-triage-completed do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. release-note Denotes a PR that will be considered when it comes time to generate release notes. labels Jul 1, 2025
@ti-chi-bot
Copy link

ti-chi-bot bot commented Jul 1, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign hicqu for approval. For more information see the Code Review Process.
Please ensure that each of them provides their approval before proceeding.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ti-chi-bot ti-chi-bot bot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Jul 1, 2025
Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Summary of Changes

Hello @hongyunyan, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request introduces a temporary adjustment to the CI configuration for heavy integration tests. It reconfigures all MySQL-related test groups to exclusively run the fail_over_ddl_mix_with_syncpoint test, suggesting a focused effort on debugging or validating this particular scenario within the CI pipeline. The pull request is currently marked as Work In Progress.

Highlights

  • CI Test Configuration: Modified run_heavy_it_in_ci.sh to configure all 16 MySQL heavy integration test groups to exclusively execute the fail_over_ddl_mix_with_syncpoint test. This change likely aims to focus CI resources on debugging or validating this specific test case.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point in your pull request via creating an issue comment (i.e. comment on the pull request page) using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in issue comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist is currently in preview and may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments to provide feedback.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request appears to be a work-in-progress effort to debug a flaky integration test, fail_over_ddl_mix_with_syncpoint. The change modifies the CI test runner script to execute only this specific test across all MySQL test groups. My review highlights the risk of this approach: it temporarily disables a wide range of other important tests. I've flagged this as a high-severity issue to ensure the original test configuration is restored before merging, and I've suggested a more maintainable way to handle such debugging scenarios in the future to prevent accidental loss of test coverage.

Comment on lines 31 to 64
mysql_groups=(
# G00
'generate_column many_pk_or_uk'
'fail_over_ddl_mix_with_syncpoint'
# G01
'api_v2 ddl_for_split_tables_with_random_move_table'
'fail_over_ddl_mix_with_syncpoint'
# G02
'availability ddl_for_split_tables_with_failover'
'fail_over_ddl_mix_with_syncpoint'
# G03
'multi_source'
'fail_over_ddl_mix_with_syncpoint'
# G04
'syncpoint syncpoint_check_ts'
'fail_over_ddl_mix_with_syncpoint'
# G05
'move_table ddl_for_split_tables_with_merge_and_split'
'fail_over_ddl_mix_with_syncpoint'
# G06
'cdc ddl_for_split_tables_with_random_merge_and_split'
'fail_over_ddl_mix_with_syncpoint'
# G07
'resolve_lock merge_table'
'fail_over_ddl_mix_with_syncpoint'
# G08
'bank'
'fail_over_ddl_mix_with_syncpoint'
# G09
'drop_many_tables'
'fail_over_ddl_mix_with_syncpoint'
# G10
'default_value http_proxies'
'fail_over_ddl_mix_with_syncpoint'
# G11
'ddl_reentrant force_replicate_table'
'fail_over_ddl_mix_with_syncpoint'
# G12
'tidb_mysql_test ddl_with_random_move_table'
'fail_over_ddl_mix_with_syncpoint'
# G13
'fail_over region_merge'
'fail_over_ddl_mix_with_syncpoint'
# G14
'fail_over_ddl_mix'
'fail_over_ddl_mix_with_syncpoint'
# G15
# 'fail_over_ddl_mix_with_syncpoint'
'fail_over_ddl_mix_with_syncpoint'
)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

high

It appears you're focusing all MySQL heavy integration test groups on fail_over_ddl_mix_with_syncpoint, likely to debug a flaky test. While this is a valid debugging technique, it disables a large number of other important tests, significantly reducing test coverage for the MySQL sink.

These changes must be reverted before this PR is merged to prevent a major gap in regression testing. Given the "[WIP]" status, I assume this is a temporary measure. Please restore the original test distribution before marking this PR as ready for review.

For future debugging, consider a more robust approach that doesn't require modifying the test group definitions directly. Using an environment variable to override the test list would be safer and prevent accidental merges of debugging configurations.

Example:

# Default test groups
mysql_groups=(
	# G00
	'generate_column many_pk_or_uk'
	# G01
	'api_v2 ddl_for_split_tables_with_random_move_table'
    # ... and so on
)

# Override for debugging if a specific environment variable is set
if [[ -n "$DEBUG_TEST_CASE" ]]; then
    for i in ${!mysql_groups[@]}; do
        mysql_groups[$i]="$DEBUG_TEST_CASE"
    done
fi

@ti-chi-bot
Copy link

ti-chi-bot bot commented Jul 1, 2025

@hongyunyan: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-cdc-pulsar-integration-light 4216470 link false /test pull-cdc-pulsar-integration-light
pull-cdc-mysql-integration-heavy 4216470 link true /test pull-cdc-mysql-integration-heavy

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@hongyunyan hongyunyan closed this Jul 28, 2025
@hongyunyan hongyunyan deleted the 0701 branch December 12, 2025 08:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do-not-merge/needs-triage-completed do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. release-note Denotes a PR that will be considered when it comes time to generate release notes. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

fail_over_ddl_mix_with_syncpoint failed on mysql integration test

1 participant