Skip to content

*: Make tiflash compatible with the cse branch#9765

Merged
ti-chi-bot[bot] merged 15 commits intopingcap:masterfrom
JaySon-Huang:align_with_cse
Feb 7, 2025
Merged

*: Make tiflash compatible with the cse branch#9765
ti-chi-bot[bot] merged 15 commits intopingcap:masterfrom
JaySon-Huang:align_with_cse

Conversation

@JaySon-Huang
Copy link
Contributor

@JaySon-Huang JaySon-Huang commented Jan 6, 2025

What problem does this PR solve?

Issue Number: close #9767

Problem Summary:

What is changed and how it works?


The following adoption of cse only enable when SERVERLESS_PROXY = 1 is defined

  • Length of short value in lock CF encode as varInt instead of u8
  • Blocklist feature
    • keyspace blocklist
    • region_id blocklist
    • store_id blocklist under disagg arch
  • mtls
  • A HTTP API for Acquiring the all the region ids created in this TiFlash node with given keyspace id
  • File-base large txn
  • Special threshold on parallel prehandle

Check List

Tests

  • Unit test
  • Integration test
  • Manual test (add detailed scripts or steps below)
  • No code

Side effects

  • Performance regression: Consumes more CPU
  • Performance regression: Consumes more Memory
  • Breaking backward compatibility

Documentation

  • Affects user behaviors
  • Contains syntax changes
  • Contains variable changes
  • Contains experimental features
  • Changes MySQL compatibility

Release note

None

@ti-chi-bot ti-chi-bot bot added do-not-merge/needs-linked-issue do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. release-note-none Denotes a PR that doesn't merit a release note. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. and removed size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. do-not-merge/needs-linked-issue labels Jan 6, 2025
@JaySon-Huang JaySon-Huang force-pushed the align_with_cse branch 2 times, most recently from 2dbf453 to 236d14f Compare January 7, 2025 07:40
@JaySon-Huang JaySon-Huang changed the title [WIP] *: Make tiflash compatible with the cse branch *: Make tiflash compatible with the cse branch Jan 8, 2025
@ti-chi-bot ti-chi-bot bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jan 8, 2025
Copy link
Member

@yongman yongman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Jan 8, 2025

@yongman: adding LGTM is restricted to approvers and reviewers in OWNERS files.

Details

In response to this:

LGTM

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Poco::Net::Context::VerificationMode::VERIFY_STRICT
#else
// mtls: metrics server allows anonymous pullers @iosmanthus
Poco::Net::Context::VerificationMode::VERIFY_RELAXED
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where does this line come from? Can not find on either tiflash master or cse

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

return false;
}
#else
if (version == cur_version)
Copy link
Member

@CalvinNeo CalvinNeo Jan 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

        // if the `version` is less than `cur_version`, it means that the schema version in TiKV has been rolled back by restore.
        // We should sync the schema again.

Why won't this happen in TiFlash master?

Copy link
Contributor Author

@JaySon-Huang JaySon-Huang Feb 6, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In TiFlash master, when executing  flashback cluster, tidb won't overwrite the schema_version.
But in cse branch, they may restore the cluster by the data from S3. And this will lead to schema version rollbacked to a smaller version.

@CalvinNeo
Copy link
Member

/cc @guo-shaoge Could you please also review the blocklist part?

Poco::Net::Context::VerificationMode::VERIFY_STRICT
#else
// mtls: metrics server allows anonymous pullers @iosmanthus
Poco::Net::Context::VerificationMode::VERIFY_RELAXED
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member

@CalvinNeo CalvinNeo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@ti-chi-bot ti-chi-bot bot added needs-1-more-lgtm Indicates a PR needs 1 more LGTM. approved labels Feb 5, 2025
Signed-off-by: JaySon-Huang <tshent@qq.com>
JaySon-Huang and others added 12 commits February 6, 2025 16:27
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Co-authored-by: Calvin Neo <CalvinNeo@users.noreply.github.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Feb 7, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: CalvinNeo, Lloyd-Pottiger, yongman

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:
  • OWNERS [CalvinNeo,Lloyd-Pottiger]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ti-chi-bot ti-chi-bot bot added lgtm and removed needs-1-more-lgtm Indicates a PR needs 1 more LGTM. labels Feb 7, 2025
@ti-chi-bot
Copy link
Contributor

ti-chi-bot bot commented Feb 7, 2025

[LGTM Timeline notifier]

Timeline:

  • 2025-02-05 02:28:46.628640999 +0000 UTC m=+238798.161052997: ☑️ agreed by CalvinNeo.
  • 2025-02-07 06:53:31.415565833 +0000 UTC m=+427482.947977832: ☑️ agreed by Lloyd-Pottiger.

@ti-chi-bot ti-chi-bot bot merged commit 6a4b04d into pingcap:master Feb 7, 2025
5 checks passed
@JaySon-Huang JaySon-Huang deleted the align_with_cse branch February 7, 2025 07:39
yongman pushed a commit to yongman/tiflash that referenced this pull request Jun 18, 2025
close pingcap#9767

Signed-off-by: JaySon-Huang <tshent@qq.com>

Co-authored-by: Calvin Neo <CalvinNeo@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved lgtm release-note-none Denotes a PR that doesn't merit a release note. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make tiflash compatible with the cse branch

4 participants