Skip to content

Delete range can not remove expected data (#1783)#1789

Merged
flowbehappy merged 2 commits intopingcap:release-4.0from
ti-srebot:release-4.0-c72c331726b4
Apr 16, 2021
Merged

Delete range can not remove expected data (#1783)#1789
flowbehappy merged 2 commits intopingcap:release-4.0from
ti-srebot:release-4.0-c72c331726b4

Conversation

@ti-srebot
Copy link
Collaborator

@ti-srebot ti-srebot commented Apr 16, 2021

cherry-pick #1783 to release-4.0
You can switch your code base to this Pull Request by using git-extras:

# In tics repo:
git pr https://github.com/pingcap/tics/pull/1789

After apply modifications, you can push your change to this PR via:

git push git@github.com:ti-srebot/tics.git pr/1789:release-4.0-c72c331726b4

What problem does this PR solve?

Problem Summary:

  1. Currently in DT engine, we only do place index for relevant query ranges in a segment. It can speed up individual region read, but the result of place index can not be shared between other region reads. It will eventually slow down the whole query processing if we have lots of cop requests.

  2. Some data failed to be removed after region peer migrated to other nodes.

What is changed and how it works?

What's Changed:

  1. This PR adds a new option dt_enable_relevant_place, and by default set to true, means enabling relevant place. The behavior is the same as the previous, but we can use the option to disable the relevant place.
  2. Fix bug: delete range can not remove expected data.

Related changes

  • PR to update pingcap/docs/pingcap/docs-cn:
  • Need to cherry-pick to the release branch

Check List

Tests

  • Unit test
  • Integration test

Side effects

Release note

  • Fix a potential issue that the DeleteRange in the storage engine failed to remove some data.

Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot ti-srebot added CHERRY-PICK cherry pick status/LGT1 Indicates that a PR has LGTM 1. type/bugfix This PR fixes a bug. labels Apr 16, 2021
@ti-srebot ti-srebot requested a review from JaySon-Huang April 16, 2021 08:44
@ti-srebot ti-srebot added this to the v4.0.13 milestone Apr 16, 2021
@flowbehappy
Copy link
Contributor

/run-all-tests

@flowbehappy
Copy link
Contributor

/build

@flowbehappy
Copy link
Contributor

/run-all-tests

Copy link
Contributor

@JaySon-Huang JaySon-Huang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@flowbehappy flowbehappy force-pushed the release-4.0-c72c331726b4 branch from c32c308 to c9ec694 Compare April 16, 2021 09:50
@flowbehappy
Copy link
Contributor

/run-all-tests

@ti-chi-bot
Copy link
Member

@ti-srebot: Adding the "do-not-merge/release-note-label-needed" label because no release-note block was detected, please follow our release note process to remove it.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@ti-chi-bot ti-chi-bot added do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Sep 9, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CHERRY-PICK cherry pick do-not-merge/release-note-label-needed Indicates that a PR should not merge because it's missing one of the release note labels. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. status/LGT1 Indicates that a PR has LGTM 1. type/bugfix This PR fixes a bug.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants