Support blobstore gc when data bigger than 512M#3907
Support blobstore gc when data bigger than 512M#3907ti-chi-bot merged 11 commits intopingcap:masterfrom jiaqizho:add-gc-512m-support
Conversation
|
[REVIEW NOTIFICATION] This pull request has been approved by:
To complete the pull request process, please ask the reviewers in the list to review by filling The full list of commands accepted by this bot can be found here. DetailsReviewer can indicate their review by submitting an approval review. |
|
@JaySon-Huang PTAL |
| auto lock_stats = blob_stats.lock(); | ||
| blob_stats.eraseStat(stat, lock_stats); | ||
| getBlobFile(blob_id)->del(); |
There was a problem hiding this comment.
Do we need to lock it when removing the file on disk?
There was a problem hiding this comment.
need protecting when changing stats_map.
JaySon-Huang
left a comment
There was a problem hiding this comment.
Pass written_blobs as a reference, and only append to it after successfully write.
And also capture log, write_lilmiter to make the params of lambda to be more clear.
|
Can we simplify |
changed. |
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
Signed-off-by: JaySon-Huang <tshent@qq.com>
|
/run-all-tests |
|
Coverage detail: https://ci-internal.pingcap.net/job/tics_ghpr_unit_test/1130/cobertura/ lines: 44.7% (51591 out of 115297) |
|
/merge |
|
@JaySon-Huang: It seems you want to merge this PR, I will help you trigger all the tests: /run-all-tests You only need to trigger If you have any questions about the PR merge process, please refer to pr process. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository. |
|
This pull request has been accepted and is ready to merge. DetailsCommit hash: ff56640 |
|
@jiaqizho: Your PR was out of date, I have automatically updated it for you. At the same time I will also trigger all tests for you: /run-all-tests If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository. |
|
Coverage detail: https://ci-internal.pingcap.net/job/tics_ghpr_unit_test/1134/cobertura/ lines: 44.8% (51637 out of 115387) |
What problem does this PR solve?
Issue Number: close #xxx
Problem Summary:
What is changed and how it works?
Check List
Tests
Side effects
Documentation
Release note