Skip to content
This repository was archived by the owner on Jul 24, 2024. It is now read-only.

cherry pick #402 and #396 to release 4.0.#410

Merged
kennytm merged 2 commits intopingcap:release-4.0from
YuJuncen:402-396
Jul 9, 2020
Merged

cherry pick #402 and #396 to release 4.0.#410
kennytm merged 2 commits intopingcap:release-4.0from
YuJuncen:402-396

Conversation

@YuJuncen
Copy link
Collaborator

@YuJuncen YuJuncen commented Jul 8, 2020

What problem does this PR solve?

cherry-pick #402 and #396

Release Note

  • Improve parallel processing power when backing up a large database with many regions.
  • Fix a bug that may cause failed to backup when dataset is too large and GC lifetime is too brief.

kennytm and others added 2 commits July 8, 2020 20:17
…pingcap#396)

* *: run BackupRanges in parallel, change meaning of backup concurrency

* backup: fix overestimated time summary

* backup,task: refactor: remove backupMeta field from backup.Client

This avoids the implicit race due to mutating hidden members. Instead, we
use functional style (build the backupMeta bottom-up from immutable bits)
to eliminate the race conditions.

Co-authored-by: 3pointer <luancheng@pingcap.com>
* backup: set syncpoint at background

* backup: use real duration

* backup: run check safepoint at background

* backup: fix some errors after merging

* backup: fix some problems

* backup: ensure all files are collected.

* backup: use select to sync files

* backup: don't select on errCh

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
Copy link
Collaborator

@kennytm kennytm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot ti-srebot added the status/LGT1 LGTM1 label Jul 8, 2020
@ti-srebot
Copy link
Contributor

@kennytm,Thanks for your review.

Copy link
Member

@overvenus overvenus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot ti-srebot removed the status/LGT1 LGTM1 label Jul 9, 2020
@ti-srebot ti-srebot added the status/LGT2 LGTM2 label Jul 9, 2020
@ti-srebot
Copy link
Contributor

@overvenus,Thanks for your review.

@overvenus overvenus added this to the v4.0.3 milestone Jul 9, 2020
@kennytm kennytm merged commit d184933 into pingcap:release-4.0 Jul 9, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants