-
Notifications
You must be signed in to change notification settings - Fork 4.1k
backupccl: incremental backups can miss non-transactional writes #62564
Copy link
Copy link
Closed
Labels
A-disaster-recoveryC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-technical-advisoryCaused a technical advisoryCaused a technical advisorybranch-release-20.1Used to mark GA and release blockers, technical advisories, and bugs for 20.1Used to mark GA and release blockers, technical advisories, and bugs for 20.1branch-release-20.2Used to mark GA and release blockers, technical advisories, and bugs for 20.2Used to mark GA and release blockers, technical advisories, and bugs for 20.2
Description
Non-transactional writes, such as AddSSTable requests may write at a timestamp arbitrarily far in the past. As such, the incremental iterator used by backup will miss these writes if they write to a timestamp prior to that of the previous backup.
Indexes that are being added to tables should only be backed up when they appear online. Additionally, these spans should be considered newly introduced so that backup performs a full scan of the index, rather than an incremental read.
Offline tables should be included in the backup to account for the case where a table that was previously online was taken offline. The writes to the table while it was OFFLINE will need to be captured in a subsequent incremental backup once the table returns online.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
A-disaster-recoveryC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-technical-advisoryCaused a technical advisoryCaused a technical advisorybranch-release-20.1Used to mark GA and release blockers, technical advisories, and bugs for 20.1Used to mark GA and release blockers, technical advisories, and bugs for 20.1branch-release-20.2Used to mark GA and release blockers, technical advisories, and bugs for 20.2Used to mark GA and release blockers, technical advisories, and bugs for 20.2