Skip to content

Use ClusterState as Consistency Source for Snapshot Repositories (#49060)#50267

Merged
original-brownbear merged 1 commit intoelastic:7.xfrom
original-brownbear:49060-7.x
Dec 17, 2019
Merged

Use ClusterState as Consistency Source for Snapshot Repositories (#49060)#50267
original-brownbear merged 1 commit intoelastic:7.xfrom
original-brownbear:49060-7.x

Conversation

@original-brownbear
Copy link
Copy Markdown
Contributor

Follow up to #49729

This change removes falling back to listing out the repository contents to find the latest index-N in write-mounted blob store repositories.
This saves 2-3 list operations on each snapshot create and delete operation. Also it makes all the snapshot status APIs cheaper (and faster) by saving one list operation there as well in many cases.
This removes the resiliency to concurrent modifications of the repository as a result and puts a repository in a corrupted state in case loading RepositoryData failed from the assumed generation.

backport of #49060

)

Follow up to #49729

This change removes falling back to listing out the repository contents to find the latest `index-N` in write-mounted blob store repositories.
This saves 2-3 list operations on each snapshot create and delete operation. Also it makes all the snapshot status APIs cheaper (and faster) by saving one list operation there as well in many cases.
This removes the resiliency to concurrent modifications of the repository as a result and puts a repository in a `corrupted` state in case loading `RepositoryData` failed from the assumed generation.
@original-brownbear original-brownbear added :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Dec 17, 2019
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed (:Distributed/Snapshot/Restore)

@original-brownbear original-brownbear merged commit 2e7b1ab into elastic:7.x Dec 17, 2019
@original-brownbear original-brownbear deleted the 49060-7.x branch December 17, 2019 09:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants