Skip to content

Fix SnapshotStatus Transport Action Doing IO on Transport Thread (#68023)#68092

Merged
original-brownbear merged 1 commit intoelastic:7.xfrom
original-brownbear:68023-7.x
Jan 28, 2021
Merged

Fix SnapshotStatus Transport Action Doing IO on Transport Thread (#68023)#68092
original-brownbear merged 1 commit intoelastic:7.xfrom
original-brownbear:68023-7.x

Conversation

@original-brownbear
Copy link
Copy Markdown
Contributor

There is a small chance here that #67947 would cause the callback
for the repository data to run on a transport or CS updater thread
and do a lot of IO to fetch SnapshotInfo.

Fixed by always forking to the generic pool for the callback.
Added test that triggers lots of deserializing repository data from
cache on the transport thread concurrently which triggers this bug
relatively reliable (more than half the runs) but is still reasonably
fast (under 5s).

backport of #68023

)

There is a small chance here that #67947 would cause the callback
for the repository data to run on a transport or CS updater thread
and do a lot of IO to fetch `SnapshotInfo`.

Fixed by always forking to the generic pool for the callback.
Added test that triggers lots of deserializing repository data from
cache on the transport thread concurrently which triggers this bug
relatively reliable (more than half the runs) but is still reasonably
fast (under 5s).
@original-brownbear original-brownbear added :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Jan 28, 2021
@elasticmachine elasticmachine added the Team:Distributed Meta label for distributed team. label Jan 28, 2021
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@original-brownbear
Copy link
Copy Markdown
Contributor Author

Jenkins run elasticsearch-ci/default-distro (Dep download issue)

@original-brownbear
Copy link
Copy Markdown
Contributor Author

Jenkins run elasticsearch-ci/1 (unrelated + known)

@original-brownbear original-brownbear merged commit 582223b into elastic:7.x Jan 28, 2021
@original-brownbear original-brownbear deleted the 68023-7.x branch January 28, 2021 09:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs Team:Distributed Meta label for distributed team.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants