Skip to content

Batch auto create index cluster state updates#82159

Merged
elasticsearchmachine merged 4 commits intoelastic:masterfrom
probakowski:auto-create-batch2
Jan 11, 2022
Merged

Batch auto create index cluster state updates#82159
elasticsearchmachine merged 4 commits intoelastic:masterfrom
probakowski:auto-create-batch2

Conversation

@probakowski
Copy link
Copy Markdown
Contributor

This change adds batching for cluster state updates to auto create index action. It will do a single reroute at the end of the batch which speeds up the operation

@probakowski probakowski added >enhancement :Data Management/Indices APIs DO NOT USE. Use ":Distributed/Indices APIs" or ":StorageEngine/Templates" instead. v8.0.0 labels Dec 31, 2021
@elasticmachine elasticmachine added the Team:Data Management (obsolete) DO NOT USE. This team no longer exists. label Dec 31, 2021
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

Copy link
Copy Markdown
Contributor

@original-brownbear original-brownbear left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM (but lets add a TODO as requested to make this nicer). For now this is a very nice speedup for our benchmarking.

@original-brownbear
Copy link
Copy Markdown
Contributor

@probakowski let's only do 8.1 here IMO. No need to push this to 8.0, it's not that much user impact to justify the backport.

@probakowski
Copy link
Copy Markdown
Contributor Author

Thanks @original-brownbear! That makes sense, I'll do master only

@probakowski probakowski added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Jan 11, 2022
@elasticsearchmachine elasticsearchmachine merged commit 0054ec3 into elastic:master Jan 11, 2022
@probakowski probakowski deleted the auto-create-batch2 branch January 11, 2022 12:10
original-brownbear added a commit that referenced this pull request Jan 11, 2022
Defer reroute on autocreate DS. Follow-up to #82159.

relates #77466
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) :Data Management/Indices APIs DO NOT USE. Use ":Distributed/Indices APIs" or ":StorageEngine/Templates" instead. >enhancement Team:Data Management (obsolete) DO NOT USE. This team no longer exists. v8.1.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants