Skip to content

Add failure store option to modify data stream API#107116

Merged
elasticsearchmachine merged 16 commits intoelastic:mainfrom
jbaiera:add-modify-failure-store-options
Apr 10, 2024
Merged

Add failure store option to modify data stream API#107116
elasticsearchmachine merged 16 commits intoelastic:mainfrom
jbaiera:add-modify-failure-store-options

Conversation

@jbaiera
Copy link
Copy Markdown
Member

@jbaiera jbaiera commented Apr 4, 2024

This PR adds the ability to modify the failure store indices on a data stream using the modify data stream API.

These options are available in the event that we need to pull indices out of a failure store or add them back to the failure store for any reason. The operations are done using the existing modify data stream actions with a new flag on the action body to denote if the action should be done on the failure stores or not.

@jbaiera jbaiera added >non-issue :StorageEngine/Data streams Data streams and their lifecycles v8.14.0 labels Apr 4, 2024
@jbaiera jbaiera requested review from gmarouli and nielsbauman April 4, 2024 16:40
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@elasticsearchmachine elasticsearchmachine added the Team:Data Management (obsolete) DO NOT USE. This team no longer exists. label Apr 4, 2024
Copy link
Copy Markdown
Contributor

@nielsbauman nielsbauman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is looking good! Left a couple of comments, but most should be pretty easy to resolve.

jbaiera and others added 3 commits April 5, 2024 11:28
…test/data_stream/170_modify_data_stream.yml

Co-authored-by: Niels Bauman <33722607+nielsbauman@users.noreply.github.com>
@jbaiera jbaiera requested a review from nielsbauman April 5, 2024 20:13
Copy link
Copy Markdown
Contributor

@gmarouli gmarouli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great @jbaiera . Minor comments and we are good to go (and potentially some merge conflicts depending on who merges first :P )

@jbaiera jbaiera requested review from gmarouli and nielsbauman April 10, 2024 05:34
Copy link
Copy Markdown
Contributor

@gmarouli gmarouli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

Copy link
Copy Markdown
Contributor

@nielsbauman nielsbauman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 from me too, we're picking up some pace with failure stores!

@jbaiera jbaiera added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Apr 10, 2024
@elasticsearchmachine elasticsearchmachine merged commit 42935c6 into elastic:main Apr 10, 2024
@jbaiera jbaiera deleted the add-modify-failure-store-options branch April 10, 2024 18:34
craigtaverner pushed a commit to craigtaverner/elasticsearch that referenced this pull request Apr 11, 2024
This PR adds the ability to modify the failure store indices on a data
stream using the modify data stream API.

These options are available in the event that we need to pull indices
out of a failure store or add them back to the failure store for any
reason. The operations are done using the existing modify data stream
actions with a new flag on the action body to denote if the action
should be done on the failure stores or not.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) >non-issue :StorageEngine/Data streams Data streams and their lifecycles Team:Data Management (obsolete) DO NOT USE. This team no longer exists. v8.14.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants