Skip to content

[7.x] Add data tiers (hot, warm, cold, frozen) as custom node roles (#60994)#61045

Merged
dakrone merged 1 commit intoelastic:7.xfrom
dakrone:backport/7.x/pr-60994
Aug 12, 2020
Merged

[7.x] Add data tiers (hot, warm, cold, frozen) as custom node roles (#60994)#61045
dakrone merged 1 commit intoelastic:7.xfrom
dakrone:backport/7.x/pr-60994

Conversation

@dakrone
Copy link
Copy Markdown
Member

@dakrone dakrone commented Aug 12, 2020

Backports the following commits to 7.x:

…c#60994)

This commit adds the `data_hot`, `data_warm`, `data_cold`, and `data_frozen` node roles to the
x-pack plugin. These roles are intended to be the base for the formalization of data tiers in
Elasticsearch.

These roles all act as data nodes (meaning shards can be allocated to them). Nodes with the existing
`data` role acts as though they have all of the roles configured (it is a hot, warm, cold, and
frozen node).

This also includes a custom `AllocationDecider` that allows the user to configure the following
settings on a cluster level:
- `cluster.routing.allocation.require._tier`
- `cluster.routing.allocation.include._tier`
- `cluster.routing.allocation.exclude._tier`

And in index settings:
- `index.routing.allocation.require._tier`
- `index.routing.allocation.include._tier`
- `index.routing.allocation.exclude._tier`

Relates to elastic#60848
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-core-features (:Core/Features/Features)

@elasticmachine elasticmachine added the Team:Data Management (obsolete) DO NOT USE. This team no longer exists. label Aug 12, 2020
@dakrone dakrone merged commit e3df64a into elastic:7.x Aug 12, 2020
@dakrone dakrone deleted the backport/7.x/pr-60994 branch August 12, 2020 17:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport Team:Data Management (obsolete) DO NOT USE. This team no longer exists. v7.10.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants