Skip to content

Autoscaling reactive storage decider (#65520)#66236

Merged
henningandersen merged 1 commit intoelastic:7.xfrom
henningandersen:enhance_reactive_storage_autoscaler_7x
Dec 14, 2020
Merged

Autoscaling reactive storage decider (#65520)#66236
henningandersen merged 1 commit intoelastic:7.xfrom
henningandersen:enhance_reactive_storage_autoscaler_7x

Conversation

@henningandersen
Copy link
Copy Markdown
Contributor

Backport of #65520

The reactive storage decider will request additional capacity
proportional to the size of shards that are either:

  • unassigned and unable to be allocated with only reason being storage
    on a node
  • shards that cannot remain where they are with only reason being
    storage and cannot be allocated anywhere else
  • shards that cannot remain where they are and cannot be allocated
    on any node and at least one node has storage as the only reason for
    unable to allocate.

The reactive storage decider does not try to look into the future, thus
at the time the reactive decider asks to scale up, the cluster is
already in a need for more storage.

The reactive storage decider will request additional capacity
proportional to the size of shards that are either:
* unassigned and unable to be allocated with only reason being storage
on a node
* shards that cannot remain where they are with only reason being
storage and cannot be allocated anywhere else
* shards that cannot remain where they are and cannot be allocated
on any node and at least one node has storage as the only reason for
unable to allocate.

The reactive storage decider does not try to look into the future, thus
at the time the reactive decider asks to scale up, the cluster is
already in a need for more storage.
@henningandersen henningandersen added >non-issue backport :Distributed/Autoscaling Automatically adding or removing nodes in a cluster v7.11.0 labels Dec 13, 2020
@elasticmachine elasticmachine added the Team:Distributed Meta label for distributed team. label Dec 13, 2020
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@henningandersen henningandersen merged commit 2a44a5f into elastic:7.x Dec 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport :Distributed/Autoscaling Automatically adding or removing nodes in a cluster >non-issue Team:Distributed Meta label for distributed team. v7.11.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants