Skip to content

.security with status yellow when cluster.routing.allocation.same_shard.host enabled #29933

@elasticmachine

Description

@elasticmachine

Original comment by @MarxDimitri:

Enabling cluster.routing.allocation.same_shard.host on deployments with multiple nodes on a single host puts .security to yellow. Tested with the version 5.3.

GET /_cat/indices
health status index                             uuid                   pri rep docs.count docs.deleted store.size pri.store.size
…
yellow open   .security                         bpl6HgGdRcqmwZEqAAGBnw   1  11          1            0     17.3kb          2.8kb
…
GET /_cluster/allocation/explain
{
  "index": ".security",
  "shard": 0,
  "primary": false,
  "current_state": "unassigned",
  "unassigned_info": {
    "reason": "REPLICA_ADDED",
    "at": "2017-04-24T11:50:54.057Z",
    "last_allocation_status": "no_attempt"
  },
  "can_allocate": "no",
  "allocate_explanation": "cannot allocate because allocation is not permitted to any of the nodes",
  "node_allocation_decisions": [
    {
      "node_id": "9-hnXjLEThy-c4TbfgqUTg",
      "node_name": "esindex-il03_warm_2",
      "transport_address": "172.27.130.206:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[9-hnXjLEThy-c4TbfgqUTg], [R], s[STARTED], a[id=yutvMaxhTfCHI6lUgyvCDQ]]"
        }
      ]
    },
    {
      "node_id": "FSGDMHoIQwWtypVKi-Tf2A",
      "node_name": "esindex-il05_warm_2",
      "transport_address": "172.27.130.208:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[FSGDMHoIQwWtypVKi-Tf2A], [R], s[STARTED], a[id=ffHbyCIaT0WcNpB25Xu17g]]"
        }
      ]
    },
    {
      "node_id": "G7FHRbvPSWKgrbLdwgP5Cw",
      "node_name": "esindex-il05_warm_1",
      "transport_address": "172.27.130.208:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.208], where it already exists on node [G7FHRbvPSWKgrbLdwgP5Cw]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "I0IBpNXYQj63CtqFzXEQng",
      "node_name": "esindex-il01_hot_2",
      "transport_address": "172.27.130.198:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.198], where it already exists on node [I0IBpNXYQj63CtqFzXEQng]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "Wht2Q3m4ShCG9fDb1_WPAA",
      "node_name": "esindex-il04_warm_2",
      "transport_address": "172.27.130.207:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.207], where it already exists on node [Wht2Q3m4ShCG9fDb1_WPAA]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "XZMimYlLThSbMY3L9sYFbA",
      "node_name": "esindex-il03_warm_1",
      "transport_address": "172.27.130.206:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.206], where it already exists on node [XZMimYlLThSbMY3L9sYFbA]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "XiYyR0iMR6Kmb49DYoeuTw",
      "node_name": "esindex-il00_hot_2",
      "transport_address": "172.27.130.197:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[XiYyR0iMR6Kmb49DYoeuTw], [R], s[STARTED], a[id=0IuYqdzeRs-FXqHpzNDSjQ]]"
        }
      ]
    },
    {
      "node_id": "ZSk0zfN3SJeg09PDkK8E6Q",
      "node_name": "esindex-il01_hot_1",
      "transport_address": "172.27.130.198:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[ZSk0zfN3SJeg09PDkK8E6Q], [R], s[STARTED], a[id=yDdnf-wkSlySVhwhm2JsNA]]"
        }
      ]
    },
    {
      "node_id": "ceG6PFJ6Qq2s2ia8dAB68w",
      "node_name": "esindex-il02_hot_2",
      "transport_address": "172.27.130.199:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.199], where it already exists on node [ceG6PFJ6Qq2s2ia8dAB68w]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "eE8aD3CwTJeEEg30KbfFDg",
      "node_name": "esindex-il00_hot_1",
      "transport_address": "172.27.130.197:9301",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated on host address [172.27.130.197], where it already exists on node [eE8aD3CwTJeEEg30KbfFDg]; set cluster setting [cluster.routing.allocation.same_shard.host] to false to allow multiple nodes on the same host to hold the same shard copies"
        }
      ]
    },
    {
      "node_id": "uKD4Gy6ZRe-SolYYQNVMmw",
      "node_name": "esindex-il02_hot_1",
      "transport_address": "172.27.130.199:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "hot"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[uKD4Gy6ZRe-SolYYQNVMmw], [R], s[STARTED], a[id=Yln4Q0N6TrGD1FCuFvXgMg]]"
        }
      ]
    },
    {
      "node_id": "ui7i2lC3S7K_hvjF8_BMtw",
      "node_name": "esindex-il04_warm_1",
      "transport_address": "172.27.130.207:9300",
      "node_attributes": {
        "firezone": "l",
        "box_type": "warm"
      },
      "node_decision": "no",
      "deciders": [
        {
          "decider": "same_shard",
          "decision": "NO",
          "explanation": "the shard cannot be allocated to the same node on which a copy of the shard already exists [[.security][0], node[ui7i2lC3S7K_hvjF8_BMtw], [P], s[STARTED], a[id=cNLniAwgS4mrZDFDPRxc3g]]"
        }
      ]
    }
  ]
}

Metadata

Metadata

Assignees

Labels

:Distributed/AllocationAll issues relating to the decision making around placing a shard (both master logic & on the nodes):Security/SecuritySecurity issues without another label>bug

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions