Skip to content

Final pipeline not executed for indexing requests which include date math expressions #75047

@danhermann

Description

@danhermann

Elasticsearch version (bin/elasticsearch --version): 7.12.0, 7.13.2, possibly others

Description of the problem including expected versus actual behavior:

This is similar to #69727 except that in this case, the final pipeline is set directly on an existing index rather than in a template.

Steps to reproduce:

PUT _ingest/pipeline/my-final-pipeline
{
  "description": "create event.source",
  "processors": [
    {
      "set": {
        "field": "user.name",
        "value": "my-user-name",
        "ignore_failure": false
      }
    }
  ]
}

# Create an index which the final_pipeline is my-final-pipeline
# PUT /<my-index-{now/d}>
PUT /%3Cmy-index-%7Bnow%2Fd%7D%3E
{
  "settings": {
    "index.final_pipeline": "my-final-pipeline"
  }
}

# Index a document using the date math expression in the URL:
POST %3Cmy-index-%7Bnow%2Fd%7D%3E/_doc/1
{
  "foo": "bar"
}

# observe that user.name field is not set by the final pipeline

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions