Skip to content

[Ingest Plugin] continue_on_failure parameter #14548

@talevy

Description

@talevy

It would be nice to have a flag for ingest pipelines that run during index/bulk requests to allow for some configuration of how errors are handled during ingestion.

Currently, any exception that is caused during an ingest pipeline, the pipeline halts and the document being ingested is not indexed. Some environments may prefer to not block on such failures and continue to index the failed document anyways. For these scenarios it would be nice to have an continue_on_failure flag turned on to instruct Elasticsearch to index the document as it was before it was processed by the ingest pipeline. Such documents can be tagged so that they can be found in the index for re-processing.

_simulate should also support this flag to help with recreating pipeline behavior

depends on #14888

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions