Skip to content

[Transform] Allow aligning checkpointing with date_histogram bucket boundaries #62746

@hendrikmuhs

Description

@hendrikmuhs

spin-off from #61587

If a transform is used with date_histogram transform creates and updates intermediate buckets, because checkpointing is not aligned with the interval in a the date histogram. For usecases with lot's of data and/or low intervals, this creates extra load, because upserts (delete + create) are expensive.

If checkpointing was aligned with bucket boundaries, upserts could be avoided.

Pro's

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions