Skip to content

Replace _scroll with the ability to acquire point-in-time views + search_after #26472

@jpountz

Description

@jpountz

_scroll comes with limitations such as the fact that it only allows to go forward, which can be an issue if there are connectivity issues while the client is retrieving one page as this particular page cannot be retried.

We would like to replace _scroll with an API that allows to open point-in-time views of the data and then allows to paginate through it using search_after. We could even keep the sort by _doc optimization if users provide "track_total_hits": false in their request.

In FixitFriday it was suggested that we call this API Jim's API.

Metadata

Metadata

Assignees

No one assigned

    Labels

    :Search/SearchSearch-related issues that do not fall into other categoriesTeam:SearchMeta label for search teamhigh hanging fruit

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions