Skip to content

Circuit breaker for number of tokens used in in-memory highlighter #26515

@ppf2

Description

@ppf2

ES 2.4

image

We have seen a situation when there's limited amount of heap and the user was trying to use the default highlighter against a field with millions of tokens.

@s1monw is wondering if we could potentially limit the number of tokens used in our in-memory highlighter to stop creating tons of tokens in these situations. He noted that we could potentially do this transparently in ES by wrapping the token streams somehow and this can also be a per-request
limit that users can configure. Creating a discussion ticket on this topic.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions