Skip to content

[8.x] Prepare tsdb doc values format for merging optimizations.#126261

Merged
martijnvg merged 1 commit intoelastic:8.xfrom
martijnvg:backport_125933
Apr 4, 2025
Merged

[8.x] Prepare tsdb doc values format for merging optimizations.#126261
martijnvg merged 1 commit intoelastic:8.xfrom
martijnvg:backport_125933

Conversation

@martijnvg
Copy link
Copy Markdown
Member

Backporting #125933 to 8.x branch.

The change contains the following changes:

  • The numDocsWithField field moved from SortedNumericEntry to NumericEntry. Making this statistic always available.
  • Store jump table after values in ES87TSDBDocValuesConsumer#writeField(...). Currently it is stored before storing values. This will allow us later to iterate over the SortedNumericDocValues once. When merging, this is expensive as a merge sort on the fly is being executed.

This change will allow all the optimizations that are listed in #1254032

Backporting elastic#125933 to 8.x branch.

The change contains the following changes:

- The numDocsWithField field moved from SortedNumericEntry to NumericEntry. Making this statistic always available.
- Store jump table after values in ES87TSDBDocValuesConsumer#writeField(...). Currently it is stored before storing values. This will allow us later to iterate over the SortedNumericDocValues once. When merging, this is expensive as a merge sort on the fly is being executed.

This change will allow all the optimizations that are listed in elastic#125403
@martijnvg martijnvg merged commit 834f4df into elastic:8.x Apr 4, 2025
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants