Skip to content

[8.x] Estimate segment field usages (#112760)#112777

Merged
elasticsearchmachine merged 1 commit intoelastic:8.xfrom
dnhatn:backport/8.x/pr-112760
Sep 12, 2024
Merged

[8.x] Estimate segment field usages (#112760)#112777
elasticsearchmachine merged 1 commit intoelastic:8.xfrom
dnhatn:backport/8.x/pr-112760

Conversation

@dnhatn
Copy link
Copy Markdown
Member

@dnhatn dnhatn commented Sep 11, 2024

Backports the following commits to 8.x:

We have introduced a new memory estimation method in serverless, based 
on the number of segments and the fields within them. This new approach
works well overall, but it still falls short in cases where most fields
are used more than once - for example, in both doc_values and postings,
or doc_values and points. This change exposes the total usage of fields
in segments, allowing us to adjust the memory estimate for these cases.
@dnhatn dnhatn added :StorageEngine/Mapping The storage related side of mappings >non-issue auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport Team:StorageEngine labels Sep 11, 2024
@elasticsearchmachine elasticsearchmachine merged commit f217322 into elastic:8.x Sep 12, 2024
@dnhatn dnhatn deleted the backport/8.x/pr-112760 branch September 12, 2024 00:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport >non-issue :StorageEngine/Mapping The storage related side of mappings Team:StorageEngine v8.16.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants