Skip to content

[ML] Impose a minimum on the automatically calculated JVM size#91732

Merged
droberts195 merged 1 commit intoelastic:mainfrom
droberts195:fix_auto_jvm_size_discrepancy
Nov 21, 2022
Merged

[ML] Impose a minimum on the automatically calculated JVM size#91732
droberts195 merged 1 commit intoelastic:mainfrom
droberts195:fix_auto_jvm_size_discrepancy

Conversation

@droberts195
Copy link
Copy Markdown

This change fixes a discrepancy that has existed for a long time but was revealed by #91694. The ML automatic node/JVM sizing code contained a minimum node size but did not restrict the minimum JVM size to the size that would be chosen on that minimum node size. This could throw off calculations at small scale.

Fixes #91728

This change fixes a discrepancy that has existed for a long time
but was revealed by elastic#91694. The ML automatic node/JVM sizing code
contained a minimum node size but did not restrict the minimum
JVM size to the size that would be chosen on that minimum node
size. This could throw off calculations at small scale.

Fixes elastic#91728
@droberts195
Copy link
Copy Markdown
Author

Marked as >non-issue even though it's a bug fix, as it relates to an internal implementation detail of autoscaling in ESS.

@elasticsearchmachine elasticsearchmachine added the Team:ML Meta label for the ML team label Nov 19, 2022
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/ml-core (Team:ML)

Copy link
Copy Markdown

@hendrikmuhs hendrikmuhs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@droberts195 droberts195 merged commit c21bd63 into elastic:main Nov 21, 2022
@droberts195 droberts195 deleted the fix_auto_jvm_size_discrepancy branch November 21, 2022 08:17
droberts195 added a commit to droberts195/elasticsearch that referenced this pull request Nov 21, 2022
…ic#91732)

This change fixes a discrepancy that has existed for a long time
but was revealed by elastic#91694. The ML automatic node/JVM sizing code
contained a minimum node size but did not restrict the minimum
JVM size to the size that would be chosen on that minimum node
size. This could throw off calculations at small scale.

Fixes elastic#91728
droberts195 added a commit to droberts195/elasticsearch that referenced this pull request Nov 21, 2022
…ic#91732)

This change fixes a discrepancy that has existed for a long time
but was revealed by elastic#91694. The ML automatic node/JVM sizing code
contained a minimum node size but did not restrict the minimum
JVM size to the size that would be chosen on that minimum node
size. This could throw off calculations at small scale.

Fixes elastic#91728
elasticsearchmachine pushed a commit that referenced this pull request Nov 21, 2022
… (#91742)

This change fixes a discrepancy that has existed for a long time
but was revealed by #91694. The ML automatic node/JVM sizing code
contained a minimum node size but did not restrict the minimum
JVM size to the size that would be chosen on that minimum node
size. This could throw off calculations at small scale.

Fixes #91728
elasticsearchmachine pushed a commit that referenced this pull request Nov 21, 2022
… (#91741)

This change fixes a discrepancy that has existed for a long time
but was revealed by #91694. The ML automatic node/JVM sizing code
contained a minimum node size but did not restrict the minimum
JVM size to the size that would be chosen on that minimum node
size. This could throw off calculations at small scale.

Fixes #91728
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:ml Machine learning >non-issue Team:ML Meta label for the ML team v8.5.3 v8.6.0 v8.7.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

NativeMemoryCalculatorTests » testActualNodeSizeCalculationConsistency

3 participants