Skip to content

Only load FST off heap if we are actually using mmaps for the term dictionary#43158

Merged
s1monw merged 2 commits intoelastic:masterfrom
s1monw:only_offheap_on_mmap
Jun 13, 2019
Merged

Only load FST off heap if we are actually using mmaps for the term dictionary#43158
s1monw merged 2 commits intoelastic:masterfrom
s1monw:only_offheap_on_mmap

Conversation

@s1monw
Copy link
Copy Markdown
Contributor

@s1monw s1monw commented Jun 12, 2019

Given the significant performance impact that NIOFS has when term dicts are
loaded off-heap this change enforces FstLoadMode#AUTO that loads term dicts
off-heap only if the underlying index input indicates a memory map.

Relates to #43150

…ctionary

Given the significant performance impact that NIOFS has when term dicts are
loaded off-heap this change enforces FstLoadMode#AUTO that loads term dicts
off heap only if the underlying index input indicates a memory map.

Relates to elastic#43150
@s1monw s1monw added >enhancement :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v8.0.0 v7.2.0 labels Jun 12, 2019
@s1monw s1monw requested a review from jpountz June 12, 2019 13:24
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed

@s1monw s1monw added v7.3.0 and removed v7.2.0 labels Jun 12, 2019
@s1monw s1monw requested a review from jimczi June 12, 2019 18:45
Copy link
Copy Markdown
Contributor

@jimczi jimczi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@s1monw s1monw merged commit 4de85c4 into elastic:master Jun 13, 2019
s1monw added a commit that referenced this pull request Jun 13, 2019
…ctionary (#43158)

Given the significant performance impact that NIOFS has when term dicts are
loaded off-heap this change enforces FstLoadMode#AUTO that loads term dicts
off heap only if the underlying index input indicates a memory map.

Relates to #43150
tlrx added a commit to tlrx/elasticsearch that referenced this pull request Mar 18, 2020
This is a partial restore of elastic#43158, following decision taken in elastic#51247
tlrx added a commit that referenced this pull request Mar 18, 2020
This is a partial restore of #43158, following decision taken in #51247

Closes #51247
tlrx added a commit that referenced this pull request Mar 18, 2020
This is a partial restore of #43158, following decision taken in #51247

Closes #51247
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Distributed/Engine Anything around managing Lucene and the Translog in an open shard. >enhancement v7.3.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants