Skip to content

Optimize GCS Mock (#51593)#51595

Merged
original-brownbear merged 1 commit intoelastic:7.6from
original-brownbear:51593-7.6
Jan 29, 2020
Merged

Optimize GCS Mock (#51593)#51595
original-brownbear merged 1 commit intoelastic:7.6from
original-brownbear:51593-7.6

Conversation

@original-brownbear
Copy link
Copy Markdown
Contributor

This test was still very GC heavy in Java 8 runs in particular
which seems to slow down request processing to the point of timeouts
in some runs.
This PR completely removes the large number of O(MB) byte[] allocations
that were happening in the mock http handler which cuts the allocation rate
by about a factor of 5 in my local testing for the GC heavy testSnapshotWithLargeSegmentFiles
run.

Closes #51446
Closes #50754

backport of #51593

This test was still very GC heavy in Java 8 runs in particular
which seems to slow down request processing to the point of timeouts
in some runs.
This PR completely removes the large number of O(MB) `byte[]` allocations
that were happening in the mock http handler which cuts the allocation rate
by about a factor of 5 in my local testing for the GC heavy `testSnapshotWithLargeSegmentFiles`
run.

Closes #51446
Closes #50754
@original-brownbear original-brownbear added :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Jan 29, 2020
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-distributed (:Distributed/Snapshot/Restore)

@original-brownbear original-brownbear merged commit 09f8d4b into elastic:7.6 Jan 29, 2020
@original-brownbear original-brownbear deleted the 51593-7.6 branch January 29, 2020 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants