Skip to content

Stats: Hdr histogram serialization/deserialization#623

Merged
mum4k merged 2 commits intoenvoyproxy:mainfrom
oschaaf:horizontal-scaling-stats-serialization
Feb 10, 2021
Merged

Stats: Hdr histogram serialization/deserialization#623
mum4k merged 2 commits intoenvoyproxy:mainfrom
oschaaf:horizontal-scaling-stats-serialization

Conversation

@oschaaf
Copy link
Copy Markdown
Member

@oschaaf oschaaf commented Feb 6, 2021

Being able to serialize and deserialize statistics serves several goals:

  • Allow over-the-wire transportation in horizontally scaled setups.
  • Facilitate storage of high res data.
  • Could be used as a means to decouple our workers from the main thread,
    by avoiding reliance on a shared process namespace to merge statistics.
    (not a goal right now)

This adds an abstraction to Statistic, implements it for HdrHistogram, and
adds some tests.

Part of horizontal scaling effort, split out from:
Split out from https://github.com/oschaaf/nighthawk/tree/horizontal-scaling

Signed-off-by: Otto van der Schaaf ovanders@redhat.com

Being able to serialize and deserialize statistics serves several goals:
- Allow over-the-wire transportation in horizontally scaled setups.
- Facilitate storage of high res data.
- Could be used as a means to decouple our workers from the main thread,
  by avoiding reliance on a shared process namespace to merge statistics.
  (not a goal right now)

This adds an abstraction to Statistic, implements it for HdrHistogram, and
adds some tests.

Part of horizontal scaling effort, split out from:
Split out from https://github.com/oschaaf/nighthawk/tree/horizontal-scaling

Signed-off-by: Otto van der Schaaf <ovanders@redhat.com>
@oschaaf oschaaf added the waiting-for-review A PR waiting for a review. label Feb 6, 2021
@mum4k mum4k requested a review from jiajunye February 8, 2021 03:52
@mum4k
Copy link
Copy Markdown
Collaborator

mum4k commented Feb 8, 2021

@jiajunye please review and assign back to me once done.

@jiajunye
Copy link
Copy Markdown
Contributor

jiajunye commented Feb 9, 2021

lgtm

@mum4k mum4k self-assigned this Feb 9, 2021
@mum4k mum4k added waiting-for-changes A PR waiting for comments to be resolved and changes to be applied. and removed waiting-for-review A PR waiting for a review. labels Feb 9, 2021
Signed-off-by: Otto van der Schaaf <ovanders@redhat.com>
@oschaaf oschaaf added waiting-for-review A PR waiting for a review. and removed waiting-for-changes A PR waiting for comments to be resolved and changes to be applied. labels Feb 9, 2021
@mum4k mum4k merged commit 10b2a8e into envoyproxy:main Feb 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

waiting-for-review A PR waiting for a review.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants