Skip to content

Add util/compression package to consolidate snappy/zstd use in Prometheus.#16156

Merged
bwplotka merged 2 commits intomainfrom
compression
Mar 10, 2025
Merged

Add util/compression package to consolidate snappy/zstd use in Prometheus.#16156
bwplotka merged 2 commits intomainfrom
compression

Conversation

@bwplotka
Copy link
Member

@bwplotka bwplotka commented Mar 3, 2025

We had a bit mess on our compression uses, trying to consolidate all compressions we use in one package.

At some point we can add gzip, and potentially replace all snappy uses with this util pkg. I noticed this and kind of needed in #16046 (e.g. for my micro-benchmarks that use compressions as well).

@bwplotka bwplotka requested review from ArthurSens and bboreham March 3, 2025 14:58
@bwplotka bwplotka force-pushed the compression branch 3 times, most recently from 6c48d3a to ca21aa2 Compare March 3, 2025 16:22
@bwplotka

This comment was marked as resolved.

@bwplotka bwplotka force-pushed the compression branch 3 times, most recently from e954941 to 5755960 Compare March 4, 2025 12:00
@bwplotka

This comment was marked as resolved.

Copy link
Member

@ArthurSens ArthurSens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! I tried my best to do a very deep review, and things look correct in general :)

I noticed some extra changes unrelated to "consolidate compression in a single package", i.e., changes on wlog metrics. That was a bit too much for me today; I am not sure if you want to keep it in this same PR or do a follow-up to keep PRs with a single scope. Either way, I'll try to look at the metric changes at another moment

@bwplotka bwplotka force-pushed the compression branch 2 times, most recently from 7c60b21 to 9470c33 Compare March 7, 2025 10:00
Copy link
Member

@ArthurSens ArthurSens left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just need a rebase and LGTM

…heus.

Signed-off-by: bwplotka <bwplotka@gmail.com>

Apply suggestions from code review

Co-authored-by: Arthur Silva Sens <arthursens2005@gmail.com>
Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

tmp

Signed-off-by: bwplotka <bwplotka@gmail.com>

Addressed comments.

Signed-off-by: bwplotka <bwplotka@gmail.com>

Update util/compression/buffers.go

Co-authored-by: Arthur Silva Sens <arthursens2005@gmail.com>
Signed-off-by: Bartlomiej Plotka <bwplotka@gmail.com>

Fix lint?

Signed-off-by: bwplotka <bwplotka@gmail.com>
Signed-off-by: bwplotka <bwplotka@gmail.com>
@bwplotka bwplotka merged commit 7a7bc65 into main Mar 10, 2025
45 checks passed
@bwplotka bwplotka deleted the compression branch March 10, 2025 10:36
charleskorn added a commit to grafana/mimir that referenced this pull request Mar 21, 2025
charleskorn added a commit to grafana/mimir that referenced this pull request Mar 21, 2025
zenador pushed a commit to grafana/mimir that referenced this pull request Mar 21, 2025
* Upgrade mimir-prometheus

* Adjust tests to match new pretty printing format in prometheus/prometheus#16083

* Fix breaking change from prometheus/prometheus#16156

* Upgrade to github.com/oklog/ulid/v2 (prometheus/prometheus#16168)

* Bring in changes from prometheus/prometheus#16199

* Remove OOO native histograms flag (prometheus/prometheus#16207)

* Add changelog entries

* Ignore deprecation warning for `model.NameValidationScheme`

* Remove outdated native histogram OOO integration test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants