[improve][build] Upgrade zstd version from 1.5.2-3 to 1.5.7-3 #24263
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
|
Pulsar doesn't seem to package zstd-jni in the Pulsar distribution directly since the LICENSE files didn't require an update. I guess this library is used by some Pulsar IO connector? |
lhotari
approved these changes
May 7, 2025
Member
lhotari
left a comment
There was a problem hiding this comment.
LGTM, although this has a minor impact on Pulsar (not included in Pulsar distribution's main libraries)
dao-jun
approved these changes
May 7, 2025
liangyepianzhou
approved these changes
May 7, 2025
Member
Author
|
/pulsarbot run-failure-checks |
Member
@StevenLuMT Pulsar CI is currently broken. SchemaTest.testPendingQueueSizeIfIncompatible fails consistently. I'm disabling that in #24261 |
Member
Author
Got it,Thanks @lhotari |
Contributor
|
I think it's probably not used anymore, since we switched to java implementation of ZStd few years ago |
Member
Author
@merlimat Good suggestion. I think zstd-jni can be explained and upgraded. But to solve the fundamental problem, I will submit a PR for commons-compress 
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #24263 +/- ##
============================================
+ Coverage 73.57% 74.26% +0.69%
+ Complexity 32624 32611 -13
============================================
Files 1877 1866 -11
Lines 139502 145048 +5546
Branches 15299 16579 +1280
============================================
+ Hits 102638 107727 +5089
+ Misses 28908 28798 -110
- Partials 7956 8523 +567
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
lhotari
pushed a commit
that referenced
this pull request
May 9, 2025
### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34)
lhotari
pushed a commit
that referenced
this pull request
May 9, 2025
### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34)
lhotari
pushed a commit
that referenced
this pull request
May 9, 2025
### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 14, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit a868339)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 14, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit 6b762c2)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 14, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit a868339)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 14, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit 6b762c2)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 15, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit 6b762c2)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 15, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit 6b762c2)
manas-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 15, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit a868339)
srinath-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 16, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit 6b762c2)
srinath-ctds
pushed a commit
to datastax/pulsar
that referenced
this pull request
May 18, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34) (cherry picked from commit a868339)
nodece
pushed a commit
to ascentstream/pulsar
that referenced
this pull request
May 28, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3 (cherry picked from commit 8289e34)
KannarFr
pushed a commit
to CleverCloud/pulsar
that referenced
this pull request
Sep 22, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3
walkinggo
pushed a commit
to walkinggo/pulsar
that referenced
this pull request
Oct 8, 2025
…#24263) ### Motivation [zstd](https://github.com/facebook/zstd/releases/tag/v1.5.7) would be useful to have zstd upgraded to latest version,the new version brings many improvements: 1. Enhanced Compression Speed for Small Data Blocks 2. Substantial --patch-from improvements 3. Compression ratio improvements for large files 4. Command-Line Interface Updates See release notes for details: - [zstd v1.5.7 release notes](https://github.com/facebook/zstd/releases/tag/v1.5.7) - [zstd-jni v1.5.7-3 release notes](https://github.com/luben/zstd-jni/releases/tag/v1.5.7-3) ### Modifications Upgrade zstd version from 1.5.2-3 to 1.5.7-3
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
zstd would be useful to have zstd upgraded to latest version,the new version brings many improvements:
See release notes for details:
Modifications
Upgrade zstd version from 1.5.2-3 to 1.5.7-3
Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:
If the box was checked, please highlight the changes
Documentation
Check the box below or label this PR directly.
Need to update docs?
docdoc-requireddoc-not-neededdoc-completeMatching PR in forked repository
PR in forked repository: StevenLuMT#12