Skip to content

Adds SZ3 compression codec#83088

Merged
divanik merged 5 commits intoClickHouse:masterfrom
scanhex12:revert-83076-revert-67161-sz_attempt_2
Jul 4, 2025
Merged

Adds SZ3 compression codec#83088
divanik merged 5 commits intoClickHouse:masterfrom
scanhex12:revert-83076-revert-67161-sz_attempt_2

Conversation

@scanhex12
Copy link
Copy Markdown
Member

@scanhex12 scanhex12 commented Jul 2, 2025 •
edited by rschu1ze
Loading

This is a revert of revert #83076

Fixes #49888

This PR adds a new codec with syntax

  • CODEC(SZ3) (automatic mode) or
  • CODEC(SZ3(algorithm, error_bound_mode, error_bound)) (expert mode).

SZ3 is a lossy yet error-bound codec for columns of type Float32 and Float64. See its homepage for details. Supported values for 'algorithm' are ALGO_LORENZO_REG, ALGO_INTERP_LORENZO, and ALGO_INTERP. Supported values for errror_bound_mode are ABS, REL, PSNR and ABS_AND_REL. Argument error_bound is the maximum error and of type Float64.

Changelog category (leave one):

  • New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add SZ3 as a lossy yet error-bounded compression codec for columns of type Float32 and Float64.

@clickhouse-gh
Copy link
Copy Markdown
Contributor

clickhouse-gh bot commented Jul 2, 2025 •
edited
Loading

Workflow [PR], commit [563ffc8]

Summary: ❌

job_name test_name status info comment
Stateless tests (amd_binary, old analyzer, s3 storage, DatabaseReplicated, 2/2) failure
Logical error thrown (see clickhouse-server.log or logical_errors.txt) FAIL

@clickhouse-gh clickhouse-gh bot added pr-not-for-changelog This PR should not be mentioned in the changelog submodule changed At least one submodule changed in this PR. labels Jul 2, 2025
@scanhex12 scanhex12 marked this pull request as draft July 2, 2025 15:21
@scanhex12 scanhex12 marked this pull request as ready for review July 2, 2025 16:44
@rschu1ze rschu1ze changed the title Revert "Revert "Add SZ3 compression codec"" Adds SZ3 compression codec Jul 3, 2025
@clickhouse-gh clickhouse-gh bot added pr-feature Pull request with new product feature and removed pr-not-for-changelog This PR should not be mentioned in the changelog labels Jul 3, 2025
@scanhex12 scanhex12 enabled auto-merge July 4, 2025 08:56
@divanik
Copy link
Copy Markdown
Member

divanik commented Jul 4, 2025

Stateless tests (amd_binary, old analyzer, s3 storage, DatabaseReplicated, 2/2): #74734
Seems it doesn't related to the PR

@scanhex12 scanhex12 added this pull request to the merge queue Jul 4, 2025
@divanik divanik removed this pull request from the merge queue due to a manual request Jul 4, 2025
@divanik divanik added this pull request to the merge queue Jul 4, 2025
Merged via the queue into ClickHouse:master with commit fd1f7b8 Jul 4, 2025
235 of 239 checks passed
@robot-ch-test-poll2 robot-ch-test-poll2 added the pr-synced-to-cloud The PR is synced to the cloud repo label Jul 4, 2025
@Algunenano Algunenano mentioned this pull request Jul 24, 2025
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@rschu1ze rschu1ze rschu1ze approved these changes

Assignees

No one assigned

Labels

pr-feature Pull request with new product feature pr-synced-to-cloud The PR is synced to the cloud repo submodule changed At least one submodule changed in this PR.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Add support for SZ Compression

4 participants

@scanhex12 @divanik @rschu1ze @robot-ch-test-poll2