Skip to content

s3: disable content pre-upload checksums#115160

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
dt:s3-no-hash
Nov 28, 2023
Merged

s3: disable content pre-upload checksums#115160
craig[bot] merged 1 commit intocockroachdb:masterfrom
dt:s3-no-hash

Conversation

@dt
Copy link
Copy Markdown
Contributor

@dt dt commented Nov 28, 2023

We send our data over TLS so the integrity of the transport is already checked, and amazon will checksum it server-side before saving it. Additionally, all the blocks in the ssts we're uploading have their own internal checksums, so we really don't gain much from this extra checksumming.

Release note: none.
Epic: none.

@dt dt requested review from nvb and stevendanna November 28, 2023 13:41
@dt dt requested a review from a team as a code owner November 28, 2023 13:41
@blathers-crl
Copy link
Copy Markdown

blathers-crl bot commented Nov 28, 2023

It looks like your PR touches production code but doesn't add or edit any test code. Did you consider adding tests to your PR?

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

We send our data over TLS so the integrity of the transport is already checked,
and amazon will checksum it server-side before saving it. Additionally, all the
blocks in the ssts we're uploading have their own internal checksums, so we really
don't gain much from this extra checksumming.

Release note: none.
Epic: none.
@dt
Copy link
Copy Markdown
Contributor Author

dt commented Nov 28, 2023

TFTRs!

bors r+

@dt dt added backport-23.1.x PAST MAINTENANCE SUPPORT: 23.1 patch releases via ER request only backport-23.2.x PAST MAINTENANCE SUPPORT: 23.2 patch releases via ER request only labels Nov 28, 2023
@craig
Copy link
Copy Markdown
Contributor

craig bot commented Nov 28, 2023

Build succeeded:

@craig craig bot merged commit 7bb38b5 into cockroachdb:master Nov 28, 2023
@dt dt deleted the s3-no-hash branch November 28, 2023 23:57
@dt dt linked an issue Nov 29, 2023 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-23.1.x PAST MAINTENANCE SUPPORT: 23.1 patch releases via ER request only backport-23.2.x PAST MAINTENANCE SUPPORT: 23.2 patch releases via ER request only

Projects

None yet

Development

Successfully merging this pull request may close these issues.

cloud/s3: skip md5 hashing

4 participants