Skip to content

deps: unpin AWS dependencies and add workaround for S3 compatibility#9844

Merged
zekker6 merged 1 commit intomasterfrom
deps/update-aws-libs
Oct 10, 2025
Merged

deps: unpin AWS dependencies and add workaround for S3 compatibility#9844
zekker6 merged 1 commit intomasterfrom
deps/update-aws-libs

Conversation

@zekker6
Copy link
Copy Markdown
Member

@zekker6 zekker6 commented Oct 9, 2025

Updates:

  • unpin AWS dependencies and run make vendor-update
  • add config options to enable checksums only if required by storage in order to preserve backwards compatibility

Related issues:

Tested with: AWS S3, self-hosted MinIO, Linode object storage as it was failing previously with multi-part uploads (reported here - #8630 (comment)).
An updated library allows (PR with the fix) overriding multi-part upload configurations so that compatibility can be preserved.

Note before merge: this PR targets another branch with an updated Go version since VictoriaLogs updated requirements to Go version and make vendor-update was failing due to version mismatch. Base for this PR will be moved to master once current base branch will be merged into master.

go.mod Outdated
github.com/Azure/azure-sdk-for-go/sdk/azidentity v1.13.0
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob v1.6.2
github.com/VictoriaMetrics/VictoriaLogs v0.0.0-20250728123024-98593029b5aa
github.com/VictoriaMetrics/VictoriaLogs v1.36.1
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should use commit as the version according to contributing doc.

For VictoriaMetrics packages, use go get <dependency>@canonical_commit_hash. Finally, run go mod tidy and go mod vendor to update go.mod, go.sum, and /vendor.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess we also need to update make targets to reflect that as commit hash was overriden by make vendor-update.
Reverting this manually in the meantime

@zekker6 zekker6 force-pushed the deps/update-aws-libs branch from d6e64a3 to 896905a Compare October 9, 2025 12:35
Base automatically changed from deps/update-go to master October 9, 2025 12:53
@zekker6 zekker6 force-pushed the deps/update-aws-libs branch from 896905a to 09f1916 Compare October 9, 2025 12:54
Copy link
Copy Markdown
Contributor

@f41gh7 f41gh7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

- unpin AWS dependencies and run `make vendor-update`
- add config options to enable checksums only if required by storage

Related issues:
- #9748
- #8622

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
@zekker6 zekker6 force-pushed the deps/update-aws-libs branch from 09f1916 to 812e754 Compare October 9, 2025 13:49
@zekker6 zekker6 merged commit 0eb4657 into master Oct 10, 2025
18 checks passed
@zekker6 zekker6 deleted the deps/update-aws-libs branch October 10, 2025 14:35
zekker6 added a commit that referenced this pull request Oct 10, 2025
…9844)

Updates:
- unpin AWS dependencies and run `make vendor-update`
- add config options to enable checksums only if required by storage in
order to preserve backwards compatibility

Related issues:
- #9748
- #8622

Tested with: AWS S3, self-hosted MinIO, Linode object storage as it was
failing previously with multi-part uploads (reported here -
#8630 (comment)).
An updated library allows (PR with the
fix - aws/aws-sdk-go-v2#3151) overriding
multi-part upload configurations so that compatibility can be preserved.

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants