Skip to content

new feature: Add more checksum support for S3 #5550

@Xuanwo

Description

@Xuanwo

Feature Description

crc64-nvme is the new crc algo that supported by s3: https://docs.aws.amazon.com/AmazonS3/latest/userguide/checking-object-integrity.html

Problem and Solution

  • CRC64-NVME (Recommended)
    • crc64-nvme is the default algo used by s3. Adding it in opendal can make sure the data we upload is correct.
  • CRC-32
  • CRC-32C
  • SHA-1
  • SHA-256
  • Also, content-md5.

Additional Context

No response

Are you willing to contribute to the development of this feature?

  • Yes, I am willing to contribute to the development of this feature.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions