Skip to content

[Go][Parquet] Allow registering new codecs for parquet #40113

@zhouyan

Description

@zhouyan

Describe the enhancement requested

Current Parquet implementation in Go does not support all codec defined in the standard, some due to licensing issues, which is fine. And the choice of implementation is also not necessarily the best for every use cases. For example, I would like to be able to use libdeflate for GZIP codec or CGO binding of ZSTD codec. Instead of updating the implementation in the main repo, I think it is better to allow user to supply their own. For example, CGO may not be suitable for all use cases and hence may not be suitable as the default implementation.

Component(s)

Go, Parquet

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions