Skip to content

feat(go/adbc/driver/snowflake): Expose file compression options for bulk ingestion #1473

@joellubi

Description

@joellubi

As part of the updates to snowflake bulk ingestion (#1456), parquet files are compressed with configurable codec and compression level. These parameters currently cannot be changed, but we would like to specify them using Statement.SetOption().

Specifically, users should be able to set the following keys on the Snowflake Statement:

  • adbc.snowflake.rpc.ingest_compression_codec
  • adbc.snowflake.rpc.ingest_compression_level

It would be nice if a string -> Codec method could be used from the parquet library directly, so that the list of options on the Statement is automatically kept up to date with the list of supported codecs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions