Skip to content

Pyiceberg 9.0 not adding files with hour(timestamp) partitions #1917

@MrDerecho

Description

@MrDerecho

Apache Iceberg version

0.9.0 (latest release)

Please describe the bug 🐞

Note: this feature still works in pyiceberg 8.1.

Currently, I cannot use the table.add_files method to add files to an iceberg table due to ValueError Cannot infer partition value from parquet metadata as there are more than one partition values for Partition Field: timestamp_hour. lower_value=1743465600155254, upper_value=1743469198047855, when I inspect the parquet metadata the stats max and min values are within an hour, the same files are able to be added using pyiceberg 8.1

Image

Willingness to contribute

  • I can contribute a fix for this bug independently
  • I would be willing to contribute a fix for this bug with guidance from the Iceberg community
  • I cannot contribute a fix for this bug at this time

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions