Skip to content

StructArrayReader Cannot Handle Nested Lists #1651

@tustvold

Description

@tustvold

Describe the bug

When reading the parquet file provided by @kesavkolla here the reader bails out with "Not all children array length are the same".

Interestingly if you just project column 32 i.e.

let mut reader = reader.get_record_reader_by_columns(vec![32], 1024).unwrap();

You get ParquetError("Arrow: item_reader rep levels are None.")

If you project 31 and 32 you get the above error.

To Reproduce

Run the test on the provided file

Expected behavior

The file should be read correctly

Metadata

Metadata

Assignees

Labels

bugparquetChanges to the parquet crate

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions