-
Notifications
You must be signed in to change notification settings - Fork 4k
Closed
Description
For now it's not possible to write a pyarrow.Table containing a LargeListArray in parquet. The lines
from pyarrow import parquet
import pyarrow as pa
indices = [1, 2, 3]
indptr = [0, 1, 2, 3]
q = pa.lib.LargeListArray.from_arrays(indptr, indices)
table = pa.Table.from_arrays([q], names=['no'])
parquet.write_table(table, '/test')yields the error
ArrowNotImplementedError: Unhandled type for Arrow to Parquet schema conversion: large_list<item: int64>
Reporter: marc abboud
Assignee: Micah Kornfield / @emkornfield
Related issues:
- [Python] pyarrow.concat_arrays segfaults if a resulting StringArray's capacity overflows (is related to)
Note: This issue was originally created as ARROW-7731. Please see the migration documentation for further details.