Skip to content

[Go][Parquet] Reslicing for nullable dictionary in chunked writer is bugged #39925

@elliotmr

Description

@elliotmr

Describe the bug, including details regarding any error messages, version, and platform.

If you create a dictionary array that is marked as nullable but doesn't have any null values in it, the code executes some re-slicing logic that is faulty on line:

https://github.com/apache/arrow/blob/main/go/parquet/file/column_writer.go#L662C84-L662C99

There are 2 problems:

  1. It assumes that the underlying value array is Int32, this is not a requirement.
  2. The end of the slice needs to have the start of the slice added onto it or you will have a negative array length.

Component(s)

Go

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions