-
Notifications
You must be signed in to change notification settings - Fork 4k
ARROW-16638: [Go][Parquet] Fix boolean column skip #13221
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
|
| // buf is large enough to hold values, but not to hold def and rep lvls; use nil for them | ||
| vals, _, err := cr.ReadBatch(batch, | ||
| *(*[]bool)(unsafe.Pointer(&buf)), | ||
| arrow.Int16Traits.CastFromBytes(buf), | ||
| arrow.Int16Traits.CastFromBytes(buf)) | ||
| nil, | ||
| nil) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please update the corresponding .tmpl file so that future calls to go generate don't clobber this. Otherwise this LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done, thank you!
zeroshade
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
![]()
|
Thanks @mdepero! |
|
Benchmark runs are scheduled for baseline = 7adda73 and contender = 5994fd8. 5994fd8 is a master commit associated with this PR. Results will be available as each benchmark for each run completes. |
Uses
nilfordefLvlsandrepLvlswhen skipping boolean values, since the scratch buffer allocated for n boolean values when skipping is not large enough to hold n def and rep levels, resulting in an out of bounds panic when skipping too many rows.