Skip to content

Fix memcheck error found in PARQUET_TEST#13585

Closed
etseidl wants to merge 2 commits intorapidsai:branch-23.08from
etseidl:fix_parquet_memcheck
Closed

Fix memcheck error found in PARQUET_TEST#13585
etseidl wants to merge 2 commits intorapidsai:branch-23.08from
etseidl:fix_parquet_memcheck

Conversation

@etseidl
Copy link
Copy Markdown
Contributor

@etseidl etseidl commented Jun 15, 2023

Description

Memcheck found invalid memory reads in the Parquet reader. The read overruns were caused by reading beyond the end of misaligned buffers during copy operations such as this. This PR adds padding to the end of buffers used to store column chunk data to allow these copies to succeed without reading unallocated memory.

Closes #13571

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@etseidl etseidl requested a review from a team as a code owner June 15, 2023 23:30
@etseidl etseidl requested review from robertmaynard and vyasr June 15, 2023 23:30
@rapids-bot
Copy link
Copy Markdown
Contributor

rapids-bot bot commented Jun 15, 2023

Pull requests from external contributors require approval from a rapidsai organization member with write permissions or greater before CI can begin.

@github-actions github-actions bot added the libcudf Affects libcudf (C++/CUDA) code. label Jun 15, 2023
@ttnghia
Copy link
Copy Markdown
Contributor

ttnghia commented Jun 16, 2023

Sorry I already have a solution to fix this along with other issues. Please see #13586.

@etseidl etseidl closed this Jun 16, 2023
@etseidl etseidl deleted the fix_parquet_memcheck branch June 16, 2023 01:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

libcudf Affects libcudf (C++/CUDA) code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Invalid memory read in cudf::io::parquet::gpu::gpuDecodePageData

2 participants