Skip to content

Fix reading gzipped file in Julia 1.11 on Windows#1144

Merged
quinnj merged 3 commits intoJuliaData:mainfrom
nhz2:nz/fix-reading-compressed-csv-on-windows
Oct 19, 2024
Merged

Fix reading gzipped file in Julia 1.11 on Windows#1144
quinnj merged 3 commits intoJuliaData:mainfrom
nhz2:nz/fix-reading-compressed-csv-on-windows

Conversation

@nhz2
Copy link
Copy Markdown
Contributor

@nhz2 nhz2 commented Oct 17, 2024

Fixes #1137

On Julia 1.11 the underlying memory needs to be finalized to unmmap the file.
Ref: JuliaLang/julia#54210

@codecov
Copy link
Copy Markdown

codecov bot commented Oct 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.27%. Comparing base (57eca79) to head (c20c83b).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1144      +/-   ##
==========================================
+ Coverage   90.22%   90.27%   +0.05%     
==========================================
  Files           9        9              
  Lines        2312     2314       +2     
==========================================
+ Hits         2086     2089       +3     
+ Misses        226      225       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@nhz2
Copy link
Copy Markdown
Contributor Author

nhz2 commented Oct 19, 2024

@longemen3000 @oscarvdvelde @JakeZw This PR is ready for review now

# Ref: https://github.com/JuliaLang/julia/pull/54210
if !chunking && Sys.iswindows() && ctx.stringtype !== PosLenString
finalize(ctx.buf)
if VERSION ≥ v"1.11"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Copy Markdown
Member

@quinnj quinnj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fixes @nhz2!

@quinnj quinnj merged commit 80936af into JuliaData:main Oct 19, 2024
@nhz2 nhz2 deleted the nz/fix-reading-compressed-csv-on-windows branch October 20, 2024 01:47
quinnj pushed a commit that referenced this pull request Jan 12, 2026
* finalize memory if 1.11

* don't download busybox in test

* test windows on lts
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CSV.File failing for gzipped file in Julia 1.11-rc

2 participants