Upgrade Arrow C++ to 24.0.0#647
Conversation
|
The benchmark project is reliably segfaulting. I have a minimal repro here: https://github.com/adamreeve/ParquetSharp/blob/segfault-repro/SegfaultRepro/Program.cs Looks like it's related to mimalloc and only happens when writing Parquet from multiple threads (but doesn't need any concurrency). Backtrace is: DetailsThe repro works fine if setting The current mimalloc version after updating the vcpkg baseline is 3.3.1. In the previous 23.0.0 release of ParquetSharp, mimalloc 3.2.7 was used. I tested downgrading mimalloc to 3.2.7 and that works, so I think we should just pin mimalloc to the older version for now and report this upstream (ideally with a repro that just uses mimalloc directly from C++). Edit: mimalloc 3.2.8 also works so I've pinned to that. The first broken version is 3.3.0, and 3.3.2 is also broken. |
| curl -L -o /tmp/bison-${BISON_VERSION}.tar.gz https://ftp.gnu.org/gnu/bison/bison-${BISON_VERSION}.tar.gz && | ||
| tar -xf /tmp/bison-${BISON_VERSION}.tar.gz -C /tmp && | ||
| cd /tmp/bison-${BISON_VERSION} && ./configure && make && make install" |
There was a problem hiding this comment.
This is a bit slow, and we could instead use the bison-bin PyPI package (https://github.com/trim21/bison-py), but I don't think this is widely used enough that we should trust it, and it's hard to verify the wheel contents.
Maybe we should be building a docker image that we can cache instead, but that feels like it should be a separate PR.
No description provided.