[CI][Java][Integration] Integration verification jobs are failing due to libarrow_cdata_jni.so not found #40716
Description
Describe the bug, including details regarding any error messages, version, and platform.
Verification integration jobs have been failing for a long time:
verify-rc-source-integration-linux-almalinux-8-amd64
verify-rc-source-integration-linux-conda-latest-amd64
verify-rc-source-integration-linux-ubuntu-20.04-amd64
verify-rc-source-integration-linux-ubuntu-22.04-amd64
verify-rc-source-integration-macos-amd64
verify-rc-source-integration-macos-conda-amd64
It seems that they have been failing since the 19th of January. The commits between the last success and the first failure are: 55afcf0...05b8f36
I suspect #39001 is the culprit.
Based on the logs:
[ERROR] StreamTest.getNextError:192 ? IllegalState error loading native libraries: java.io.FileNotFoundException: arrow_cdata_jni/x86_64/libarrow_cdata_jni.so
[ERROR] StreamTest.getSchemaError:213 ? IllegalState error loading native libraries: java.io.FileNotFoundException: arrow_cdata_jni/x86_64/libarrow_cdata_jni.so
[ERROR] StreamTest.roundtripDictionary:169->roundtrip:228 ? IllegalState error loading native libraries: java.io.FileNotFoundException: arrow_cdata_jni/x86_64/libarrow_cdata_jni.so
[ERROR] StreamTest.roundtripStrings:131->roundtrip:257->roundtrip:228 ? IllegalState error loading native libraries: java.io.FileNotFoundException: arrow_cdata_jni/x86_64/libarrow_cdata_jni.so
[ERROR] StreamTest.testRoundtripInts:94->roundtrip:257->roundtrip:228 ? IllegalState error loading native libraries: java.io.FileNotFoundException: arrow_cdata_jni/x86_64/libarrow_cdata_jni.so
Component(s)
Continuous Integration, Integration, Java