[CI] Python HDFS nightly jobs are failing running Hadoop tests #41005
Description
Describe the bug, including details regarding any error messages, version, and platform.
The hdfs tests:
have been failing with:
[ RUN ] TestHadoopFileSystem.ConnectsAgain
24/04/04 00:51:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hdfsBuilderConnect(forceNewInstance=1, nn=impala, port=8020, kerbTicketCachePath=(NULL), userName=hdfs) error:
java.lang.IllegalArgumentException: java.net.UnknownHostException: impala
/arrow/cpp/src/arrow/io/hdfs_test.cc:122: Failure
Failed
'HadoopFileSystem::Connect(&conf_, &client_)' failed with IOError: HDFS connection failed
/arrow/cpp/src/arrow/io/hdfs_test.cc:130: Failure
Value of: _st.ok()
Actual: false
Expected: true
'client_->Disconnect()' failed with IOError: HDFS hdfsFS::Disconnect failed. Detail: [errno 9] Bad file descriptor
[ FAILED ] TestHadoopFileSystem.ConnectsAgain (657 ms)
on 13 tests:
[ FAILED ] 13 tests, listed below:
[ FAILED ] TestHadoopFileSystem.ConnectsAgain
[ FAILED ] TestHadoopFileSystem.MultipleClients
[ FAILED ] TestHadoopFileSystem.MakeDirectory
[ FAILED ] TestHadoopFileSystem.GetCapacityUsed
[ FAILED ] TestHadoopFileSystem.GetPathInfo
[ FAILED ] TestHadoopFileSystem.GetPathInfoNotExist
[ FAILED ] TestHadoopFileSystem.AppendToFile
[ FAILED ] TestHadoopFileSystem.ListDirectory
[ FAILED ] TestHadoopFileSystem.ReadableMethods
[ FAILED ] TestHadoopFileSystem.LargeFile
[ FAILED ] TestHadoopFileSystem.RenameFile
[ FAILED ] TestHadoopFileSystem.ChmodChown
[ FAILED ] TestHadoopFileSystem.ThreadSafety
13 FAILED TESTS
I haven't been able to reproduce locally at the moment.
Component(s)
Continuous Integration