Skip to content

[CI] Python HDFS nightly jobs are failing running Hadoop tests #41005

@raulcd

Description

@raulcd

Describe the bug, including details regarding any error messages, version, and platform.

The hdfs tests:

have been failing with:

 [ RUN      ] TestHadoopFileSystem.ConnectsAgain
24/04/04 00:51:28 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hdfsBuilderConnect(forceNewInstance=1, nn=impala, port=8020, kerbTicketCachePath=(NULL), userName=hdfs) error:
java.lang.IllegalArgumentException: java.net.UnknownHostException: impala
/arrow/cpp/src/arrow/io/hdfs_test.cc:122: Failure
Failed
'HadoopFileSystem::Connect(&conf_, &client_)' failed with IOError: HDFS connection failed
/arrow/cpp/src/arrow/io/hdfs_test.cc:130: Failure
Value of: _st.ok()
  Actual: false
Expected: true
'client_->Disconnect()' failed with IOError: HDFS hdfsFS::Disconnect failed. Detail: [errno 9] Bad file descriptor
[  FAILED  ] TestHadoopFileSystem.ConnectsAgain (657 ms)

on 13 tests:

 [  FAILED  ] 13 tests, listed below:
[  FAILED  ] TestHadoopFileSystem.ConnectsAgain
[  FAILED  ] TestHadoopFileSystem.MultipleClients
[  FAILED  ] TestHadoopFileSystem.MakeDirectory
[  FAILED  ] TestHadoopFileSystem.GetCapacityUsed
[  FAILED  ] TestHadoopFileSystem.GetPathInfo
[  FAILED  ] TestHadoopFileSystem.GetPathInfoNotExist
[  FAILED  ] TestHadoopFileSystem.AppendToFile
[  FAILED  ] TestHadoopFileSystem.ListDirectory
[  FAILED  ] TestHadoopFileSystem.ReadableMethods
[  FAILED  ] TestHadoopFileSystem.LargeFile
[  FAILED  ] TestHadoopFileSystem.RenameFile
[  FAILED  ] TestHadoopFileSystem.ChmodChown
[  FAILED  ] TestHadoopFileSystem.ThreadSafety

13 FAILED TESTS

I haven't been able to reproduce locally at the moment.

Component(s)

Continuous Integration

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions