Project

General

Profile

Actions
Copy link

QA Run #74070

open

wip-rocky10-branch-of-the-day-2025-12-01-1764638786

Added by Nitzan Mordechai 4 months ago. Updated 4 months ago.

Status:
QA Testing
Priority:
Normal
Assignee:
Nitzan Mordechai
Shaman Build:
wip-rocky10-branch-of-the-day-2025-12-01-1764638786/
QA Runs:
wip-rocky10-branch-of-the-day-2025-12-01-1764638786
QA Release:
main
Git Branch:
ceph-ci/commits/wip-rocky10-branch-of-the-day-2025-12-01-1764638786
Tags (freeform):

Description

Include ceph.git PRs:
https://github.com/ceph/ceph/pull/66055 – adds rocky 10 to distro matrix
https://github.com/ceph/ceph/pull/66240 – fixes for ceph-mgr on python 3.12
https://github.com/ceph/ceph/pull/66155 – fix for egrep change on rocky 10
https://github.com/ceph/ceph/pull/66069 – support r10 as a container base
https://github.com/ceph/ceph/pull/66171 – support distro-suffix to specify r10 containers for cephadm
https://github.com/ceph/ceph/pull/66244 – run modules in main interpreter by default
https://github.com/ceph/ceph/pull/66223 – fix python3-cmd2 dependency
https://github.com/ceph/ceph/pull/66232 – add Rocky Linux support to librados tests
https://github.com/ceph/ceph/pull/66396 - neorados: specify alignments for aligned_storage
https://github.com/ceph/ceph/pull/66467 – pybind/mgr: update modules to use independent CLICommand subtypes with distinct COMMAND attributes

Actions
Copy link
 #1

Updated by Nitzan Mordechai 4 months ago

  • QA Runs changed from nmordech-2025-12-03_06:59:35-rados-wip-rocky10-branch-of-the-day-2025-12-01-1764638786-distro-default-smithi/ to wip-rocky10-branch-of-the-day-2025-12-01-1764638786
Actions
Copy link
 #2

Updated by Nitzan Mordechai 4 months ago · Edited

related issue:
Jobid: 8638576

Crash: Test failure: test_file_sd_command (tasks.mgr.test_prometheus.TestPrometheus)
ceph version 20.3.0-4312-gbf0bf4bb (bf0bf4bb2ea954f34bf0e12de398316d07bef0e6) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe3f4cff520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: /lib/x86_64-linux-gnu/libc.so.6(+0x2871b) [0x7fe3f4ce571b]
 6: /lib/x86_64-linux-gnu/libc.so.6(+0x39e96) [0x7fe3f4cf6e96]
 7: ceph-mgr(+0x163b21) [0x55e31ca20b21]
 8: (ActivePyModules::get_typed_config(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const+0x48) [0x55e31c9b1748]
 9: ceph-mgr(+0x10fd52) [0x55e31c9ccd52]
 10: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xea54e) [0x7fe3f5e3f54e]
 11: _PyEval_EvalFrameDefault()
 12: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 13: _PyEval_EvalFrameDefault()
 14: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 15: _PyEval_EvalFrameDefault()
 16: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 17: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xe247c) [0x7fe3f5e3747c]
 18: (ActivePyModule::dispatch_remote(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::span<std::byte const, 18446744073709551615ul>, std::span<std::byte const, 18446744073709551615ul>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0x16d) [0x55e31c9a132d]
 19: ceph-mgr(+0x118fa1) [0x55e31c9d5fa1]
 20: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xea54e) [0x7fe3f5e3f54e]
 21: _PyEval_EvalFrameDefault()
 22: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 23: _PyEval_EvalFrameDefault()
 24: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 25: _PyEval_EvalFrameDefault()
 26: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 27: _PyEval_EvalFrameDefault()
 28: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 29: _PyEval_EvalFrameDefault()
 30: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7fe3f5f174df]
 31: _PyEval_EvalFrameDefault()

another failure:
jobid: 8638728 ,8638604, 8638670, 8638690

    -1> 2025-12-03T10:21:36.090+0000 7fee7b39c640  0 [volumes DEBUG root] refreshing mgr for ef386917-d85f-4b42-8560-21f0db432eac (PG autoscaler increasing pool 1 PGs from 1 to 32) at 0.000000
     0> 2025-12-03T10:21:36.094+0000 7fee7b39c640 -1 *** Caught signal (Aborted) **
 in thread 7fee7b39c640 thread_name:pg_autoscaler

 ceph version 20.3.0-4312-gbf0bf4bb (bf0bf4bb2ea954f34bf0e12de398316d07bef0e6) tentacle (dev - None)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7feed6f01520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: /lib/x86_64-linux-gnu/libc.so.6(+0x2871b) [0x7feed6ee771b]
 6: /lib/x86_64-linux-gnu/libc.so.6(+0x39e96) [0x7feed6ef8e96]
 7: ceph-mgr(+0x163b21) [0x557b2e449b21]
 8: ceph-mgr(+0x1149ea) [0x557b2e3fa9ea]
 9: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xea54e) [0x7feed804154e]
 10: _PyEval_EvalFrameDefault()
 11: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7feed81194df]
 12: _PyEval_EvalFrameDefault()
 13: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7feed81194df]
 14: _PyEval_EvalFrameDefault()
 15: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7feed81194df]
 16: _PyObject_FastCallDictTstate()
 17: _PyObject_Call_Prepend()
 18: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x14f10e) [0x7feed80a610e]
 19: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x14389e) [0x7feed809a89e]
 20: _PyObject_MakeTpCall()
 21: _PyEval_EvalFrameDefault()
 22: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7feed81194df]
 23: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xe23e8) [0x7feed80393e8]
 24: PyVectorcall_Call()
 25: (ActivePyModule::dispatch_remote(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::span<std::byte const, 18446744073709551615ul>, std::span<std::byte const, 18446744073709551615ul>, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*)+0x16d) [0x557b2e3ca32d]
 26: ceph-mgr(+0x118fa1) [0x557b2e3fefa1]
 27: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xea54e) [0x7feed804154e]
 28: _PyEval_EvalFrameDefault()
 29: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0x1c24df) [0x7feed81194df]
 30: /lib/x86_64-linux-gnu/libpython3.10.so.1.0(+0xe23e8) [0x7feed80393e8]
 31: _PyEval_EvalFrameDefault()

['8638457', '8638535', '8638689', '8638461', '8638575', '8638607', '8638669'] - https://tracker.ceph.com/issues/73823 - orch/cephadm: nvme-loop task fails on rocky 10
['8638573', '8638542'] - https://tracker.ceph.com/issues/73822 - Rocky10 - rados/verify - valgrind error: MismatchedFree operator delete[](void*, unsigned long, std::align_val_t) RocksDBStore::close() RocksDBStore::~RocksDBStore()

Unrelated issues:
['8638600', '8638585'] - https://tracker.ceph.com/issues/58223 - failure on `sudo fuser -v /var/lib/dpkg/lock-frontend`
['8638547', '8638698'] - https://tracker.ceph.com/issues/73838 - LazyOmapStatsTest::wait_for_active_clean -
['8638546', '8638696'] - https://tracker.ceph.com/issues/68668 - rados/dashboard: mkfs.xfs: cannot open /dev/vg_nvme/lv_2: Device or resource busy
['8638548', '8638676', '8638592', '8638522', '8638552', '8638425'] - https://tracker.ceph.com/issues/52109 - test_cephadm.sh: Timeout('Port 8443 not free on 127.0.0.1.',)
['8638606', '8638684', '8638582', '8638421', '8638638', '8638693', '8638685', '8638428', '8638597', '8638514'] - https://tracker.ceph.com/issues/72945 - Data digests are inconsistent during scrubbing
['8638620', '8638469'] - https://tracker.ceph.com/issues/70669 - ERROR: test_list_enabled_module: cephfs resource temporarily unavailable
['8638525'] - https://tracker.ceph.com/issues/71931 - rados/test_health_warnings.sh: OSD got stuck down and never came back up

Actions
Copy link

Also available in: Atom PDF