Ceph » Orchestrator

description: rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start
2-ops/deploy-raw}

/a/lflores-2026-01-21_20:56:39-rados-main-distro-default-trial/11934

2026-01-22T01:15:07.861 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/232610b9-f72f-11f0-9367-d404e6e7d460/mon.trial031/config
2026-01-22T01:15:08.096 INFO:teuthology.orchestra.run.trial031.stdout:
2026-01-22T01:15:08.237 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":26,"num_osds":6,"num_up_osds":6,"osd_up_since":1769044344,"num_in_osds":6,"osd_in_since":1769044328,"num_remapped_pgs":0}
2026-01-22T01:15:08.663 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Jan 22 01:15:08 trial031 ceph-mon[17979]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail
2026-01-22T01:15:08.663 INFO:journalctl@ceph.mon.trial031.trial031.stdout:Jan 22 01:15:08 trial031 ceph-mon[17979]: from='client.? 10.20.193.31:0/4011274930' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch
2026-01-22T01:15:08.774 INFO:journalctl@ceph.mon.trial096.trial096.stdout:Jan 22 01:15:08 trial096 ceph-mon[24667]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail
2026-01-22T01:15:08.774 INFO:journalctl@ceph.mon.trial096.trial096.stdout:Jan 22 01:15:08 trial096 ceph-mon[24667]: from='client.? 10.20.193.31:0/4011274930' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch
2026-01-22T01:15:09.238 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:20763e3b00eca4f0dd8e8ba26cc85db51c13d48d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 232610b9-f72f-11f0-9367-d404e6e7d460 -- ceph osd stat -f json
2026-01-22T01:15:09.495 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/232610b9-f72f-11f0-9367-d404e6e7d460/mon.trial031/config
2026-01-22T01:15:09.727 INFO:teuthology.orchestra.run.trial031.stdout:
2026-01-22T01:15:09.868 INFO:teuthology.orchestra.run.trial031.stdout:{"epoch":26,"num_osds":6,"num_up_osds":6,"osd_up_since":1769044344,"num_in_osds":6,"osd_in_since":1769044328,"num_remapped_pgs":0}
2026-01-22T01:15:09.868 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f3df5a3a3153828dd8c0051ee630419067f719ee/teuthology/contextutil.py", line 30, in nested
    vars.append(enter())
                ^^^^^^^
  File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__
    return next(self.gen)
           ^^^^^^^^^^^^^^
  File "/home/teuthworker/src/github.com_ceph_ceph_627d6cb11df8056dbdf27d04fd5d9340a2368826/qa/tasks/cephadm.py", line 1120, in ceph_osds
    while proceed():
          ^^^^^^^^^
  File "/home/teuthworker/src/git.ceph.com_teuthology_f3df5a3a3153828dd8c0051ee630419067f719ee/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (120) after waiting for 120 seconds
2026-01-22T01:15:09.871 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring
2026-01-22T01:15:09.898 DEBUG:teuthology.orchestra.run.trial096:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring
2026-01-22T01:15:09.928 INFO:tasks.cephadm:Disabling cephadm mgr module
2026-01-22T01:15:09.928 DEBUG:teuthology.orchestra.run.trial031:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:20763e3b00eca4f0dd8e8ba26cc85db51c13d48d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 232610b9-f72f-11f0-9367-d404e6e7d460 -- ceph mgr module disable cephadm
2026-01-22T01:15:10.192 INFO:teuthology.orchestra.run.trial031.stderr:Inferring config /var/lib/ceph/232610b9-f72f-11f0-9367-d404e6e7d460/mon.trial031/config
2026-01-22T01:15:10.210 INFO:teuthology.orchestra.run.trial031.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory
2026-01-22T01:15:10.228 DEBUG:teuthology.orchestra.run:got remote process result: 125