Bug #75357
closedRocky10 - smoke/basic: CephFS kernel mount fails
0%
Description
Seeing several possible root causes:
1. kernel does not support v2 syntax
2. no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized
/a/yuriw-2026-03-04_22:27:22-smoke-wip-rocky10-branch-of-the-day-2026-03-04-1772633736-distro-default-trial/83970
2026-03-05T12:43:28.210 DEBUG:teuthology.orchestra.run.trial106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2026-03-05T12:43:28.270 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2026-03-05T12:43:28.271 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2026-03-05T12:43:28.302 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:3300,10.20.193.105:3300,10.20.193.105:3301" 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with new device syntax: 0@4e0c58e5-78ea-4afe-a37e-ea0c145857db.cephfs=/ 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=10.20.193.69:3300/10.20.193.105:3300/10.20.193.105:3301" will pass to kernel 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: v2 mount support check returned 2 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: kernel does not support v2 syntax 2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: switching to using v1 address with old syntax 2026-03-05T12:43:30.160 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:43:30.160 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:43:30.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:43:30.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:43:30.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:43:30.164 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:43:43.093 DEBUG:teuthology.orchestra.run.trial069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:43:43.095 DEBUG:teuthology.orchestra.run.trial105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:43:43.096 DEBUG:teuthology.orchestra.run.trial106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:44:00.161 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:44:00.161 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:44:00.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:44:00.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:44:00.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections.. 2026-03-05T12:44:00.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: [] 2026-03-05T12:44:13.108 DEBUG:teuthology.orchestra.run.trial069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:44:13.111 DEBUG:teuthology.orchestra.run.trial105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:44:13.113 DEBUG:teuthology.orchestra.run.trial106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2026-03-05T12:44:29.487 INFO:teuthology.orchestra.run.trial106.stderr:mount error: no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized 2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:3300,10.20.193.105:3300,10.20.193.105:3301" 2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with new device syntax: 0@4e0c58e5-78ea-4afe-a37e-ea0c145857db.cephfs=/ 2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=10.20.193.69:3300/10.20.193.105:3300/10.20.193.105:3301" will pass to kernel 2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: v2 mount support check returned 2 2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: kernel does not support v2 syntax 2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: switching to using v1 address with old syntax 2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:6789,10.20.193.105:6789,10.20.193.105:6790" 2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with old device syntax: 10.20.193.69:6789,10.20.193.105:6789,10.20.193.105:6790:/ 2026-03-05T12:44:29.490 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4e0c58e5-78ea-4afe-a37e-ea0c145857db" will pass to kernel 2026-03-05T12:44:29.492 DEBUG:teuthology.orchestra.run:got remote process result: 32 2026-03-05T12:44:29.492 INFO:tasks.cephfs.kernel_mount:mount command failed
As this was found during the Rocky10 runs, and this appears to be a new issue, we should rule out that it's in any way related to those changes.
Updated by Laura Flores 15 days ago
- Tags set to rocky10
- Subject changed from smoke/basic: CephFS kernel mount fails to Rocky10 - smoke/basic: CephFS kernel mount fails
- Description updated (diff)
Updated by Laura Flores 15 days ago
- Related to QA Run #75339: wip-rocky10-branch-of-the-day-2026-03-04-1772633736 added
Updated by Laura Flores 14 days ago
/a/yuriw-2026-03-05_23:35:09-smoke-wip-rocky10-branch-of-the-day-2026-03-04-1772633736-distro-default-trial/90038
Updated by Nitzan Mordechai 12 days ago
/a/yuriw-2026-03-07_15:37:31-smoke-wip-rocky10-branch-of-the-day-2026-03-06-1772840606-distro-default-trial/
2 jobs: ['92905', '92907']
Updated by Venky Shankar 11 days ago ยท Edited
This is likely related to https://tracker.ceph.com/issues/75355 (which is an issue with fuse mount). The underlying issue seems to be the same as mentioned https://tracker.ceph.com/issues/75355#note-6.
Updated by Venky Shankar 11 days ago
- Related to Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds added
Updated by Nitzan Mordechai 10 days ago
/a/yuriw-2026-03-09_20:51:09-smoke-wip-rocky10-branch-of-the-day-2026-03-09-1773078259-distro-default-trial/95310/
Updated by Venky Shankar 4 days ago
- Is duplicate of Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds added