Project

General

Profile

Actions

Bug #75357

closed

Rocky10 - smoke/basic: CephFS kernel mount fails

Added by Laura Flores 15 days ago. Updated 4 days ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Tags (freeform):
Merge Commit:
Fixed In:
Released In:
Upkeep Timestamp:
Tags:

Description

Seeing several possible root causes:
1. kernel does not support v2 syntax
2. no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized

/a/yuriw-2026-03-04_22:27:22-smoke-wip-rocky10-branch-of-the-day-2026-03-04-1772633736-distro-default-trial/83970

2026-03-05T12:43:28.210 DEBUG:teuthology.orchestra.run.trial106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback
2026-03-05T12:43:28.270 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback
2026-03-05T12:43:28.271 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes".
2026-03-05T12:43:28.302 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes".
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:3300,10.20.193.105:3300,10.20.193.105:3301" 
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with new device syntax: 0@4e0c58e5-78ea-4afe-a37e-ea0c145857db.cephfs=/
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=10.20.193.69:3300/10.20.193.105:3300/10.20.193.105:3301" will pass to kernel
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: v2 mount support check returned 2
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: kernel does not support v2 syntax
2026-03-05T12:43:28.303 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: switching to using v1 address with old syntax
2026-03-05T12:43:30.160 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:43:30.160 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:43:30.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:43:30.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:43:30.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:43:30.164 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:43:43.093 DEBUG:teuthology.orchestra.run.trial069:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:43:43.095 DEBUG:teuthology.orchestra.run.trial105:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:43:43.096 DEBUG:teuthology.orchestra.run.trial106:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:44:00.161 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:44:00.161 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:44:00.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:44:00.162 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:44:00.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:scanning for idle connections..
2026-03-05T12:44:00.163 INFO:tasks.ceph.mgr.y.trial105.stderr:INFO:mgr_util:cleaning up connections: []
2026-03-05T12:44:13.108 DEBUG:teuthology.orchestra.run.trial069:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:44:13.111 DEBUG:teuthology.orchestra.run.trial105:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:44:13.113 DEBUG:teuthology.orchestra.run.trial106:> sudo logrotate /etc/logrotate.d/ceph-test.conf
2026-03-05T12:44:29.487 INFO:teuthology.orchestra.run.trial106.stderr:mount error: no mds (Metadata Server) is up. The cluster might be laggy, or you may not be authorized
2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback
2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes".
2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:3300,10.20.193.105:3300,10.20.193.105:3301" 
2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with new device syntax: 0@4e0c58e5-78ea-4afe-a37e-ea0c145857db.cephfs=/
2026-03-05T12:44:29.488 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=10.20.193.69:3300/10.20.193.105:3300/10.20.193.105:3301" will pass to kernel
2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: v2 mount support check returned 2
2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: kernel does not support v2 syntax
2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: switching to using v1 address with old syntax
2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: resolved to: "10.20.193.69:6789,10.20.193.105:6789,10.20.193.105:6790" 
2026-03-05T12:44:29.489 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: trying mount with old device syntax: 10.20.193.69:6789,10.20.193.105:6789,10.20.193.105:6790:/
2026-03-05T12:44:29.490 INFO:teuthology.orchestra.run.trial106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4e0c58e5-78ea-4afe-a37e-ea0c145857db" will pass to kernel
2026-03-05T12:44:29.492 DEBUG:teuthology.orchestra.run:got remote process result: 32
2026-03-05T12:44:29.492 INFO:tasks.cephfs.kernel_mount:mount command failed

As this was found during the Rocky10 runs, and this appears to be a new issue, we should rule out that it's in any way related to those changes.


Related issues 3 (3 open0 closed)

Related to Ceph QA - QA Run #75339: wip-rocky10-branch-of-the-day-2026-03-04-1772633736QA TestingYaarit HatukaActions
Related to CephFS - Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds Fix Under Review

Actions
Is duplicate of CephFS - Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds Fix Under Review

Actions
Actions #1

Updated by Laura Flores 15 days ago

  • Tags set to rocky10
  • Subject changed from smoke/basic: CephFS kernel mount fails to Rocky10 - smoke/basic: CephFS kernel mount fails
  • Description updated (diff)
Actions #2

Updated by Laura Flores 15 days ago

  • Related to QA Run #75339: wip-rocky10-branch-of-the-day-2026-03-04-1772633736 added
Actions #3

Updated by Laura Flores 14 days ago

/a/yuriw-2026-03-05_23:35:09-smoke-wip-rocky10-branch-of-the-day-2026-03-04-1772633736-distro-default-trial/90038

Actions #4

Updated by Nitzan Mordechai 12 days ago

/a/yuriw-2026-03-07_15:37:31-smoke-wip-rocky10-branch-of-the-day-2026-03-06-1772840606-distro-default-trial/
2 jobs: ['92905', '92907']

Actions #5

Updated by Venky Shankar 11 days ago ยท Edited

This is likely related to https://tracker.ceph.com/issues/75355 (which is an issue with fuse mount). The underlying issue seems to be the same as mentioned https://tracker.ceph.com/issues/75355#note-6.

Actions #6

Updated by Venky Shankar 11 days ago

  • Related to Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds added
Actions #7

Updated by Nitzan Mordechai 10 days ago

/a/yuriw-2026-03-09_20:51:09-smoke-wip-rocky10-branch-of-the-day-2026-03-09-1773078259-distro-default-trial/95310/

Actions #8

Updated by Venky Shankar 4 days ago

  • Status changed from New to Duplicate

Dup of #75355

Actions #9

Updated by Venky Shankar 4 days ago

  • Is duplicate of Bug #75355: Rocky10 - smoke/basic: RuntimeError: Fuse mount failed to populate/sys/ after 31 seconds added
Actions

Also available in: Atom PDF