Project

General

Profile

Actions
Copy link

Bug #68529

open

quincy: kclient mount on ubuntu 20.04 fails with ms_mode=legacy

Added by Venky Shankar over 1 year ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Tags (freeform):
Merge Commit:
Fixed In:
Released In:
Upkeep Timestamp:

Description

/a/xiubli-2024-08-13_04:29:48-fs-wip-xiubli-testing-20240812.103236-quincy-distro-default-smithi/7850646

The branch has PR https://github.com/ceph/ceph/pull/59037 which works around the unavailability of centos8 in ceph-ci but switching to ubuntu (20.04 for quincy). Please find the discussion here: https://github.com/ceph/ceph/pull/59037#issuecomment-2301187197

Essentially, the ubuntu 20.04 stock kernel does not have the following commit:

commit 00498b994113a871a556f7ff24a4cf8a00611700
Author: Ilya Dryomov <idryomov@gmail.com>
Date:   Thu Nov 19 16:04:58 2020 +0100

    libceph: introduce connection modes and ms_mode option

    msgr2 supports two connection modes: crc (plain) and secure (on-wire
    encryption).  Connection mode is picked by server based on input from
    client.

    Introduce ms_mode option:

      ms_mode=legacy        - msgr1 (default)
      ms_mode=crc           - crc mode, if denied fail
      ms_mode=secure        - secure mode, if denied fail
      ms_mode=prefer-crc    - crc mode, if denied agree to secure mode
      ms_mode=prefer-secure - secure mode, if denied agree to crc mode

    ms_mode affects all connections, we don't separate connections to mons
    like it's done in userspace with ms_client_mode vs ms_mon_client_mode.

    For now the default is legacy, to be flipped to prefer-crc after some
    time.

    Signed-off-by: Ilya Dryomov <idryomov@gmail.com>

So, this mount failures is expected in Ubuntu 20.04 with mds_mode=legacy.

Actions
Copy link
 #1

Updated by Venky Shankar over 1 year ago

Same issue with ms_mode=secure. See: https://pulpito.ceph.com/xiubli-2024-08-13_04:29:48-fs-wip-xiubli-testing-20240812.103236-quincy-distro-default-smithi/7850750/

2024-08-13T06:53:21.013031+00:00 smithi003 kernel: [  308.011343] SGI XFS with ACLs, security attributes, realtime, no debug enabled
2024-08-13T06:53:21.017028+00:00 smithi003 kernel: [  308.014466] XFS (dm-4): Mounting V4 Filesystem
2024-08-13T06:53:21.021056+00:00 smithi003 kernel: [  308.020274] XFS (dm-4): Ending clean mount
2024-08-13T06:53:21.021065+00:00 smithi003 kernel: [  308.020301] xfs filesystem being mounted at /var/lib/ceph supports timestamps until 2038 (0x7fffffff)
2024-08-13T06:58:26.057058+00:00 smithi003 kernel: [  613.059762] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation
2024-08-13T07:18:17.901037+00:00 smithi003 kernel: [ 1804.920124] IPv6: ADDRCONF(NETDEV_CHANGE): brx.0: link becomes ready
2024-08-13T07:18:17.901046+00:00 smithi003 kernel: [ 1804.920219] IPv6: ADDRCONF(NETDEV_CHANGE): veth0: link becomes ready
2024-08-13T07:18:17.913063+00:00 smithi003 kernel: [ 1804.932103] ceph-brx: port 1(brx.0) entered blocking state
2024-08-13T07:18:17.913076+00:00 smithi003 kernel: [ 1804.932105] ceph-brx: port 1(brx.0) entered disabled state
2024-08-13T07:18:17.913078+00:00 smithi003 kernel: [ 1804.932224] device brx.0 entered promiscuous mode
2024-08-13T07:18:17.913079+00:00 smithi003 kernel: [ 1804.932291] ceph-brx: port 1(brx.0) entered blocking state
2024-08-13T07:18:17.913080+00:00 smithi003 kernel: [ 1804.932293] ceph-brx: port 1(brx.0) entered forwarding state
2024-08-13T07:18:18.061068+00:00 smithi003 kernel: [ 1805.081297] FS-Cache: Loaded
2024-08-13T07:18:18.077042+00:00 smithi003 kernel: [ 1805.098512] Key type ceph registered
2024-08-13T07:18:18.077058+00:00 smithi003 kernel: [ 1805.098703] libceph: loaded (mon/osd proto 15/24)
2024-08-13T07:18:18.097044+00:00 smithi003 kernel: [ 1805.117010] FS-Cache: Netfs 'ceph' registered for caching
2024-08-13T07:18:18.097061+00:00 smithi003 kernel: [ 1805.117017] ceph: loaded (mds proto 32)
2024-08-13T07:18:18.109062+00:00 smithi003 kernel: [ 1805.123751] libceph: bad option at 'ms_mode=secure'
Actions
Copy link

Also available in: Atom PDF