Project

General

Profile

Actions

Bug #71816

open

Failed to write to /dev/nvme-fabrics: Invalid argument

Added by Shraddha Agrawal 9 months ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Backport:
tentacle
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Tags (freeform):
Merge Commit:
Fixed In:
Released In:
Upkeep Timestamp:

Description

/a/yuriw-2025-06-19_19:29:56-rados-wip-yuri11-testing-2025-06-19-0935-distro-default-smithi/8337258

Also observed in the nightly run: https://pulpito.ceph.com/teuthology-2025-06-22_20:00:20-rados-main-distro-default-smithi/8340469/

Error in scrape.log:

Failure: Command failed on smithi079 with status 234: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'

Error in teuthology.log:

2025-06-19T21:15:17.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn
2025-06-19T21:15:17.650 INFO:teuthology.orchestra.run.smithi079.stdout:1
2025-06-19T21:15:17.679 INFO:teuthology.orchestra.run.smithi079.stdout:/dev/vg_nvme/lv_11
2025-06-19T21:15:17.698 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to write to /dev/nvme-fabrics: Invalid argument
2025-06-19T21:15:17.699 DEBUG:teuthology.orchestra.run:got remote process result: 234

It looks pretty similar to this earlier resolved issue: https://tracker.ceph.com/issues/67684


Related issues 1 (1 open0 closed)

Related to Orchestrator - Bug #73823: orch/cephadm: nvme-loop task fails on rocky 10Pending Backport

Actions
Actions #1

Updated by Laura Flores 9 months ago

/a/yuriw-2025-06-28_18:55:21-rados-wip-yuri-testing-2025-06-28-0812-distro-default-smithi/8355273

Actions #2

Updated by Laura Flores about 2 months ago

  • Related to Bug #73823: orch/cephadm: nvme-loop task fails on rocky 10 added
Actions #3

Updated by Nitzan Mordechai about 2 months ago

/a/nmordech-2026-02-04_08:35:27-rados:cephadm-wip-rocky10-branch-of-the-day-2026-02-03-1770151121-distro-default-trial/
['34069', '34059', '34062', '34056']

Actions #4

Updated by Laura Flores about 1 month ago ยท Edited

/a/yaarit-2026-02-05_17:05:15-rados:cephadm-wip-rocky10-branch-of-the-day-2026-02-03-1770151121-distro-default-trial
['37008', '37012', '36996', '37010', '37004', '36998']

Actions

Also available in: Atom PDF