Project

General

Profile

Actions
Copy link

Bug #73566

open

Test failure: test_with_health_warn_on_1_mds_with_2_active_MDSs (tasks.cephfs.test_admin.TestMDSFail)

Added by Jos Collin 5 months ago. Updated 5 months ago.

Status:
Triaged
Priority:
Normal
Assignee:
Rishabh Dave
Category:
Testing
Target version:
Ceph - v21.0.0
% Done:

0%

Source:
Q/A
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Tags (freeform):
Merge Commit:
Fixed In:
Released In:
Upkeep Timestamp:

Description

https://pulpito.ceph.com/jcollin-2025-10-10_05:57:09-fs:functional-wip-jcollin-testing-20251010.002614-squid-distro-default-smithi/8545211/

test_with_health_warn_on_1_mds_with_2_active_MDSs fails with

2025-10-10T22:12:59.590 INFO:tasks.cephfs_test_runner:Test when a CephFS has 2 active MDSs and one of them have either ... ERROR
2025-10-10T22:12:59.591 INFO:tasks.cephfs_test_runner:
2025-10-10T22:12:59.591 INFO:tasks.cephfs_test_runner:======================================================================
2025-10-10T22:12:59.591 INFO:tasks.cephfs_test_runner:ERROR: test_with_health_warn_on_1_mds_with_2_active_MDSs (tasks.cephfs.test_admin.TestMDSFail)
2025-10-10T22:12:59.591 INFO:tasks.cephfs_test_runner:Test when a CephFS has 2 active MDSs and one of them have either
2025-10-10T22:12:59.591 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_104ea276496eeef39137386037044178d6f67f79/qa/tasks/cephfs/test_admin.py", line 2645, in test_with_health_warn_on_1_mds_with_2_active_MDSs
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    self.run_ceph_cmd(f'mds fail {mds1_id}')
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_104ea276496eeef39137386037044178d6f67f79/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    return self.mon_manager.run_cluster_cmd(**kwargs)
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_104ea276496eeef39137386037044178d6f67f79/qa/tasks/ceph_manager.py", line 1635, in run_cluster_cmd
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    return self.controller.run(**kwargs)
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_78c036dc9ad59cb33807dc7f21fda50de2f348d2/teuthology/orchestra/remote.py", line 575, in run
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_78c036dc9ad59cb33807dc7f21fda50de2f348d2/teuthology/orchestra/run.py", line 461, in run
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    r.wait()
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_78c036dc9ad59cb33807dc7f21fda50de2f348d2/teuthology/orchestra/run.py", line 161, in wait
2025-10-10T22:12:59.592 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_78c036dc9ad59cb33807dc7f21fda50de2f348d2/teuthology/orchestra/run.py", line 181, in _raise_for_status
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi119 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c'
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:Ran 76 tests in 4370.484s
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:
2025-10-10T22:12:59.593 INFO:tasks.cephfs_test_runner:FAILED (errors=1)

in squid QA.

Actions
Copy link
 #1

Updated by Venky Shankar 5 months ago

  • Status changed from New to Need More Info

Jos, I believe there is an existing tracker for this. Please refer run wiki.

Actions
Copy link
 #2

Updated by Jos Collin 5 months ago

  • Description updated (diff)
Actions
Copy link
 #3

Updated by Jos Collin 5 months ago

  • Status changed from Need More Info to New

Venky Shankar wrote in #note-1:

Jos, I believe there is an existing tracker for this. Please refer run wiki.

Yes in tentacle. But the backtrace seems different from this one.

Actions
Copy link
 #4

Updated by Venky Shankar 5 months ago

  • Status changed from New to Triaged
  • Assignee set to Rishabh Dave
  • Target version set to v21.0.0
  • Source set to Q/A

Rishabh, PTAL.

Actions
Copy link

Also available in: Atom PDF