Project

General

Profile

Actions
Copy link

Bug #64927

closed

qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'"

Added by Rishabh Dave about 2 years ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Jos Collin
Category:
Administration/Usability
Target version:
Ceph - v20.0.0
% Done:

0%

Source:
Development
Backport:
quincy,reef,squid
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
cephfs-mirror
Labels (FS):
Pull request ID:
56193
Tags (freeform):
backport_processed
Merge Commit:
62eb72731aca5d403ed6239946c6ea66f3be36e7
Fixed In:
v19.3.0-3451-g62eb72731a
Released In:
v20.2.0~2488
Upkeep Timestamp:
2025-11-01T01:26:54+00:00

Description

Saw this failure occur a couple of times in recent QA run for CephFS PRs -

https://pulpito.ceph.com/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588288
https://pulpito.ceph.com/rishabh-2024-03-08_19:54:47-fs-rishabh-2024mar8-testing-default-smithi/7588301

The failure doesn't look related to any of the PRs in the batch, including the cephfs-mirror PR in the batch. According to Jos too, this unrelated to the any of these PRs and is an intermittent failure. And he knows the fix for this.

Following is the traceback from the logs -

2024-03-08T23:33:50.127 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_blocklist'
2024-03-08T23:33:50.680 INFO:tasks.cephfs_test_runner:test_cephfs_mirror_blocklist (tasks.cephfs.test_mirroring.TestMirroring) ... ERROR
2024-03-08T23:33:50.680 INFO:tasks.cephfs_test_runner:
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:======================================================================
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:ERROR: test_cephfs_mirror_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_mirroring.py", line 514, in test_cephfs_mirror_blocklist
2024-03-08T23:33:50.681 INFO:tasks.cephfs_test_runner:    rados_inst_new = self.get_mirror_rados_addr(self.primary_fs_name, self.primary_fs_id)
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_7d63482aa89628d733e298984a762389b625c761/qa/tasks/cephfs/test_mirroring.py", line 278, in get_mirror_rados_addr
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:    return res['rados_inst']
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:KeyError: 'rados_inst'
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-03-08T23:33:50.682 INFO:tasks.cephfs_test_runner:Ran 6 tests in 682.929s
2024-03-08T23:33:50.683 INFO:tasks.cephfs_test_runner:
2024-03-08T23:33:50.683 INFO:tasks.cephfs_test_runner:FAILED (errors=1)
2024-03-08T23:33:50.683 INFO:tasks.cephfs_test_runner:

Related issues 3 (0 open — 3 closed)

Copied to CephFS - Backport #66979: squid: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'"ResolvedJos CollinActions
Copied to CephFS - Backport #66980: reef: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'"ResolvedJos CollinActions
Copied to CephFS - Backport #66981: quincy: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'"ResolvedJos CollinActions
Actions
Copy link
 #1

Updated by Rishabh Dave about 2 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Jos Collin about 2 years ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 56193
Actions
Copy link
 #9

Updated by Venky Shankar over 1 year ago

  • Category set to Administration/Usability
  • Status changed from Fix Under Review to Pending Backport
  • Target version set to v20.0.0
  • Source set to Development
  • Backport set to quincy,reef,squid
Actions
Copy link
 #10

Updated by Jos Collin over 1 year ago

  • Copied to Backport #66979: squid: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'" added
Actions
Copy link
 #11

Updated by Jos Collin over 1 year ago

  • Copied to Backport #66980: reef: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'" added
Actions
Copy link
 #12

Updated by Jos Collin over 1 year ago

  • Copied to Backport #66981: quincy: qa/cephfs: test_cephfs_mirror_blocklist raises "KeyError: 'rados_inst'" added
Actions
Copy link
 #15

Updated by Upkeep Bot over 1 year ago

  • Tags (freeform) set to backport_processed
Actions
Copy link
 #16

Updated by Jos Collin over 1 year ago

  • Status changed from Pending Backport to Resolved
Actions
Copy link
 #17

Updated by Upkeep Bot 9 months ago

  • Merge Commit set to 62eb72731aca5d403ed6239946c6ea66f3be36e7
  • Fixed In set to v19.3.0-3451-g62eb72731ac
  • Upkeep Timestamp set to 2025-07-02T03:31:35+00:00
Actions
Copy link
 #18

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v19.3.0-3451-g62eb72731ac to v19.3.0-3451-g62eb72731a
  • Upkeep Timestamp changed from 2025-07-02T03:31:35+00:00 to 2025-07-14T16:45:18+00:00
Actions
Copy link
 #19

Updated by Upkeep Bot 5 months ago

  • Released In set to v20.2.0~2488
  • Upkeep Timestamp changed from 2025-07-14T16:45:18+00:00 to 2025-11-01T01:26:54+00:00
Actions
Copy link

Also available in: Atom PDF