Project

General

Profile

Actions
Copy link

Bug #66877

open

qa/cephfs: ignore OSD down warning in cluster log

Added by Rishabh Dave over 1 year ago. Updated 5 months ago.

Status:
Pending Backport
Priority:
Normal
Assignee:
Rishabh Dave
Category:
-
Target version:
-
% Done:

0%

Source:
Backport:
squid,reef,quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
58486
Tags (freeform):
backport_processed
Merge Commit:
2bffb22d410005179803d9d55c844c1b2e539bf5
Fixed In:
v19.3.0-5632-g2bffb22d41
Released In:
v20.2.0~1767
Upkeep Timestamp:
2025-11-01T01:03:10+00:00

Description

Link to this job - https://pulpito.ceph.com/rishabh-2024-07-04_16:36:07-fs-wip-rishabh-testing-20240701.141150-debug-testing-default-smithi/7787234

From /a/rishabh-2024-07-04_16:36:07-fs-wip-rishabh-testing-20240701.141150-debug-testing-default-smithi/7787234/remote/smithi032/log/29e2825a-3a28-11ef-bcab-c7b262605968/ceph.log.gz -

2024-07-04T17:30:00.000149+0000 mon.smithi032 (mon.0) 381 : cluster [WRN] [WRN] OSD_DOWN: 1 osds down
2024-07-04T17:30:00.000155+0000 mon.smithi032 (mon.0) 382 : cluster [WRN]     osd.2 (root=default,host=smithi032) is down

We'll need to add a regex to catch the second line, I talked with Venky about this and it seems ignorelist currently can't allow regexs.

Related issues 3 (1 open — 2 closed)

Copied to CephFS - Backport #68616: reef: qa/cephfs: ignore OSD down warning in cluster logResolvedRishabh DaveActions
Copied to CephFS - Backport #68617: squid: qa/cephfs: ignore OSD down warning in cluster logQA TestingRishabh DaveActions
Copied to CephFS - Backport #68618: quincy: qa/cephfs: ignore OSD down warning in cluster logRejectedRishabh DaveActions
Actions
Copy link
 #1

Updated by Rishabh Dave over 1 year ago

@Venky Shankar IIUC regex can be used since ignorelist is only a list of string which are passed to grep one by one and grep allow regexs.

Actions
Copy link
 #2

Updated by Rishabh Dave over 1 year ago

  • Pull request ID set to 58486
Actions
Copy link
 #3

Updated by Xiubo Li over 1 year ago ยท Edited

squid: https://pulpito.ceph.com/jcollin-2024-07-01_10:56:30-fs-wip-jcollin-testing-20240701.061036-squid-distro-default-smithi/7781264

2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:    fs cephfs has deprecated feature inline_data enabled.
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:[WRN] OSD_DOWN: 1 osds down
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:    osd.5 (root=default,host=smithi196) is down
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:    all OSDs are running squid or later but require_osd_release < squid
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/219 objects degraded (13.699%), 12 pgs degraded
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.2 is active+undersized+degraded, acting [1,0]
2024-07-03T09:10:02.776 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.3 is active+undersized+degraded, acting [2,1]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.b is active+undersized+degraded, acting [3,4]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.f is active+undersized+degraded, acting [4,0]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.14 is active+undersized+degraded, acting [3,4]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.16 is active+undersized+degraded, acting [3,2]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.18 is active+undersized+degraded, acting [4,3]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.1a is active+undersized+degraded, acting [3,4]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.1b is active+undersized+degraded, acting [1,0]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.1c is active+undersized+degraded, acting [4,2]
2024-07-03T09:10:02.777 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.1d is active+undersized+degraded, acting [3,0]
2024-07-03T09:10:02.778 INFO:teuthology.orchestra.run.smithi143.stdout:    pg 2.1e is active+undersized+degraded, acting [2,0]
Actions
Copy link
 #5

Updated by Rishabh Dave over 1 year ago

  • Backport set to squid,reef,quincy
Actions
Copy link
 #6

Updated by Rishabh Dave over 1 year ago

  • Status changed from New to Fix Under Review
Actions
Copy link
 #9

Updated by Rishabh Dave over 1 year ago

  • Status changed from Fix Under Review to Pending Backport
Actions
Copy link
 #10

Updated by Upkeep Bot over 1 year ago

  • Copied to Backport #68616: reef: qa/cephfs: ignore OSD down warning in cluster log added
Actions
Copy link
 #11

Updated by Upkeep Bot over 1 year ago

  • Copied to Backport #68617: squid: qa/cephfs: ignore OSD down warning in cluster log added
Actions
Copy link
 #12

Updated by Upkeep Bot over 1 year ago

  • Copied to Backport #68618: quincy: qa/cephfs: ignore OSD down warning in cluster log added
Actions
Copy link
 #13

Updated by Upkeep Bot over 1 year ago

  • Tags (freeform) set to backport_processed
Actions
Copy link
 #14

Updated by Upkeep Bot 9 months ago

  • Merge Commit set to 2bffb22d410005179803d9d55c844c1b2e539bf5
  • Fixed In set to v19.3.0-5632-g2bffb22d410
  • Upkeep Timestamp set to 2025-07-08T22:38:03+00:00
Actions
Copy link
 #15

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v19.3.0-5632-g2bffb22d410 to v19.3.0-5632-g2bffb22d4100
  • Upkeep Timestamp changed from 2025-07-08T22:38:03+00:00 to 2025-07-14T15:46:36+00:00
Actions
Copy link
 #16

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v19.3.0-5632-g2bffb22d4100 to v19.3.0-5632-g2bffb22d41
  • Upkeep Timestamp changed from 2025-07-14T15:46:36+00:00 to 2025-07-14T21:10:40+00:00
Actions
Copy link
 #17

Updated by Upkeep Bot 5 months ago

  • Released In set to v20.2.0~1767
  • Upkeep Timestamp changed from 2025-07-14T21:10:40+00:00 to 2025-11-01T01:03:10+00:00
Actions
Copy link

Also available in: Atom PDF