Project

General

Profile

Actions

Bug #65235

closed

upgrade/reef-x/stress-split: "OSDMAP_FLAGS: noscrub flag(s) set" warning in cluster log

Added by Laura Flores almost 2 years ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Tests
Target version:
-
% Done:

0%

Source:
Q/A
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Tags (freeform):
Fixed In:
v19.3.0-5849-g11454f9f54
Released In:
v20.2.0~1691
Upkeep Timestamp:
2025-11-01T01:19:07+00:00

Description

/a/teuthology-2024-03-29_02:08:11-upgrade-squid-distro-default-smithi/7629127

2024-03-29T06:44:20.321 INFO:teuthology.orchestra.run.smithi045.stdout:2024-03-29T05:10:00.000191+0000 mon.a (mon.0) 1714 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set

Likely needs to be whitelisted.


Related issues 2 (0 open2 closed)

Related to RADOS - Bug #65521: Add expected warnings in cluster log to ignorelistsClosedLaura Flores

Actions
Related to RADOS - Bug #66474: rados/thrash-old-clients: HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancyDuplicateLaura Flores

Actions
Actions #1

Updated by Laura Flores almost 2 years ago

  • Assignee set to Laura Flores
Actions #2

Updated by Laura Flores almost 2 years ago

There are many instances of this flag getting set in the test run intentionally, so it makes sense to whitelist.

/a/yuriw-2024-04-09_14:58:21-upgrade-wip-yuri4-testing-2024-04-08-1432-distro-default-smithi/7648856$ cat teuthology.log | grep "osd set" | grep "nodeep-scrub" 
2024-04-10T02:27:05.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid c02b312e-f6dc-11ee-b64a-cb9ed24678a4 -- ceph osd set nodeep-scrub
2024-04-10T02:27:18.827 INFO:journalctl@ceph.mon.a.smithi062.stdout:Apr 10 02:27:18 smithi062 bash[80906]: audit 2024-04-10T02:27:18.270108+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.62:0/1866068261' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch
2024-04-10T02:27:18.827 INFO:journalctl@ceph.mon.c.smithi062.stdout:Apr 10 02:27:18 smithi062 bash[83329]: audit 2024-04-10T02:27:18.270108+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.62:0/1866068261' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch
2024-04-10T02:27:19.138 INFO:journalctl@ceph.mon.b.smithi129.stdout:Apr 10 02:27:18 smithi129 bash[67507]: audit 2024-04-10T02:27:18.270108+0000 mon.a (mon.0) 1416 : audit 1 from='client.? 172.21.15.62:0/1866068261' entity='client.admin' cmd=[{"prefix": "osd set", "key": "nodeep-scrub"}]: dispatch

Actions #3

Updated by Laura Flores almost 2 years ago

/a/yuriw-2024-04-11_17:03:54-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7652474

  msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench}
duration: 4465.95135641098
failure_reason: '"2024-04-12T01:10:00.000098+0000 mon.a (mon.0) 1265 : cluster [WRN]
  Health detail: HEALTH_WARN noscrub flag(s) set" in cluster log'
flavor: default
owner: scheduled_yuriw@teuthology
success: false

Actions #4

Updated by Brad Hubbard almost 2 years ago

  • Category set to Tests
  • Assignee changed from Laura Flores to Brad Hubbard
  • Source set to Q/A
Actions #5

Updated by Laura Flores almost 2 years ago

  • Related to Bug #65521: Add expected warnings in cluster log to ignorelists added
Actions #6

Updated by Brad Hubbard almost 2 years ago

Unfortunately, noscrub and nodeep-scrub are not the only warnings we would need to mask for the thrashosds-health test as there appear to be many others. Looking into this further.

Actions #7

Updated by Laura Flores almost 2 years ago

@Brad Hubbard perhaps we can address just the warnings reported in this Tracker, and address additional warnings in a Part 2.

Actions #8

Updated by Brad Hubbard almost 2 years ago

Sure Laura

Actions #9

Updated by Laura Flores almost 2 years ago

  • Related to Bug #66474: rados/thrash-old-clients: HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy added
Actions #10

Updated by Brad Hubbard over 1 year ago

Trying to reproduce this on centos9 since nothing on centos8 seems to work any more.

Actions #11

Updated by Laura Flores over 1 year ago

  • Status changed from New to In Progress
Actions #12

Updated by Radoslaw Zarzynski over 1 year ago

scrub note: tracked as a part of the meta-ticket.

Actions #13

Updated by Brad Hubbard over 1 year ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 59568
Actions #14

Updated by Laura Flores over 1 year ago

/a/yuriw-2024-08-28_23:20:46-upgrade-wip-yuri4-testing-2024-08-28-1359-distro-default-smithi/7879171

Actions #15

Updated by Radoslaw Zarzynski over 1 year ago

scrub note: in QA.

Actions #16

Updated by Radoslaw Zarzynski over 1 year ago

scrub note: in QA.

Actions #17

Updated by Radoslaw Zarzynski over 1 year ago

scrub note: still in QA.

Actions #18

Updated by Radoslaw Zarzynski over 1 year ago

This ticket has the fix like https://tracker.ceph.com/issues/66602.
Anyway, pinging Yuri.

Actions #19

Updated by Radoslaw Zarzynski over 1 year ago

scrub note: the PR went into QA!

Actions #20

Updated by Laura Flores over 1 year ago

In QA; awaiting approval

Actions #22

Updated by Brad Hubbard over 1 year ago

  • Status changed from Fix Under Review to Resolved
Actions #23

Updated by Laura Flores about 1 year ago

  • Tags changed from test-failure to test-failure, cluster-log-warning
Actions #24

Updated by Upkeep Bot 8 months ago

  • Merge Commit set to 11454f9f543fef51b6287491b11b5e113d52ce20
  • Fixed In set to v19.3.0-5849-g11454f9f543
  • Upkeep Timestamp set to 2025-07-11T13:48:56+00:00
Actions #25

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v19.3.0-5849-g11454f9f543 to v19.3.0-5849-g11454f9f54
  • Upkeep Timestamp changed from 2025-07-11T13:48:56+00:00 to 2025-07-14T23:09:48+00:00
Actions #26

Updated by Upkeep Bot 5 months ago

  • Released In set to v20.2.0~1691
  • Upkeep Timestamp changed from 2025-07-14T23:09:48+00:00 to 2025-11-01T01:19:07+00:00
Actions

Also available in: Atom PDF