Bug #66602
openrados/upgrade: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)
0%
Description
/a/lflores-2024-06-18_23:03:53-rados-squid-release-distro-default-smithi/7762824
2024-06-19T02:57:13.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b460004-2dd7-11ef-bc9d-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v MON_DOWN | egrep -v 'out of quorum' | head -n 1 2024-06-19T02:57:13.413 INFO:teuthology.orchestra.run.smithi012.stdout:2024-06-19T01:13:53.931498+0000 mon.a (mon.0) 832 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)
Updated by Laura Flores almost 2 years ago
- Related to Bug #65521: Add expected warnings in cluster log to ignorelists added
Updated by Radoslaw Zarzynski over 1 year ago
scrub note: it looks it's supposed the fix for #65521 will tackle this one as well. Am I correct, @Laura Flores?
Updated by Nitzan Mordechai over 1 year ago
- Status changed from New to In Progress
- Assignee set to Nitzan Mordechai
Radoslaw Zarzynski wrote in #note-3:
scrub note: it looks it's supposed the fix for #65521 will tackle this one as well. Am I correct, @Laura Flores?
looks like #65521 only to gather all the ignore lists that are out there, that one is for upgrade and I'll take it
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-06-27_20:00:00-rados-squid-release-distro-default-smithi/7776798
Updated by Laura Flores over 1 year ago
- Subject changed from rados/upgrade/parallel: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) to rados/upgrade: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)
/a/yuriw-2024-06-28_19:31:25-upgrade:quincy-x-squid-release-distro-default-smithi/7778105
As this also needs to be handled for stress-split tests, I'm going to modify the title slightly.
Updated by Nitzan Mordechai over 1 year ago
@Laura Flores those 2 last comments are coming from failures in upgrade:quincy-x, that tracker handles rados/upgrade. I'll copy them over there
Updated by Laura Flores over 1 year ago
Thanks @Nitzan Mordechai, can you link the relevant PR? I'm guessing you already had one open to address this warning for other tests?
Updated by Nitzan Mordechai over 1 year ago
Laura Flores wrote in #note-10:
Thanks @Nitzan Mordechai, can you link the relevant PR? I'm guessing you already had one open to address this warning for other tests?
that one: https://github.com/ceph/ceph/pull/58277 for quincy
Reef one still under work by brad
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-07-05_14:04:08-rados-wip-yuri3-testing-2024-07-01-1610-distro-default-smithi/7788583
Updated by Aishwarya Mathuria over 1 year ago
- Tags changed from test-failure to test-failure, main-failures
Updated by Laura Flores over 1 year ago · Edited
- Assignee changed from Nitzan Mordechai to Brad Hubbard
that one: https://github.com/ceph/ceph/pull/58277 for quincy
Reef one still under work by brad
@Brad Hubbard if you're working on adding this to the reef-x upgrade tests, can you link your work? Or otherwise let us know if this task still needs coverage.
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-07-17_22:03:42-rados-wip-yuri12-testing-2024-07-16-1122-distro-default-smithi/7806659
Updated by Aishwarya Mathuria over 1 year ago
/a/yuriw-2024-07-16_01:05:51-rados-wip-yuri6-testing-2024-07-15-1335-distro-default-smithi/7803454
Updated by Aishwarya Mathuria over 1 year ago
/a/yuriw-2024-07-17_13:35:08-rados-wip-yuri10-testing-2024-07-15-1330-distro-default-smithi/7805761
Updated by Nitzan Mordechai over 1 year ago
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812732
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812724
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812743
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812716
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812722
/a/yuriw-2024-07-22_15:45:18-rados-wip-yuri2-testing-2024-07-19-0817-distro-default-smithi/7812742
Updated by Laura Flores over 1 year ago
/a/lflores-2024-07-30_16:00:24-rados-wip-lflores-testing-2-2024-07-30-0311-distro-default-smithi/7826472
Updated by Laura Flores over 1 year ago · Edited
/a/yuriw-2024-08-02_15:32:29-rados-squid-release-distro-default-smithi/7832980
/a/yuriw-2024-08-02_15:32:29-rados-squid-release-distro-default-smithi/7832719
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-08-15_14:10:18-upgrade:quincy-x-squid-release-distro-default-smithi/7856788
Updated by Laura Flores over 1 year ago
- Assignee changed from Brad Hubbard to Laura Flores
Updated by Kamoltat (Junior) Sirivadhna over 1 year ago
squid:
yuriw-2024-08-09_13:31:16-rados-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7845530
yuriw-2024-08-09_13:31:16-rados-wip-yuri7-testing-2024-08-08-0804-squid-distro-default-smithi/7845542
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-08-29_20:06:20-upgrade:quincy-x-squid-release-distro-default-smithi/7880558
Updated by Laura Flores over 1 year ago
/a/skanta-2024-09-07_00:00:30-rados-squid-release-distro-default-smithi/7893021
Updated by Laura Flores over 1 year ago
- Status changed from In Progress to Fix Under Review
- Assignee changed from Laura Flores to Brad Hubbard
- Pull request ID set to 59568
Updated by Laura Flores over 1 year ago
- Has duplicate Bug #67963: [Teuthology][Upgrade suites] cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" added
Updated by Radoslaw Zarzynski over 1 year ago
scrub note: already approved and sent to QA.
Updated by Laura Flores over 1 year ago
/a/skanta-2024-09-27_06:56:34-rados-wip-bharath14-testing-2024-09-26-2119-squid-distro-default-smithi/7921482
Updated by Shraddha Agrawal over 1 year ago
/a/skanta-2024-10-05_10:36:55-rados-wip-bharath15-testing-2024-10-05-1105-quincy-distro-default-smithi/7934546
Updated by Nitzan Mordechai over 1 year ago
/a/skanta-2024-10-16_06:36:01-rados-wip-bharath14-testing-2024-10-16-0618-squid-distro-default-smithi/
['7949879', '7949841', '7950026', '7949950', '7950035']
Updated by Laura Flores over 1 year ago
- Status changed from Fix Under Review to Pending Backport
Updated by Upkeep Bot over 1 year ago
- Copied to Backport #68825: squid: rados/upgrade: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) added
Updated by Upkeep Bot over 1 year ago
- Tags (freeform) set to backport_processed
Updated by Naveen Naidu over 1 year ago
/a/yuriw-2024-10-17_14:30:20-rados-wip-yuri-testing-2024-10-09-1524-squid-distro-default-smithi/7954348
Updated by Brad Hubbard over 1 year ago
Laura Flores wrote in #note-46:
@Laura Flores the change to resolve this issue was for reef-x upgrade test only. Is that what you were running above?
Updated by Brad Hubbard over 1 year ago
Naveen Naidu wrote in #note-45:
/a/yuriw-2024-10-17_14:30:20-rados-wip-yuri-testing-2024-10-09-1524-squid-distro-default-smithi/7954348
Same question, was this running a reef-x upgrade?
Updated by Sridhar Seshasayee over 1 year ago · Edited
/a/skanta-2024-11-26_00:08:32-rados-wip-bharath8-testing-2024-11-25-1916-squid-distro-default-smithi/8009706
/a/skanta-2024-11-26_00:08:32-rados-wip-bharath8-testing-2024-11-25-1916-squid-distro-default-smithi/8009854
Updated by Brad Hubbard over 1 year ago
OK, I got lost in the fact I was addressing this in reef-x upgrades only. Looks like we need to address this more generically if it hasn't been addressed elsewhere already?
Updated by Shraddha Agrawal over 1 year ago
/a/skanta-2024-11-28_05:17:59-rados-wip-bharath7-testing-2024-11-28-0618-squid-distro-default-smithi/8013971/
Updated by Laura Flores over 1 year ago
/a/yuriw-2024-12-15_15:56:29-rados-squid-release-distro-default-smithi/8037889
Updated by Laura Flores about 1 year ago
/a/yuriw-2024-12-24_16:11:09-rados-squid-release-distro-default-smithi/8051311
Updated by Upkeep Bot about 1 year ago
- Status changed from Pending Backport to Resolved
While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".
Updated by Laura Flores about 1 year ago
- Tags changed from test-failure, main-failures to test-failure, main-failures, cluster-log-warning
Updated by Laura Flores about 1 year ago
- Status changed from Resolved to Pending Backport
- Backport changed from squid to squid,reef
/a/yuriw-2025-03-11_17:59:57-rados-wip-yuri11-testing-2025-03-11-0848-reef-distro-default-smithi/8181678
Updated by Aishwarya Mathuria 12 months ago
/a/yuriw-2025-03-20_16:39:16-upgrade:quincy-x-reef-release-distro-default-smithi/8200674
Updated by Upkeep Bot 9 months ago
- Merge Commit set to 11454f9f543fef51b6287491b11b5e113d52ce20
- Fixed In set to v19.3.0-5849-g11454f9f543
- Upkeep Timestamp set to 2025-07-08T22:38:13+00:00
Updated by Upkeep Bot 8 months ago
- Fixed In changed from v19.3.0-5849-g11454f9f543 to v19.3.0-5849-g11454f9f543f
- Upkeep Timestamp changed from 2025-07-08T22:38:13+00:00 to 2025-07-14T15:46:46+00:00
Updated by Upkeep Bot 8 months ago
- Fixed In changed from v19.3.0-5849-g11454f9f543f to v19.3.0-5849-g11454f9f54
- Upkeep Timestamp changed from 2025-07-14T15:46:46+00:00 to 2025-07-14T21:10:47+00:00
Updated by Jonathan Bailey 8 months ago
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397603
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397735
Updated by Brad Hubbard 8 months ago
Jonathan Bailey wrote in #note-61:
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397603
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397735
@Jonathan Bailey
This is due to the changes in https://github.com/ceph/ceph/pull/60969 etc. not getting backported to reef and therefore qa/suites/rados/upgrade/parallel/0-start.yaml not having the necessary log-ignorelist entries in that version. @Laura Flores how do we want to handle this? New tracker as it's not just a straight backport of this, or any other tracker?
Updated by Laura Flores 8 months ago
Brad Hubbard wrote in #note-62:
Jonathan Bailey wrote in #note-61:
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397603
/a/skanta-2025-07-20_02:53:19-rados-wip-bharath6-testing-2025-07-20-0524-reef-distro-default-smithi/8397735@Jonathan Bailey
This is due to the changes in https://github.com/ceph/ceph/pull/60969 etc. not getting backported to reef and therefore qa/suites/rados/upgrade/parallel/0-start.yaml not having the necessary log-ignorelist entries in that version. @Laura Flores how do we want to handle this? New tracker as it's not just a straight backport of this, or any other tracker?
If we need to backport that PR, let's reopen https://tracker.ceph.com/issues/69135 so it can be backported to Reef. I'll set the status for it.
Updated by Upkeep Bot 5 months ago
- Released In set to v20.2.0~1691
- Upkeep Timestamp changed from 2025-07-14T21:10:47+00:00 to 2025-11-01T01:03:18+00:00