Project

General

Profile

Actions
Copy link

Bug #48842

closed

qa/standalone/osd/osd-recovery-prio.sh: TEST_recovery_pool_priority failed

Added by Neha Ojha about 5 years ago. Updated 8 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
38857
Tags (freeform):
Merge Commit:
dc5d090edc0817aaf8dc79817b1e685c9c5de52c
Fixed In:
v16.0.0-9050-gdc5d090edc
Released In:
v16.2.0~270
Upkeep Timestamp:
2025-07-14T18:04:16+00:00

Description

2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:508: TEST_recovery_pool_priority:  return 2
2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:37: run:  return 1

/a/teuthology-2021-01-11_07:01:02-rados-master-distro-basic-smithi/5777307

Related issues 1 (1 open — 0 closed)

Related to RADOS - Bug #74524: TEST_backfill_pool_priority: "The primary PG X.X didn't become the in progress item on remote"Pending BackportKamoltat (Junior) Sirivadhna

Actions
Actions
Copy link
 #1

Updated by Neha Ojha about 5 years ago 

2021-01-11T15:26:22.874 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:434: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:osd.0
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:{   
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:    "local_reservations": {
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:        "max_allowed": 1,
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "min_priority": 0,
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "queues": [],
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "in_progress": []
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:    },
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:    "remote_reservations": {
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "max_allowed": 1,
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "min_priority": 0,
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "queues": [],
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "in_progress": [
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:            {   
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "item": "1.0",
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "prio": 191,
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "can_preempt": true
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:            }
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:        ]
2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout:    }
2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout:}
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].item'
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  eval 'ITEM="1.0"'
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  ITEM=1.0
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:438: TEST_recovery_pool_priority:  '[' 1.0 '!=' 1.0 ']'
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].prio'
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  PRIO=191
2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:444: TEST_recovery_pool_priority:  '[' 191 '!=' 191 ']'
2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.883 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].item'
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  eval 'ITEM="1.0"'
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  ITEM=1.0
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:453: TEST_recovery_pool_priority:  '[' 1.0 '!=' 1.0 ']'
2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].prio'
2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  PRIO=191
2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:459: TEST_recovery_pool_priority:  '[' 191 '!=' 191 ']'
2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].item'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  eval ITEM=null
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  ITEM=null
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:468: TEST_recovery_pool_priority:  '[' null '!=' 2.0 ']'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:470: TEST_recovery_pool_priority:  echo 'The primary PG for test2 didn'\''t become the in progress item'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG for test2 didn't become the in progress item
2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority:  expr 0 + 1
2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority:  ERRORS=1
2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].item'
2021-01-11T15:26:22.897 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  eval ITEM=null
2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  ITEM=null
2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:483: TEST_recovery_pool_priority:  '[' null '!=' 2.0 ']'
2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:485: TEST_recovery_pool_priority:  echo 'The primary PG 2.0 didn'\''t become the in progress item on remote'
2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority:  expr 1 + 1
2021-01-11T15:26:22.900 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG 2.0 didn't become the in progress item on remote
2021-01-11T15:26:22.902 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority:  ERRORS=2
Actions
Copy link
 #2

Updated by David Zafman about 5 years ago

This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.

Actions
Copy link
 #3

Updated by David Zafman about 5 years ago

  • Status changed from New to In Progress
  • Assignee set to David Zafman
  • Pull request ID set to 38857
Actions
Copy link
 #4

Updated by David Zafman about 5 years ago

David Zafman wrote:

This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.

Actually both PGs need to be "recovering"

Actions
Copy link
 #5

Updated by Kefu Chai about 5 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link
 #6

Updated by Upkeep Bot 8 months ago

  • Merge Commit set to dc5d090edc0817aaf8dc79817b1e685c9c5de52c
  • Fixed In set to v16.0.0-9050-gdc5d090edc
  • Released In set to v16.2.0~270
  • Upkeep Timestamp set to 2025-07-14T18:04:16+00:00
Actions
Copy link
 #7

Updated by Laura Flores about 2 months ago

  • Related to Bug #74524: TEST_backfill_pool_priority: "The primary PG X.X didn't become the in progress item on remote" added
Actions
Copy link

Also available in: Atom PDF