Project

General

Profile

Actions

Bug #72517

closed

Garbage collector doesn't work

Added by Gabriel BenHanokh 7 months ago. Updated 5 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Target version:
-
% Done:

0%

Source:
Backport:
Regression:
Yes
Severity:
1 - critical
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Tags (freeform):
Fixed In:
v20.3.0-2816-g7da2ef3f81
Released In:
Upkeep Timestamp:
2025-09-04T13:24:47+00:00

Description

Garbage collector doesn't work in main.
When deleting an object with tail we remove the head-object inline and the tail objects should be removed by the garbage collector.
I am seeing a problem where GC doesn't do anything automatically and even when invoked manually using "radosgw-admin gc process --include-all"

Problem recreation steps:
$ s3cmd mb s3://bucket
$ s3cmd put bin/rados s3://bucket

$ s3cmd rm s3://bucket/rados

$ bin/rados -p default.rgw.buckets.data ls
(should show a list of 6 objects)

$ bin/radosgw-admin gc list --include-all
(on my system it shows an empty list)

$ bin/radosgw-admin gc process --include-all

Now issue rados ls again, it should show no objects, but on my systems it still shows all the tail objects

$ bin/rados -p default.rgw.buckets.data ls


Related issues 2 (0 open2 closed)

Related to rgw - Bug #72398: test_rgw_orphan_list.sh ERROR: orphans found when none expectedDuplicateAli Masarwa

Actions
Related to rgw - Bug #72949: Orphans found where none expectedDuplicate

Actions
Actions #1

Updated by Gabriel BenHanokh 7 months ago

  • Regression changed from No to Yes
Actions #2

Updated by Gabriel BenHanokh 7 months ago ยท Edited

GC code was broken by
commit 78502297afd074e51e0d2f99fac1b45fc3eaa0c2 from July-28

The problem is that radosgw-admin gc list --include-all return an empty list
Seems that nothing is added to GC queue

Actions #4

Updated by Casey Bodley 7 months ago

  • Related to Bug #72398: test_rgw_orphan_list.sh ERROR: orphans found when none expected added
Actions #5

Updated by J. Eric Ivancich 7 months ago

  • Assignee set to Ali Masarwa

Assigning to @Ali Masarwa as this is likely a regression due to his pr:

https://github.com/ceph/ceph/pull/63348

Actions #6

Updated by Casey Bodley 7 months ago

  • Status changed from New to In Progress
  • Pull request ID set to 64997
Actions #7

Updated by Upkeep Bot 7 months ago

  • Status changed from In Progress to Resolved
  • Merge Commit set to 7da2ef3f81bb581220f3630383e1587c06cca087
  • Fixed In set to v20.3.0-2816-g7da2ef3f81
  • Upkeep Timestamp set to 2025-09-04T13:24:47+00:00
Actions #8

Updated by Casey Bodley 6 months ago

  • Related to Bug #72949: Orphans found where none expected added
Actions #9

Updated by Yuma Ogami 5 months ago

Following this comment , I backported PR #64997 to squid and tentacle with the following PRs.

Actions

Also available in: Atom PDF