Project

General

Profile

Actions
Copy link

Feature #65769

open

rgw: make incomplete multipart upload part of bucket check efficient

Added by J. Eric Ivancich almost 2 years ago. Updated 5 months ago.

Status:
Pending Backport
Priority:
Normal
Assignee:
J. Eric Ivancich
Target version:
Ceph - v20.0.0
% Done:

0%

Source:
Backport:
quincy, reef, squid
Reviewed:
Affected Versions:
Pull request ID:
57083
Tags (freeform):
Merge Commit:
b034c830769f4c1e51c1c75dbb99e95686a5fe96
Fixed In:
v19.3.0-2044-gb034c83076
Released In:
v20.2.0~2945
Upkeep Timestamp:
2025-11-01T00:54:47+00:00

Description

Previously the incomplete multipart portion of bucket check would list all entries in the multipart namespace across all shards and then analyze them in memory before taking further action.

Since all index entries for a given multipart upload are all on the same shard by design, we can work on this asynchronously shard by shard. Furthermore since all entries for a given multipart upload are sequential in the bucket index, we can use a small window to analyze each of the uploads.

Related issues 3 (2 open — 1 closed)

Copied to rgw - Backport #65891: quincy: rgw: make incomplete multipart upload part of bucket check efficientResolvedJ. Eric IvancichActions
Copied to rgw - Backport #65892: squid: rgw: make incomplete multipart upload part of bucket check efficientIn ProgressJ. Eric IvancichActions
Copied to rgw - Backport #65893: reef: rgw: make incomplete multipart upload part of bucket check efficientIn ProgressJ. Eric IvancichActions
Actions
Copy link
 #1

Updated by J. Eric Ivancich almost 2 years ago

quincy backport ready to go -- https://github.com/ceph/ceph/pull/57244

Actions
Copy link
 #2

Updated by J. Eric Ivancich almost 2 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions
Copy link
 #3

Updated by Upkeep Bot almost 2 years ago

  • Copied to Backport #65891: quincy: rgw: make incomplete multipart upload part of bucket check efficient added
Actions
Copy link
 #4

Updated by Upkeep Bot almost 2 years ago

  • Copied to Backport #65892: squid: rgw: make incomplete multipart upload part of bucket check efficient added
Actions
Copy link
 #5

Updated by Upkeep Bot almost 2 years ago

  • Copied to Backport #65893: reef: rgw: make incomplete multipart upload part of bucket check efficient added
Actions
Copy link
 #7

Updated by Upkeep Bot 8 months ago

  • Merge Commit set to b034c830769f4c1e51c1c75dbb99e95686a5fe96
  • Fixed In set to v19.3.0-2044-gb034c830769
  • Upkeep Timestamp set to 2025-07-08T22:38:51+00:00
Actions
Copy link
 #8

Updated by Upkeep Bot 8 months ago

  • Fixed In changed from v19.3.0-2044-gb034c830769 to v19.3.0-2044-gb034c83076
  • Upkeep Timestamp changed from 2025-07-08T22:38:51+00:00 to 2025-07-14T17:10:46+00:00
Actions
Copy link
 #9

Updated by Upkeep Bot 5 months ago

  • Released In set to v20.2.0~2945
  • Upkeep Timestamp changed from 2025-07-14T17:10:46+00:00 to 2025-11-01T00:54:47+00:00
Actions
Copy link

Also available in: Atom PDF