Project

General

Profile

Actions

Bug #73452

closed

cephfs-mirror: split the snapshot mirror thread into a mirror and crawler thread

Added by Venky Shankar 5 months ago. Updated 24 days ago.

Status:
Resolved
Priority:
Normal
Category:
Performance/Resource Usage
Target version:
% Done:

0%

Source:
Development
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
cephfs-mirror
Labels (FS):
Pull request ID:
Tags (freeform):
Fixed In:
v20.3.0-5627-g81cb89b393
Released In:
Upkeep Timestamp:
2026-02-25T12:26:55+00:00

Description

Right now, the thread that crawls the snapshot also synchronises the files and directories. This makes is hard to do any kind of prefetching of files and directories and also does not help with any of status reporting in terms of how much backlog of files/directories and the sizes of those is to be transferred.


Related issues 5 (4 open1 closed)

Related to CephFS - Bug #73453: cephfs-mirror: improve mirroring statsNewKotresh Hiremath Ravishankar

Actions
Related to CephFS - Bug #73455: cephfs-mirror, mgr: interface to observer mirroring statsResolvedKotresh Hiremath Ravishankar

Actions
Related to CephFS - Enhancement #73577: cephfs-mirror: use asynchronous IO interface for data transferNew

Actions
Related to CephFS - Bug #74198: cephfs-mirror: option to sync snapshots using a dedicated thread for a directoryFix Under ReviewVenky Shankar

Actions
Related to CephFS - Bug #75091: cephfs-mirror: Snapshot sync starvation due to datasync thread scheduling modelFix Under ReviewKotresh Hiremath Ravishankar

Actions
Actions #1

Updated by Venky Shankar 5 months ago

  • Related to Bug #73453: cephfs-mirror: improve mirroring stats added
Actions #2

Updated by Venky Shankar 5 months ago

  • Related to Bug #73455: cephfs-mirror, mgr: interface to observer mirroring stats added
Actions #3

Updated by Venky Shankar 5 months ago

  • Related to Enhancement #73577: cephfs-mirror: use asynchronous IO interface for data transfer added
Actions #4

Updated by Venky Shankar 3 months ago

  • Related to Bug #74198: cephfs-mirror: option to sync snapshots using a dedicated thread for a directory added
Actions #5

Updated by Kotresh Hiremath Ravishankar about 2 months ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 66572
Actions #6

Updated by Kotresh Hiremath Ravishankar 26 days ago

  • Related to Bug #75091: cephfs-mirror: Snapshot sync starvation due to datasync thread scheduling model added
Actions #7

Updated by Upkeep Bot 24 days ago

  • Status changed from Fix Under Review to Resolved
  • Merge Commit set to 81cb89b3931967c0e90a7cb90e213346036db1f5
  • Fixed In set to v20.3.0-5627-g81cb89b393
  • Upkeep Timestamp set to 2026-02-25T12:26:55+00:00
Actions

Also available in: Atom PDF