Skip to content

mds: fix snapdiff result fragmentation#64995

Merged
vshankar merged 4 commits intoceph:mainfrom
ifed01:wip-ifed-fix-snapdiff-fragment
Sep 2, 2025
Merged

mds: fix snapdiff result fragmentation#64995
vshankar merged 4 commits intoceph:mainfrom
ifed01:wip-ifed-fix-snapdiff-fragment

Conversation

@ifed01
Copy link
Contributor

@ifed01 ifed01 commented Aug 12, 2025

Fixes: https://tracker.ceph.com/issues/72518

Contribution Guidelines

  • To sign and title your commits, please refer to Submitting Patches to Ceph.

  • If you are submitting a fix for a stable branch (e.g. "quincy"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.

  • When filling out the below checklist, you may click boxes directly in the GitHub web UI. When entering or editing the entire PR message in the GitHub web UI editor, you may also select a checklist item by adding an x between the brackets: [x]. Spaces and capitalization matter when checking off items this way.

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands

Reproduces: https://tracker.ceph.com/issues/72518
Signed-off-by: Md Mahamudur Rahaman Sajib <mahamudur.sajib@croit.io>

(cherry picked from commit 4ff7138)
@ifed01 ifed01 requested a review from vshankar August 12, 2025 13:30
@github-actions github-actions bot added cephfs Ceph File System tests labels Aug 12, 2025
@ifed01 ifed01 requested a review from sajibreadd August 12, 2025 13:31
@ifed01 ifed01 added the bug-fix label Aug 12, 2025
ifed01 added 2 commits August 12, 2025 16:51
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
…ded.

This is required when more entries with the same name don't fit into the
fragment. With the existing means for fragment offset specification such a splitting to be
prohibited.

Fixes: https://tracker.ceph.com/issues/72518
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
@ifed01 ifed01 force-pushed the wip-ifed-fix-snapdiff-fragment branch from c2c9b94 to 24955e6 Compare August 12, 2025 15:47
@ifed01 ifed01 changed the title mds: fix snapiff result fragmentation mds: fix snapdiff result fragmentation Aug 12, 2025
@ifed01
Copy link
Contributor Author

ifed01 commented Aug 15, 2025

jenkins test make check

@ifed01
Copy link
Contributor Author

ifed01 commented Aug 15, 2025

jenkins test make check arm64

@ifed01
Copy link
Contributor Author

ifed01 commented Aug 15, 2025

jenkins test make check

1 similar comment
@ifed01
Copy link
Contributor Author

ifed01 commented Aug 18, 2025

jenkins test make check

@vshankar
Copy link
Contributor

@ifed01 https://tracker.ceph.com/issues/72518 says the test passes in main and not in reef. Do we know why? And, this change is for the main branch, so I'm not 100% clear.

@ifed01
Copy link
Contributor Author

ifed01 commented Aug 20, 2025

@ifed01 https://tracker.ceph.com/issues/72518 says the test passes in main and not in reef. Do we know why? And, this change is for the main branch, so I'm not 100% clear.

IMO the issue is present in all Ceph releases but starting Squid snapdiff listing is has a bit different fragment boundaries as some entries' encodings have changed.

@ifed01
Copy link
Contributor Author

ifed01 commented Aug 20, 2025

@ifed01 https://tracker.ceph.com/issues/72518 says the test passes in main and not in reef. Do we know why? And, this change is for the main branch, so I'm not 100% clear.

IMO the issue is present in all Ceph releases but starting Squid snapdiff listing is has a bit different fragment boundaries as some entries' encodings have changed.

In fact reverting 24955e6 and increasing amount of files in LibCephFS.SnapDiffDeletionRecreation:
TEST(LibCephFS, SnapDiffDeletionRecreation) {

  • int bulk_count = 1 << 13;
  • int bulk_count = 1 << 15;

reproduces the issue in main branch as well.

@vshankar
Copy link
Contributor

reproduces the issue in main branch as well.

Thanks for verifying that.

Copy link
Contributor

@vshankar vshankar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nicely implemented @ifed01 @sajibreadd

Good work!

issue.

Snapdiff listing fragments have different boundaries in Reef and Squid+
releases hence original reproducer (made for Reef) doesn't work properly
in S+ releases. This patch fixes that at cost of longer execution.
This might be redundant/senseless when backporting to Reef.

Related-to: https://tracker.ceph.com/issues/72518
Signed-off-by: Igor Fedotov <igor.fedotov@croit.io>
@vshankar
Copy link
Contributor

jenkins test api

@vshankar
Copy link
Contributor

This PR is under test in https://tracker.ceph.com/issues/72684.

@ifed01
Copy link
Contributor Author

ifed01 commented Aug 25, 2025

jenkins test api

Copy link
Contributor

@vshankar vshankar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@vshankar
Copy link
Contributor

vshankar commented Sep 1, 2025

jenkins test make check arm64

@vshankar vshankar merged commit 4c4fd3c into ceph:main Sep 2, 2025
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants