Skip to content

bluestore: Elastic Shared Blobs 1 - mixed preparation#51439

Closed
aclamk wants to merge 12 commits intoceph:mainfrom
aclamk:wip-aclamk-bs-esb-1-preparation
Closed

bluestore: Elastic Shared Blobs 1 - mixed preparation#51439
aclamk wants to merge 12 commits intoceph:mainfrom
aclamk:wip-aclamk-bs-esb-1-preparation

Conversation

@aclamk
Copy link
Contributor

@aclamk aclamk commented May 11, 2023

This is part 1/4 of ESB work.
It contains fixes and improvements that are useful to BlueStore but not necessary, but are necessary to the ESB.
#51439
#51440
#51441
#51442

Contribution Guidelines

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands
  • jenkins retest this please
  • jenkins test classic perf
  • jenkins test crimson perf
  • jenkins test signed
  • jenkins test make check
  • jenkins test make check arm64
  • jenkins test submodules
  • jenkins test dashboard
  • jenkins test dashboard cephadm
  • jenkins test api
  • jenkins test docs
  • jenkins render docs
  • jenkins test ceph-volume all
  • jenkins test ceph-volume tox
  • jenkins test windows

aclamk and others added 4 commits May 10, 2023 11:47
After introduction of lazy statfs updates and mechanism to store them at exit,
some tests required tune-up.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Fix it, so it can be enabled and work.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Add more checks on consistency.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Upgrade local foreach_shared_blob into _fsck_foreach_shared_blob
that can be used on entire BlueStore scope.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
@aclamk
Copy link
Contributor Author

aclamk commented May 11, 2023

jenkins test make check

Copy link
Contributor

@ifed01 ifed01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, single cosmetic fix for fsck output, please...

} // for ... extent_map
} // for ... it->valid
} //if (it(PREFIX_OBJ))
stop_iterating:;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there any reason in favor of goto than return (with a comment maybe)?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

aclamk and others added 8 commits June 27, 2023 15:25
When we do fsck with non-repair mode, we do not get any info about shared blobs
that actually were corrupted. Now we print them.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
Make faster exit when sharding not enabled.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
When reshard is applied for the first time, expand reshard range to encompas whole object.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
maybe_reshard is created to filter out unnecessary calls to request_reshard.
The intended use is to let just request maybe_reshard, and delegate check
if the action is really necessary to the implementation detail level.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
When encode_some fails twice ceph aborts.
Now we print object details just before.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Modifed bluestore_blob_t to include current size of csum_data.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
Add printing of len to operator<< for const bluestore_blob_t.

Signed-off-by: Adam Kupczyk <akupczyk@ibm.com>
@rzarzynski
Copy link
Contributor

Merged as a part of #53178.

@rzarzynski rzarzynski closed this Sep 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants