Skip to content

rgw/cloud-transition: Include LocationConstraint while transitioning data to AWS non-default regions#66038

Merged
soumyakoduri merged 2 commits intoceph:mainfrom
soumyakoduri:wip-skoduri-loc-constraint
Nov 11, 2025
Merged

rgw/cloud-transition: Include LocationConstraint while transitioning data to AWS non-default regions#66038
soumyakoduri merged 2 commits intoceph:mainfrom
soumyakoduri:wip-skoduri-loc-constraint

Conversation

@soumyakoduri
Copy link
Copy Markdown
Contributor

@soumyakoduri soumyakoduri commented Oct 23, 2025

AWS expects LocationConstraint to be passed as an additional parameter while creating bucket to non-default region which is currently missing in the cloud-transition code,

From https://docs.aws.amazon.com/cli/latest/reference/s3api/create-bucket.html,
"Regions outside of us-east-1 require the appropriate LocationConstraint to be specified in order to create the bucket in the desired region."

A new tier-config option location_constraint is added to be configured while transitioning data to AWS non-default regions.

Also fixed minor issues with using virtual-hosted style URLs in REST client code.

Fixes: https://tracker.ceph.com/issues/73626
Signed-off-by: Soumya Koduri skoduri@redhat.com

Contribution Guidelines

  • To sign and title your commits, please refer to Submitting Patches to Ceph.

  • If you are submitting a fix for a stable branch (e.g. "quincy"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.

  • When filling out the below checklist, you may click boxes directly in the GitHub web UI. When entering or editing the entire PR message in the GitHub web UI editor, you may also select a checklist item by adding an x between the brackets: [x]. Spaces and capitalization matter when checking off items this way.

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands

You must only issue one Jenkins command per-comment. Jenkins does not understand
comments with more than one command.

@soumyakoduri soumyakoduri requested a review from a team as a code owner October 23, 2025 07:22
@github-actions github-actions Bot added the rgw label Oct 23, 2025
@soumyakoduri
Copy link
Copy Markdown
Contributor Author

jenkins test windows

Comment thread src/rgw/driver/rados/rgw_lc_tier.cc Outdated
@cbodley
Copy link
Copy Markdown
Contributor

cbodley commented Oct 23, 2025

should we plan for backports? would this go all the way to squid?

@soumyakoduri
Copy link
Copy Markdown
Contributor Author

should we plan for backports? would this go all the way to squid?

That's right. Will update tracker

@soumyakoduri soumyakoduri force-pushed the wip-skoduri-loc-constraint branch from 81bc4d7 to ed98301 Compare October 30, 2025 18:44
@soumyakoduri soumyakoduri requested a review from a team as a code owner October 30, 2025 18:44
@soumyakoduri
Copy link
Copy Markdown
Contributor Author

jenkins test docs

Copy link
Copy Markdown
Contributor

@cbodley cbodley left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tier config changes look great 👍

@soumyakoduri soumyakoduri force-pushed the wip-skoduri-loc-constraint branch from ed98301 to 7860811 Compare October 30, 2025 19:00
Comment thread doc/radosgw/cloud-transition.rst Outdated
Add a new tier-config option "location_constraint" to be configured
while using AWS non-default regions.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
if the host_style is set to "Virtual", the endpoint URL and
host should be set to "<bucket_name>.host" while sending
requests.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
@soumyakoduri soumyakoduri force-pushed the wip-skoduri-loc-constraint branch from 7860811 to a3cba03 Compare November 3, 2025 08:58
@soumyakoduri
Copy link
Copy Markdown
Contributor Author

@anrao19 the tetuhology failures reported above doesn't seem related to this PR. But to be sure, please include this PR too in your next teuthology run and share the results.

@anrao19
Copy link
Copy Markdown
Contributor

anrao19 commented Nov 11, 2025

Pr testing completed , Approved by @ivancich details are in :https://tracker.ceph.com/issues/73724,
@soumyakoduri , Please let me know if no further testing needed if not we can merge the pr

@soumyakoduri soumyakoduri merged commit 7941054 into ceph:main Nov 11, 2025
13 checks passed
@github-actions
Copy link
Copy Markdown

This is an automated message by src/script/redmine-upkeep.py.

I have resolved the following tracker ticket due to the merge of this PR:

No backports are pending for the ticket. If this is incorrect, please update the tracker
ticket and reset to Pending Backport state.

Update Log: https://github.com/ceph/ceph/actions/runs/19259685396

@soumyakoduri soumyakoduri deleted the wip-skoduri-loc-constraint branch March 6, 2026 09:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants