Skip to content

squid: rgw/s3select #62959

Merged
yuriw merged 7 commits intoceph:squidfrom
galsalomon66:squid-s3select
May 19, 2025
Merged

squid: rgw/s3select #62959
yuriw merged 7 commits intoceph:squidfrom
galsalomon66:squid-s3select

Conversation

@galsalomon66
Copy link
Copy Markdown
Contributor

@galsalomon66 galsalomon66 commented Apr 25, 2025

cherry-pick's per squid:s3select

https://tracker.ceph.com/issues/71059
https://tracker.ceph.com/issues/68829
https://tracker.ceph.com/issues/65468

Contribution Guidelines

  • To sign and title your commits, please refer to Submitting Patches to Ceph.

  • If you are submitting a fix for a stable branch (e.g. "quincy"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.

  • When filling out the below checklist, you may click boxes directly in the GitHub web UI. When entering or editing the entire PR message in the GitHub web UI editor, you may also select a checklist item by adding an x between the brackets: [x]. Spaces and capitalization matter when checking off items this way.

Checklist

  • Tracker (select at least one)
    • References tracker ticket
    • Very recent bug; references commit where it was introduced
    • New feature (ticket optional)
    • Doc update (no ticket needed)
    • Code cleanup (no ticket needed)
  • Component impact
    • Affects Dashboard, opened tracker ticket
    • Affects Orchestrator, opened tracker ticket
    • No impact that needs to be tracked
  • Documentation (select at least one)
    • Updates relevant documentation
    • No doc update is appropriate
  • Tests (select at least one)
Show available Jenkins commands

galsalomon66 and others added 7 commits April 25, 2025 02:52
update for the engine_version message
s3select submodule

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
(cherry picked from commit 852c1d9)
in some cases the error message does not return to client, connection got broken (invalid chunk length)
fix another broken connection
all data-source to use same API for sending error-response
add the option rgw_s3select_disable(boolean). upon turning-on this option, it rejects s3select-requests with an error-message
editorial.
rollback to ceph-master. the ceph/s3-tests#561 must be merged with ceph-PR

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 53ad57c)
…sues

Update arrow submodule.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
(cherry picked from commit 06d0574)
Previously, these fields remained constant despite the possibility
of populating them with appropriate values.
Ref. https://docs.aws.amazon.com/AmazonS3/latest/API/ErrorResponses.html

Fixes: https://tracker.ceph.com/issues/65468
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
(cherry picked from commit 3a103f2)
RGW option per parquet read-buffer.
identation.
alignment with s3select updated APIs.

removing the JSON format part, it is not align with the current s3-tests (will be done on different part)

move the parquet-reader-setup call location.
editorial.

the returned-bytes metric was missing upon parquet flow.

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 597a702)
…ifies them if necessary(invalid read)

Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 2f81b4d)
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
(cherry picked from commit 141b675)
@galsalomon66 galsalomon66 requested a review from a team as a code owner April 25, 2025 00:51
@github-actions github-actions Bot added this to the squid milestone Apr 25, 2025
@adamemerson adamemerson modified the milestones: squid, v19.2.3 Apr 25, 2025
@adamemerson
Copy link
Copy Markdown
Contributor

@galsalomon66 Thank you very much!

@galsalomon66 galsalomon66 changed the title Squid s3select squid: rgw/s3select Apr 25, 2025
@adamemerson
Copy link
Copy Markdown
Contributor

@yuriw Could we merge this into squid? It's the cleaned up version of the PR we re-ran with.

@cbodley
Copy link
Copy Markdown
Contributor

cbodley commented Apr 25, 2025

https://jenkins.ceph.com/job/ceph-api/94604/

ERROR: test_version (tasks.mgr.dashboard.test_api.VersionReqTest)

@cbodley
Copy link
Copy Markdown
Contributor

cbodley commented Apr 25, 2025

jenkins test api

@yuriw yuriw merged commit 940800f into ceph:squid May 19, 2025
16 of 17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants