Skip to content

Update to latest from branch and compliance tests#13

Merged
cwickramanayake-dotcom merged 658 commits intosplunk:masterfrom
cwickramanayake-dotcom:master
Jan 28, 2026
Merged

Update to latest from branch and compliance tests#13
cwickramanayake-dotcom merged 658 commits intosplunk:masterfrom
cwickramanayake-dotcom:master

Conversation

@cwickramanayake-dotcom
Copy link
Copy Markdown
Collaborator

Update to latest ceph/s3-tests, fix all tests, and introduce core S3 compliance tests

  • Rebased branch to latest upstream ceph/s3-tests
  • Fixed all test failures for compatibility
  • Added Splunk-specific compliance test lists and skip logic
  • Updated README with Splunk S3 compliance instructions
  • Introduced core test set for S3 compliance validation
  • Improved configuration and test selection for Splunk environments

This update ensures the branch is up-to-date, core compliance tests are clearly defined for S3 validation."

mattbenjamin and others added 30 commits March 15, 2024 10:30
Add tests for the new ObjectSizeGreaterThan and
ObjectSizeLessThan lifecycle operators.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
this is to cover the fix of: https://tracker.ceph.com/issues/58879

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
test etag on mpu complete replies

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
iam: add tests for account-based IAM apis
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
Signed-off-by: Gal Salomon <gal.salomon@gmail.com>
TestName:
s3tests_boto3.functional.test_s3:test_buckets_list_ctime

Problem:
The test creates 5 buckets for a user but in an assertion check,
it asserts false if any bucket of the user has CreationTime less
than a day prior to current time.
Due to this reason the test fails if the user has pre-existing
buckets older than a day.

Solution:
Assert only on the CreationTime of buckets that were created with
test execution.

Signed-off-by: Sumedh A. Kulkarni <sumedh.a.kulkarni@seagate.com>
Co-developed-by: Bob Ham <bham12@bloomberg.net>
Signed-off-by: Bob Ham <bham12@bloomberg.net>
…Test

Fix wrong assertion of the test: `test_buckets_list_ctime`
Fixes: https://tracker.ceph.com/issues/66655

Signed-off-by: Casey Bodley <cbodley@redhat.com>
requirements: unpin pytz version
test_multipart_get_part() tests 'normal' multipart uploads. add a new
test case for a multipart upload with a single part to tests the fix
for https://tracker.ceph.com/issues/66705

Signed-off-by: Casey Bodley <cbodley@redhat.com>
this removes a Pytest warning during execution

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
…-multipart

As described in https://tracker.ceph.com/issues/65746, retrying complete-multipart
after having attempted to complete the same upload with a bad checksum argument
fails with an internal error.

The status code is 500, but I'm unsure if it can be retried again, or whether
the upload can be aborted later.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
tests a full multipart upload cycle with 3 unique parts, which
verifies composite checksum computation and the logic to propagate
parts_count to ComleteMultipart

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
this tests a two-megabyte binary upload with validated
(awscli-computed) SHA256 checksum, and also verifies failure when
a bad checksum is provided

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
also add @pytest.mark.checksum for new checksum
tests

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
…reaming

Wip cbodley multipart nostreaming
test Get/HeadObject with partNumber for single-multipart upload
ref. ceph/ceph#56864

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Ref. ceph/ceph#58686

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Ref. ceph/ceph#58686

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Ref. ceph/ceph#58689

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
…pted

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
BucketPolicy: donot allow NotPrincipal with Allow Effect
BucketPolicy: add test for sse-c in conditions
s3select: align error codes with the new AWS format
the before-call hook url-encodes the ':' part of tenanted bucket names
to resolve SignatureDoesNotMatch errors

removed the list-v2 version of the test since it isn't relevant to
bucket policy test coverage

add a new test case that creates the bucket under the tenanted user,
then uses the main client to access it

Signed-off-by: Casey Bodley <cbodley@redhat.com>
soumyakoduri and others added 29 commits October 17, 2025 13:50
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
rgw/restore: Fixing readthrough

Reviewed-by: Jiffin Tony Thottan <thottanjiffin@gmail.com>
* in "journal" mode, when multiple source buckets share the same log prefix,
the first one being deleted will remove the object holding the temporary
object name, and only the first would commit the temp object.
* in "standard" mode, the other buckets will recreate the object holding
the temporary object name, becase the bucket deletion operation will be
logged as well.
* added tests where only one of the buckets sharing a common prefix is
  deleted and the rest are not

Signed-off-by: Yuval Lifshitz <ylifshit@ibm.com>
rgw/logging: change test to match the new source cleanup process
Add test for copy on sse-s3 and sse-c encrypted objects.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Signed-off-by: Seena Fallah <seenafallah@gmail.com>
Based on the new fixes around copy enc, those headers are required
when completing mp upload.

Signed-off-by: Seena Fallah <seenafallah@gmail.com>
This change address multiple messages in the log:

    DeprecationWarning: invalid escape sequence '\$'

Signed-off-by: Kyr Shatskyy <kyrylo.shatskyy@clyso.com>
functional: fix invalid escape sequence deprication warning
Modified to work with the new asynchronous buckt logging commit
mechanism.

Fixes: https://tracker.ceph.com/issues/71365

Signed-off-by: Nithya Balachandran <nithya.balachandran@ibm.com>
CopyObject: add test for encrypted objects
rgw/bucket-logging: handle async log commits
s3: test checksum for get_object with part number
…compliance tests

- Rebased branch to latest upstream ceph/s3-tests
- Fixed all test failures for compatibility
- Added Splunk-specific compliance test lists and skip logic
- Updated README with Splunk S3 compliance instructions
- Introduced core test set for S3 compliance validation
- Improved configuration and test selection for Splunk environments

This update ensures the branch is up-to-date, core compliance tests are clearly defined for S3 validation."
@cwickramanayake-dotcom cwickramanayake-dotcom merged commit 918d095 into splunk:master Jan 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.