rgw: add reshard test by oritwas · Pull Request #22939 · ceph/ceph

oritwas · 2018-07-08T14:12:57Z

No description provided.

oritwas · 2018-07-23T06:40:59Z

jenkins test this please

oritwas · 2018-07-24T16:06:57Z

jenkins test this please

cbodley

looks good if it passes!

cbodley · 2018-07-24T17:19:54Z

qa/tasks/rgw_reshard.py

+    connection = boto.s3.connection.S3Connection(
+        aws_access_key_id=access_key,
+        aws_secret_access_key=secret_key,
+        is_secure=False,


if we ever run this in the verify suite (or enable ssl in other suites) we'll need to enable this. in my wip branch for radosgw_admin_rest task, i'm using this line:

is_secure=True if endpoint.cert else False,

@cbodley , do you think it should run in verify suite?

not really, no - at least not in the same job as s3/swift tests because of the ceph.conf overrides

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

stale · 2018-10-17T21:54:23Z

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
If you are a maintainer or core committer, please follow-up on this issue to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

mattbenjamin · 2018-10-17T22:08:49Z

@cbodley anything blocking this?

cbodley · 2018-10-19T18:29:54Z

@cbodley anything blocking this?

@mattbenjamin nope, it looks like a valuable test to catch regressions in stats. i hope it still passes

stale · 2018-12-18T19:39:39Z

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
If you are a maintainer or core committer, please follow-up on this issue to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

cbodley · 2018-12-18T19:41:14Z

please don't kill this, friendly robot

stale · 2019-02-16T20:29:17Z

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
If you are a maintainer or core committer, please follow-up on this issue to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

stale · 2019-05-17T20:54:19Z

This pull request has been automatically closed because there has been no activity for 90 days. Please feel free to reopen this pull request (or open a new one) if the proposed change is still appropriate. Thank you for your contribution!

cbodley · 2019-05-23T21:04:35Z

qa/tasks/rgw_reshard.py

+
+    # check bucket shards num
+    (err, out) = rgwadmin(ctx, client, ['reshard', 'list'], check_status=True)
+    assert len(out) == 1


a test run is showing a failure here:

http://qa-proxy.ceph.com/teuthology/cbodley-2019-05-23_20:37:05-rgw-wip-kefu-testing-2019-05-23-0009-distro-basic-smithi/3972928/teuthology.log

it may be due to:

2019-05-23T20:52:24.095 INFO:teuthology.orchestra.run.smithi084.stderr:parse error setting 'rgw_reshard_thread_interval' to '30' (Value '30' is below minimum 600)

stale · 2019-07-22T21:59:33Z

This pull request has been automatically marked as stale because it has not had any activity for 60 days. It will be closed if no further activity occurs for another 30 days.
If you are a maintainer or core committer, please follow-up on this pull request to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

stale · 2019-09-20T22:02:40Z

This pull request has been automatically marked as stale because it has not had any activity for 60 days. It will be closed if no further activity occurs for another 30 days.
If you are a maintainer or core committer, please follow-up on this pull request to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

yuriw · 2019-12-11T21:08:20Z

wip-yuri8-testing-2019-12-11-2105

stale · 2020-02-11T21:19:54Z

This pull request has been automatically marked as stale because it has not had any activity for 60 days. It will be closed if no further activity occurs for another 30 days.
If you are a maintainer or core committer, please follow-up on this pull request to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

stale · 2020-05-12T06:31:24Z

This pull request has been automatically closed because there has been no activity for 90 days. Please feel free to reopen this pull request (or open a new one) if the proposed change is still appropriate. Thank you for your contribution!

oritwas added rgw tests needs-test labels Jul 8, 2018

oritwas force-pushed the wip-rgw-add-reshard-test branch from cdb8759 to 052aa43 Compare July 8, 2018 14:17

oritwas assigned cbodley and yehudasa Jul 23, 2018

oritwas force-pushed the wip-rgw-add-reshard-test branch 2 times, most recently from 6733153 to 65e6a3e Compare July 23, 2018 06:46

cbodley approved these changes Jul 24, 2018

View reviewed changes

oritwas added 7 commits July 25, 2018 11:13

rgw: add reshard task

08c06db

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: add stats checking

84a4395

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgwL: check user stats in rgw_reshard.py

5fcb754

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: add dynamic resharding testing to rgw_reshard test

71d6068

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: check acl after resharding in rgw_reshard test

b4e21a6

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: add rgw_reshard.yaml to thrash testing

09d60a6

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

rgw: add user creation to rgw_reshard task

98bc9f9

Signed-off-by: Orit Wasserman <owasserm@redhat.com>

oritwas force-pushed the wip-rgw-add-reshard-test branch 2 times, most recently from 6f19a02 to 98bc9f9 Compare July 25, 2018 08:15

stale bot added the stale label Oct 17, 2018

stale bot removed the stale label Oct 17, 2018

stale bot added the stale label Dec 18, 2018

stale bot removed the stale label Dec 18, 2018

stale bot added the stale label Feb 16, 2019

stale bot closed this May 17, 2019

cbodley reopened this May 21, 2019

stale bot removed the stale label May 21, 2019

cbodley added needs-qa and removed needs-test labels May 21, 2019

cbodley reviewed May 23, 2019

View reviewed changes

stale bot added the stale label Jul 22, 2019

cbodley removed the stale label Aug 1, 2019

stale bot added the stale label Sep 20, 2019

yuriw added the wip-yuri8-testing label Dec 11, 2019

stale bot removed the stale label Dec 11, 2019

yuriw removed the wip-yuri8-testing label Dec 13, 2019

cbodley removed the needs-qa label Dec 17, 2019

stale bot added the stale label Feb 11, 2020

cbodley mentioned this pull request Apr 6, 2020

rgw: more multisite dynamic resharding pieces. #34352

Merged

3 tasks

stale bot closed this May 12, 2020

Conversation

oritwas commented Jul 8, 2018

Uh oh!

oritwas commented Jul 23, 2018

Uh oh!

oritwas commented Jul 24, 2018

Uh oh!

cbodley left a comment

Choose a reason for hiding this comment

Uh oh!

cbodley Jul 24, 2018

Choose a reason for hiding this comment

Uh oh!

oritwas Jul 25, 2018

Choose a reason for hiding this comment

Uh oh!

cbodley Jul 25, 2018

Choose a reason for hiding this comment

Uh oh!

stale bot commented Oct 17, 2018

Uh oh!

mattbenjamin commented Oct 17, 2018

Uh oh!

cbodley commented Oct 19, 2018

Uh oh!

stale bot commented Dec 18, 2018

Uh oh!

cbodley commented Dec 18, 2018

Uh oh!

stale bot commented Feb 16, 2019

Uh oh!

stale bot commented May 17, 2019

Uh oh!

cbodley May 23, 2019

Choose a reason for hiding this comment

Uh oh!

stale bot commented Jul 22, 2019

Uh oh!

stale bot commented Sep 20, 2019

Uh oh!

yuriw commented Dec 11, 2019

Uh oh!

stale bot commented Feb 11, 2020

Uh oh!

stale bot commented May 12, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants