[DNM] skip tasks.cephfs.test_nfs.TestNFS.test_create_multiple_exports#35644
Closed
sebastian-philipp wants to merge 1 commit intoceph:masterfrom
Closed
[DNM] skip tasks.cephfs.test_nfs.TestNFS.test_create_multiple_exports#35644sebastian-philipp wants to merge 1 commit intoceph:masterfrom
sebastian-philipp wants to merge 1 commit intoceph:masterfrom
Conversation
Contributor
|
Skipping this test won't work. It gives new error. |
Contributor
Author
|
meh |
Contributor
|
Is there some issue with quay? I am getting error on pulling images. |
8fdd3e7 to
2693b48
Compare
Contributor
Author
|
getting this as well: |
Contributor
Author
This was referenced Jun 18, 2020
batrick
requested changes
Jun 18, 2020
Member
batrick
left a comment
There was a problem hiding this comment.
I assume you're using this for testing but NAK on this going into master.
I think Varsha uncovered a cephadm bug. We tell cephadm to remove nfs-ganesha:
2020-06-17T18:31:33.855+0000 7fe3506a8700 0 [volumes DEBUG root] _oremote volumes -> cephadm.remove_service(*('nfs.ganesha-test',), **{})
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr ~Gil Destroying new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr dispatch_remote Calling cephadm.remove_service...
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr dispatch_remote Success calling 'remove_service'
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr ~Gil Destroying new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr ~Gil Destroying new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr dispatch_remote Calling orchestrator._select_orchestrator...
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr get_config key: mgr/orchestrator/orchestrator
2020-06-17T18:31:33.855+0000 7fe3506a8700 10 mgr get_typed_config get_typed_config orchestrator found: cephadm
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr dispatch_remote Success calling '_select_orchestrator'
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr ~Gil Destroying new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 0 [volumes DEBUG root] _oremote volumes -> cephadm.process(*([<class 'cephadm.module.CephadmCompletion'>(_s=1, val=NA, _on_c=<function trivial_completion.<locals>.wrapper.<locals>.<lambda> at 0x7fe341f96048>, id=140614041503952, name=<lambda>, pr=NA, _next=None)],), **{})
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr ~Gil Destroying new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr Gil Switched to new thread state 0x55d35d5e3b00
2020-06-17T18:31:33.855+0000 7fe3506a8700 20 mgr dispatch_remote Calling cephadm.process...
2020-06-17T18:31:33.859+0000 7fe3506a8700 0 [cephadm DEBUG root] process: completions=<CephadmCompletion>[
<lambda>(...),
]
2020-06-17T18:31:33.859+0000 7fe3506a8700 0 [cephadm INFO root] Remove service nfs.ganesha-test
2020-06-17T18:31:33.859+0000 7fe3506a8700 0 log_channel(cephadm) log [INF] : Remove service nfs.ganesha-test
2020-06-17T18:31:33.859+0000 7fe3506a8700 0 [cephadm DEBUG root] Looking for OSDSpec with service_name: nfs.ganesha-test
and then
020-06-17T18:31:37.435+0000 7fe3430a9700 0 [cephadm INFO root] Removing orphan daemon nfs.ganesha-test.smithi095...
2020-06-17T18:31:37.435+0000 7fe3430a9700 0 log_channel(cephadm) log [INF] : Removing orphan daemon nfs.ganesha-test.smithi095...
2020-06-17T18:31:37.435+0000 7fe3430a9700 0 [cephadm INFO root] Removing daemon nfs.ganesha-test.smithi095 from smithi095
2020-06-17T18:31:37.435+0000 7fe3430a9700 0 log_channel(cephadm) log [INF] : Removing daemon nfs.ganesha-test.smithi095 from smithi095
and then
2020-06-17T18:31:42.159+0000 7fe350ea9700 1 -- [v2:172.21.15.95:6800/1688986166,v1:172.21.15.95:6801/1688986166] <== client.14313 172.21.15.95:0/3980712865 1 ==== mgr_command(tid 0: {"prefix": "orch ls", "service_type": "nfs", "target": ["mon-mgr", ""]}) v1 ==== 95+0+0 (secure 0 0 0) 0x55d35d4811e0 con 0x55d35d296400
The orch ls command returns the nfs.ganesha-test service even though it's been deleted.
From: /ceph/teuthology-archive/varsha-2020-06-17_18:09:32-rados-wip-varsha-testing-nfs-distro-basic-smithi/5158445/remote/ubuntu@smithi095.front.sepia.ceph.com/log/3142d272-b0c8-11ea-a06d-001a4aab830c/ceph-mgr.a.log.gz
@varshar16 To get around this, I think you should change the test to poll for removal. Maybe that will help.
Contributor
The service is When the container has finally stopped, the service will no longer appear during an
+1 for polling |
Contributor
Author
👍 That's why I marked it as DNM and omitted the DCO to prevent an accidental merge. |
Contributor
I was waiting for 8 seconds before checking the status and it worked in previous test runs. @mgfritch any idea what is causing it to take longer time here? |
Contributor
I have updated the test in this PR #35646 |
Contributor
Author
|
looks like |
Member
You also need to enable skipping in your yaml file:
see also |
2693b48 to
2b47de5
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Checklist
Show available Jenkins commands
jenkins retest this pleasejenkins test classic perfjenkins test crimson perfjenkins test signedjenkins test make checkjenkins test make check arm64jenkins test submodulesjenkins test dashboardjenkins test dashboard backendjenkins test docsjenkins render docsjenkins test ceph-volume alljenkins test ceph-volume tox