Skip to content

ci: delete gke cluster after test run#12270

Merged
nebril merged 1 commit intomasterfrom
pr/delete-gke-cluster
Jun 26, 2020
Merged

ci: delete gke cluster after test run#12270
nebril merged 1 commit intomasterfrom
pr/delete-gke-cluster

Conversation

@nebril
Copy link
Copy Markdown
Member

@nebril nebril commented Jun 24, 2020

We are hitting a lot of issues caused by state left over from test run.

This change deletes the cluster after the test run and relies on our
infra recreating the cluster for subsequent builds.

From my testing it takes our infra around10 minutes to get the cluster back up after deletion.

@nebril nebril requested a review from a team as a code owner June 24, 2020 16:58
@maintainer-s-little-helper
Copy link
Copy Markdown

Please set the appropriate release note label.

@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 24, 2020

test-gke K8sDemos

@nebril nebril added the release-note/ci This PR makes changes to the CI. label Jun 24, 2020
@errordeveloper
Copy link
Copy Markdown
Contributor

@nebril how quickly do they get re-created?

@coveralls
Copy link
Copy Markdown

coveralls commented Jun 24, 2020

Coverage Status

Coverage increased (+0.001%) to 37.168% when pulling d2581cc on pr/delete-gke-cluster into dc2c161 on master.

@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 24, 2020

@errordeveloper from my testing - it takes around 10 minutes for cluster to get back up

@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 25, 2020

test-gke K8sDemos

@nebril nebril force-pushed the pr/delete-gke-cluster branch from c00e03b to bd9c9f6 Compare June 25, 2020 11:39
We are hitting a lot of issues caused by state left over from test run.

This change deletes the cluster after the test run and relies on our
infra recreating the cluster for subsequent builds.

Signed-off-by: Maciej Kwiek <maciej@isovalent.com>
@nebril nebril force-pushed the pr/delete-gke-cluster branch from bd9c9f6 to d2581cc Compare June 25, 2020 11:40
@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 25, 2020

swapped the order of commands, we delete the cluster first so we don't rely on config connector deleting the cluster (there were issues related to that before), then we delete the k8s object which will be recreated which will cause cluster to be recreated

@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 25, 2020

test-gke K8sDemos

@nebril
Copy link
Copy Markdown
Member Author

nebril commented Jun 26, 2020

This change is only GKE-related, merging.

@nebril nebril merged commit 82f0cd0 into master Jun 26, 2020
@nebril nebril deleted the pr/delete-gke-cluster branch June 26, 2020 10:07
@vadorovsky
Copy link
Copy Markdown
Member

I think it might need a backport to 1.8 - we already want to backport GKE changes which depend on this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-note/ci This PR makes changes to the CI.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants