Skip to content

Fix: ensure the uninstall wait to be properly done#4355

Merged
lacroixthomas merged 3 commits intoagones-dev:mainfrom
lacroixthomas:bugfixes/e2e-race-condition-uninstall-upgrade
Nov 27, 2025
Merged

Fix: ensure the uninstall wait to be properly done#4355
lacroixthomas merged 3 commits intoagones-dev:mainfrom
lacroixthomas:bugfixes/e2e-race-condition-uninstall-upgrade

Conversation

@lacroixthomas
Copy link
Copy Markdown
Collaborator

What type of PR is this?

Uncomment only one /kind <> line, press enter to put that in a new line, and remove leading whitespace from that line:

/kind bug

What this PR does / Why we need it:
Ensure we wait (with a timeout of 10m) for the helm uninstall when doing a helm upgrade --install, to ensure there is no race condition between the resources from the previous version installed and the new one

Which issue(s) this PR fixes:

Closes #4354

Special notes for your reviewer:

@github-actions github-actions bot added kind/bug These are bugs. size/XS labels Nov 26, 2025
build/Makefile Outdated
install: HELM_ARGS ?=
install: $(ensure-build-image) install-custom-pull-secret
-$(DOCKER_RUN) bash -c '[[ $$(helm status agones -n agones-system --output json | jq -r ".info.status") =~ (failed|pending-.*) ]] && helm uninstall agones --namespace=agones-system || true'
-$(DOCKER_RUN) bash -c '[[ $$(helm status agones -n agones-system --output json | jq -r ".info.status") =~ (failed|pending-.*) ]] && helm uninstall agones --namespace=agones-system --wait --timeout=10m || true'
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(non blocking) Should we make the timeout 20m? 30m? Just in case

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've put 10 mins to match the timeout from the install, but I don't mind increasing it to 20m in case there is something really blocking during the uninstall (it should uninstall the helm release only if it's in failed or pending)

Will let the pipeline finish and will push this change 👌🏼

@agones-bot
Copy link
Copy Markdown
Collaborator

Build Succeeded 🥳

Build Id: 4302d77d-9347-4248-af4f-d7b00ec8ca3c

The following development artifacts have been built, and will exist for the next 30 days:

A preview of the website (the last 30 builds are retained):

To install this version:

git fetch https://github.com/googleforgames/agones.git pull/4355/head:pr_4355 && git checkout pr_4355
helm install agones ./install/helm/agones --namespace agones-system --set agones.image.registry=us-docker.pkg.dev/agones-images/ci --set agones.image.tag=1.54.0-dev-a44cd46

@agones-bot
Copy link
Copy Markdown
Collaborator

Build Succeeded 🥳

Build Id: adb444cc-4f10-4b32-9032-0e37ecd5c344

The following development artifacts have been built, and will exist for the next 30 days:

A preview of the website (the last 30 builds are retained):

To install this version:

git fetch https://github.com/googleforgames/agones.git pull/4355/head:pr_4355 && git checkout pr_4355
helm install agones ./install/helm/agones --namespace agones-system --set agones.image.registry=us-docker.pkg.dev/agones-images/ci --set agones.image.tag=1.54.0-dev-f88cf20

@lacroixthomas
Copy link
Copy Markdown
Collaborator Author

/gcbrun
Trying to make it fails to see the logs (at least the previous helmrelease in fail)

@agones-bot
Copy link
Copy Markdown
Collaborator

Build Succeeded 🥳

Build Id: dd590481-4b24-4d3b-985b-d3794133a13a

The following development artifacts have been built, and will exist for the next 30 days:

A preview of the website (the last 30 builds are retained):

To install this version:

git fetch https://github.com/googleforgames/agones.git pull/4355/head:pr_4355 && git checkout pr_4355
helm install agones ./install/helm/agones --namespace agones-system --set agones.image.registry=us-docker.pkg.dev/agones-images/ci --set agones.image.tag=1.54.0-dev-f88cf20

@markmandel
Copy link
Copy Markdown
Collaborator

It's a pretty rare failure state. Might just be easier to merge and wait and see if it pops its head up again ☺️

@lacroixthomas lacroixthomas enabled auto-merge (squash) November 27, 2025 17:36
@agones-bot
Copy link
Copy Markdown
Collaborator

Build Succeeded 🥳

Build Id: 30a00156-dcad-44e4-a504-844a865ba1a2

The following development artifacts have been built, and will exist for the next 30 days:

A preview of the website (the last 30 builds are retained):

To install this version:

git fetch https://github.com/googleforgames/agones.git pull/4355/head:pr_4355 && git checkout pr_4355
helm install agones ./install/helm/agones --namespace agones-system --set agones.image.registry=us-docker.pkg.dev/agones-images/ci --set agones.image.tag=1.54.0-dev-32ef3ec

@lacroixthomas lacroixthomas merged commit b348988 into agones-dev:main Nov 27, 2025
4 checks passed
mnthe pushed a commit to mnthe/agones that referenced this pull request Mar 23, 2026
* fix: ensure the uninstall wait to be properly done

* Fix: add more logs around previous invalid helm release state
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/bug These are bugs. size/XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Flacky: e2e test fails with failed to uninstall due to atomic being set

3 participants