The release ci fails silently since it sometimes fails to block the tree. This causes plugins fail to be published and it requires real people to check the "release ci" in all the past commits to make sure they are published.

There are 2 things (or more) we can do:

1. When release ci fails, send an email to the plugin/ecosystem team to notify the failure.
2. Add a new ci check to make sure all the plugins are published at HEAD~.