This is a follow-up step for https://github.com/ray-project/kuberay/pull/3700. We should revert https://github.com/ray-project/kuberay/pull/3700 when https://github.com/ray-project/ray/pull/53562 is available in a Ray release.