Instead of cross-compiling in CI, we should have native workers to build binaries; possibly, this would also reveal issues, such as #2329