[Bug] ray job commands don't work with RAY_ADDRESS={module}:// #22119
Description
Search before asking
- I searched the issues and found no similar issues.
Ray Component
Ray Serve
What happened + What you expected to happen
Ray client currently supports connection strings for external modules of the format "other_module://", however ray job commands don't support this format. For example if the other module is anyscale, ray.init("anyscale://") does work as expected, but RAY_ADDRESS="anyscale://" ray job submit doesn't.
Error:
2022-01-10 16:39:19,148 INFO cli.py:25 -- Creating JobSubmissionClient at address: anyscale://
Traceback (most recent call last):
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/bin/ray", line 8, in <module>
sys.exit(main())
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/ray/scripts/scripts.py", line 1989, in main
return cli()
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/ray/dashboard/modules/job/cli.py", line 104, in job_submit
runtime_env=final_runtime_env)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/ray/dashboard/modules/job/sdk.py", line 213, in submit_job
return JobSubmitResponse(**r.json()).job_id
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/site-packages/requests/models.py", line 900, in json
return complexjson.loads(self.text, **kwargs)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/json/__init__.py", line 348, in loads
return _default_decoder.decode(s)
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/local/Caskroom/miniconda/base/envs/anyscale/lib/python3.7/json/decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
Versions / Dependencies
Ray 1.9.2, Python 3.7
Reproduction script
Example using anyscale as the external module.
RAY_ADDRESS="anyscale://" ray job submit
Anything else
No response
Are you willing to submit a PR?
- Yes I am willing to submit a PR!