-
Notifications
You must be signed in to change notification settings - Fork 2.8k
Local vLLM host alias is routed through sandbox proxy and denied #3190
Copy link
Copy link
Labels
area: inferenceInference routing, serving, model selection, or outputsInference routing, serving, model selection, or outputsarea: local-modelsLocal model providers, downloads, launch, or connectivityLocal model providers, downloads, launch, or connectivityarea: providersInference provider integrations and provider behaviorInference provider integrations and provider behaviorarea: sandboxOpenShell sandbox lifecycle, runtime, config, or recoveryOpenShell sandbox lifecycle, runtime, config, or recoveryprovider: vllmvLLM local or hosted provider behaviorvLLM local or hosted provider behavior
Metadata
Metadata
Assignees
Labels
area: inferenceInference routing, serving, model selection, or outputsInference routing, serving, model selection, or outputsarea: local-modelsLocal model providers, downloads, launch, or connectivityLocal model providers, downloads, launch, or connectivityarea: providersInference provider integrations and provider behaviorInference provider integrations and provider behaviorarea: sandboxOpenShell sandbox lifecycle, runtime, config, or recoveryOpenShell sandbox lifecycle, runtime, config, or recoveryprovider: vllmvLLM local or hosted provider behaviorvLLM local or hosted provider behavior
Type
Fields
Give feedbackNo fields configured for Enhancement.
Description
Local vLLM inference can fail from inside the sandbox because requests to
host.openshell.internalare routed through the sandbox HTTP proxy instead of connecting directly to the host-side vLLM service.Expected behavior: sandbox requests to local inference host aliases such as
host.openshell.internalandhost.docker.internalbypassHTTP_PROXYviaNO_PROXY, while normal provider traffic throughhttps://inference.local/v1continues to use the OpenShell-managed proxy path.Actual behavior: with the upstream
latest/v0.0.36startup environment,NO_PROXYincludes loopback and the OpenShell proxy host, but nothost.openshell.internal. A request tohttp://host.openshell.internal:8000/v1/modelsis sent through the policy proxy and denied.Proposed fix: #3013 adds the local host aliases to the default bypass list, allows
NEMOCLAW_NO_PROXY_EXTRAoverrides, and fixes thevllm-localdefault primary model selection.Reproduction Steps
http://host.openshell.internal:8000/v1.latestorv0.0.36with the current default proxy environment.Observed response:
{"detail":"GET host.openshell.internal:8000/v1/models not permitted by policy","error":"policy_denied"}NO_PROXYand repeat:Observed response: vLLM returns the model list successfully.
Environment
http://host.openshell.internal:8000/v1latest/v0.0.362026.5.6and vLLM servinggemma-4-26b-a4b-nvfp4Debug Output
Not attaching a full debug bundle because the repro is limited to proxy environment routing. The key comparison is:
Logs
{"detail":"GET host.openshell.internal:8000/v1/models not permitted by policy","error":"policy_denied"}Checklist