feat: add HERMES_LLM_BASE_URL fallback for MeshBoard stream-tap proxy#23
Merged
Conversation
… support MeshBoard stream-tap launcher needs to intercept inference traffic via a local proxy. Add HERMES_LLM_BASE_URL env var that overrides the resolved base_url, with proper precedence rules: - Pool entries: HERMES_LLM_BASE_URL overrides pool base_url for non-OAuth providers (OAuth tokens are scoped to their own endpoints) - _resolve_openrouter_runtime: fallback after OPENROUTER_BASE_URL - _resolve_explicit_runtime: fallback after provider-specific env vars Also add HERMES_SKIP_PROFILE_OVERRIDE env var to skip profile resolution when stream-tap launcher needs to force a specific HERMES_HOME. Fixes hermes-llm-base-url-env-override
b4d9e34 to
908669a
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add
HERMES_LLM_BASE_URLenv var support so MeshBoard stream-tap launcher can intercept inference traffic via a local proxy.Changes
hermes_cli/runtime_provider.pyHERMES_LLM_BASE_URLoverrides pool base_url for non-OAuth providers (OAuth tokens are scoped to their own endpoints and must not be redirected)OPENROUTER_BASE_URLandCUSTOM_BASE_URLhermes_cli/main.pyHERMES_SKIP_PROFILE_OVERRIDE: skip profile resolution entirely when set, allowing stream-tap launcher to force a specificHERMES_HOMEwithout profile redirectionPrecedence
Provider-specific env vars (e.g.
OPENROUTER_BASE_URL) always win overHERMES_LLM_BASE_URL. The env var is a fallback, not an override.Tests
HERMES_LLM_BASE_URL(pool, explicit path, precedence, trailing slash, no-env fallback)HERMES_SKIP_PROFILE_OVERRIDEFixes hermes-llm-base-url-env-override