Skip to content

Add Ollama Cloud as built-in provider #3926

@goemonwanwan

Description

@goemonwanwan

Problem

Ollama Cloud (https://ollama.com) is a cloud inference service with OpenAI-compatible API. Currently, users must configure it via custom_providers, but this causes issues:

  1. The provider: ollama-cloud setting is not recognized in auxiliary sections
  2. Workaround requires provider: custom + redundant base_url + api_key in every auxiliary task config
  3. PROVIDER_REGISTRY in auth.py does not include ollama-cloud

Proposed Solution

Add ollama-cloud to PROVIDER_REGISTRY in hermes_cli/auth.py:

"ollama-cloud": ProviderConfig(
    id="ollama-cloud",
    name="Ollama Cloud",
    auth_type="api_key",
    inference_base_url="https://ollama.com/v1",
    api_key_env_vars=("OLLAMA_CLOUD_API_KEY",),
),

Also add default auxiliary model in auxiliary_client.py:

_API_KEY_PROVIDER_AUX_MODELS["ollama-cloud"] = "nemotron-3-super"

Benefit

Before (workaround):

auxiliary:
  vision:
    provider: custom
    base_url: https://ollama.com/v1
    api_key: xxx
    model: qwen3.5:cloud

After (with built-in provider):

auxiliary:
  vision:
    provider: ollama-cloud
    model: qwen3.5:cloud

API key can be set via OLLAMA_CLOUD_API_KEY environment variable or custom_providers entry.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions