Skip to content

[Docs] docker.md missing local LLM connection guide (host.docker.internal) #7963

@r266-tech

Description

@r266-tech

Problem

PR #7950 added Docker/Podman/Lima DNS name detection to is_local_endpoint() — these hostnames now auto-trigger relaxed streaming timeouts. But the docs don't mention this anywhere:

  • docker.md has no section about connecting to a host-side LLM (Ollama, llama.cpp, etc.) from inside a Hermes container
  • local-llm-on-mac.md Timeouts section says "localhost, LAN IPs" but doesn't mention host.docker.internal and friends

User impact

A user running Hermes in Docker + Ollama on the host has no docs guidance on:

  1. Which hostname to use (host.docker.internal vs localhost — the latter won't work from inside Docker)
  2. That Hermes auto-detects these hostnames as local (no manual timeout config needed)

Proposed fix

  1. Add a "Connecting to local LLMs on the host" section to docker.md with a hostname table (Docker/Podman/Lima) and a config example
  2. Update the auto-detection description in local-llm-on-mac.md Timeouts section to mention container DNS names

Metadata

Metadata

Assignees

No one assigned

    Labels

    P3Low — cosmetic, nice to havearea/dockerDocker image, Compose, packagingtype/docsDocumentation improvements

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions