Skip to content

feat: memory-lancedb plugin should support local embedding providers (Ollama, etc.) not just OpenAI #23817

@lico-happy

Description

@lico-happy

Problem

The memory-lancedb long-term memory plugin requires an OpenAI API key (embedding.apiKey) and only supports text-embedding-3-small or text-embedding-3-large. There is no way to use it with local embedding providers like Ollama.

This creates a hard dependency on a paid external service for a feature that could otherwise run entirely locally. Agents who use local embedding stacks (Ollama, llama.cpp, etc.) are excluded.

Impact

  • Agents on self-hosted setups without OpenAI keys cannot use memory-lancedb at all
  • Projects like ClawBrain already solve local vector memory using Ollama — the bundled plugin should be at least as flexible
  • Forces cost on agents who want persistent memory but don't want to pay per-embedding

Proposed Solution

Support pluggable embedding providers in memory-lancedb:

{
  "plugins": {
    "slots": { "memory": "memory-lancedb" },
    "entries": {
      "memory-lancedb": {
        "config": {
          "embedding": {
            "provider": "ollama",
            "model": "all-minilm",
            "url": "http://localhost:11434"
          }
        }
      }
    }
  }
}

Or at minimum, support OpenAI-compatible endpoints so agents can point it at a local Ollama instance running an embedding model.

Current workaround

Use memory-core (bundled, no external key needed) or an external vector memory system like ClawBrain that uses Ollama natively.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions