Skip to content

Support MCP Tool Injection via stdio in Standard Chat #8884

@localai-bot

Description

@localai-bot

Feature Request

When the model specifies mcps/stdio endpoints, the standard chat interface should use MCP to inject available tools to the model.

Current Behavior

Currently, when mcps/stdio is specified, only the endpoints are configured, but the tools are not automatically injected into the standard chat interface.

Desired Behavior

When mcps/stdio is specified:

  1. The MCP server should be connected via stdio
  2. Available tools from the MCP server should be automatically injected into the model's context
  3. The standard chat interface should be able to utilize these tools

Use Case

This would allow users to seamlessly extend the model's capabilities with external tools without manually configuring tool injections in the chat interface.

Related

This enhancement would complement the existing MCP endpoint configuration by adding automatic tool discovery and injection capabilities.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions