Feature Request: MCP Apps Support in Chat Interface

Background

LocalAI already supports MCP (Model Context Protocol) as mentioned in the repository description. However, there is currently limited support for MCP apps (pre-configured MCP server integrations) directly within the chat interface.

Current State

• Issue MCP / Agent mode is not working when model file is shared #7143 indicates MCP/Agent mode exists but has bugs when model files are shared
• MCP functionality appears to be backend-focused rather than chat-integrated
• No existing issue specifically addresses MCP apps support in the chat UI

Proposed Enhancement

Add support for MCP apps in the LocalAI chat interface, allowing users to:

1. Discover and connect MCP apps directly from the chat UI
2. Manage MCP app configurations (enable/disable, configure parameters)
3. Visualize MCP tool availability during chat sessions
4. Seamlessly switch between standard chat and MCP-enhanced interactions

User Benefits

• Easier adoption: Users can discover and enable MCP capabilities without manual configuration
• Better UX: Clear indication when MCP tools are available for the current context
• Flexible workflows: Toggle MCP apps on/off per conversation as needed
• Discovery: Browse available MCP apps and their capabilities

Suggested Implementation Approach

1. Add an "MCP Apps" section in the chat interface settings/sidebar
2. Implement app discovery mechanism (local registry or remote marketplace)
3. Add connection status indicators for each MCP app
4. Provide inline documentation/tooltips for each MCP tool
5. Ensure compatibility with existing MCP/Agent mode implementation

References

• Related issue: MCP / Agent mode is not working when model file is shared #7143 (MCP/Agent mode issues with shared model files)
• MCP specification: https://modelcontextprotocol.io/
• LocalAI already lists MCP as a supported feature

Priority

This feature would significantly enhance LocalAI's agentic capabilities and user experience, making it more competitive with cloud-based alternatives that offer similar MCP integration.

Created as part of research into MCP app support for LocalAI