Skip to main content
Envoy AI Gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to GenAI services.

Built together. Built in the open.

Built together. Built in the open.

Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy.

v0.4 Release now available

v0.4 Release now available

The v0.4 Release of Envoy AI Gateway is now available. See the release notes for more information.

Get involved in the community

Get involved in the community

Join our community on Slack, join the conversation on GitHub, and attend our Monday community meetings. See links in footer.

Latest from the Blog

Stay up to date with the latest news, features, and insights from the Envoy AI Gateway team.

The Reality and Performance of MCP Traffic Routing with Envoy AI Gateway

The Reality and Performance of MCP Traffic Routing with Envoy AI Gateway

In this article explore how Envoy AI Gateway handles stateful MCP sessions, keeps performance competitive, and stays aligned with the broader Envoy ecosystem.

features
Announcing Model Context Protocol Support in Envoy AI Gateway

Announcing Model Context Protocol Support in Envoy AI Gateway

Envoy AI Gateway now supports Model Context Protocol (MCP), bringing enterprise-grade security, routing, and observability to AI agent tool integrations with full spec compliance, OAuth authentication, and zero-friction deployment.

newsfeatures
Enhancing AI Gateway Observability - OpenTelemetry Tracing Arrives in Envoy AI Gateway

Enhancing AI Gateway Observability - OpenTelemetry Tracing Arrives in Envoy AI Gateway

Envoy AI Gateway v0.3 introduces OpenTelemetry tracing with OpenInference conventions, providing complete visibility into LLM application behavior beyond metrics.Understand not just what happened, but why.

features

Supported LLM Providers

With the latest version of Envoy AI Gateway you can route traffic to these LLM providers, displayed alphabetically, out of the box.

For more information and the most up-to-date provider integrations, check out our provider documentation.

Anthropic logo
Anthropic
AWS Bedrock logo
AWS Bedrock
Azure OpenAI logo
Azure OpenAI
Cohere logo
Cohere
DeepInfra logo
DeepInfra
DeepSeek logo
DeepSeek
Google Gemini logo
Google Gemini
Grok logo
Grok
Groq logo
Groq
Hunyuan logo
Hunyuan
Mistral logo
Mistral
OpenAI logo
OpenAI
SambaNova logo
SambaNova
Tetrate Agent Router Service logo
Tetrate Agent Router Service
Together AI logo
Together AI
Vertex AI logo
Vertex AI