Talks and Presentations

This session examines how financial institutions navigate the complex security and governance requirements of GenAI by building resilient infrastructure that spans cloud and on-premise environments. It details Bloomberg's production implementation of the Envoy AI Gateway, showcasing how features like intelligent routing and secure authentication enable the safe, scalable delivery of real-time AI traffic.

This talk explores what it takes to build GenAI platforms capable of serving modern inference at scale without falling to the dark side of complexity. You'll learn from a real-world reference architecture using open-source tools like Envoy AI Gateway, KServe, and others-designed to support dynamic model-based routing, token-level rate limiting, secure upstream auth, observability, and multi-provider failover. These aren't bonus features-they're the new minimum requirements for reliable AI inference.

In this talk we will explore use, configuration and inner workings of the new features in Envoy AI Gateway.

This session introduces the Envoy AI Gateway, a recent open-source CNCF project designed to be the central control plane for your GenAI traffic. Learn how it provides a unified API to abstract away the differences between various AI/LLM providers, enabling seamless model switching.

This panel brings together Envoy maintainers, builders, and adopters who are shaping the next generation of GenAI platforms and infrastructure. We'll explore how Envoy is evolving to meet the needs of AI workloads, how the community is adapting to new demands, and how adopters are leveraging Envoy.

In this talk, we will dive into the architecture of Envoy AI Gateway to learn how it extends Envoy’s capabilities to efficiently manage AI-driven workloads for enterprise needs, while providing robustness, scalability, and adaptability in the rapidly-changing generative AI landscape. We will also showcase a demo of an AI agent seamlessly accessing models anywhere through a unified API.