This directory contains examples that demonstrate how to use the Inference Gateway with Docker Compose.

• Docker
• Docker Compose

• Basic - Simple setup with a single model provider
• MCP - Model Context Protocol integration with multiple tool servers
• Hybrid - Configuration with multiple model providers (cloud and local)
• Tools - Function calling and tool usage examples
• Authentication - Adding authentication to your gateway
• Monitoring - Metrics collection and visualization with Prometheus and Grafana

Each example directory contains:

• A README with specific instructions
• A docker-compose.yml file
• An .env.example file

To run any example:

1. Navigate to the example directory:

cd examples/docker-compose/[example-name]

1. Copy the environment file and customize as needed:

cp .env.example .env

1. Start the services:

docker compose up -d

1. Follow the specific instructions in the example's README for testing and usage

Common environment variables used across examples:

• Main Documentation
• Kubernetes Examples
• Configuration Guide

If you encounter any issues with these examples, please open an issue on GitHub.