A Llama bot in Teams allows you to chat directly with your Llama instance (or other Ollama models) and can also be added to an existing channel to interact with team members.

This bot has been build upon the work of rvinothrajendran, 01EchoBot sample.

• Docker and Docker Compose
• Domain name with SSL certificate
• Company admin Azure (Microsoft) account, with an App registration with a Secret key, Chat permissions and an Azure Bot with the teams channel enabled and the https://your_domain/api/messages messaging endpoint
• Nvidia GPU (for AMD change docker-compose file to AMD device)

1. Run git clone https://github.com/victornemeth/teamsllama.git && cd teamsllama

2. Run nano config.py and put in your APP ID and SECRET KEY

3. Run docker compose up -d

4. Run docker exec -it ollama ollama pull llama3.1:8b

5. Go to localhost:81 in browser or to your_local_ip:81 if you are on another machine

6. Login (Default Proxy Manager username: admin@example.com. Default Proxy Manager password: changeme)

7. Add proxy host

8. Put in Domain Name

9. Forward Hostname: teams-bot; Forward Port: 3978

10. Force SSL

11. Go to your Azure Portal, in the Azure Bot Channels, click Open in Teams

12. Chat with your model