Skip to content

Allow users to override OPENAI_API_URL to use a local LLM#2

Merged
kamilmac merged 2 commits intokamilmac:mainfrom
EDToaster:main
May 14, 2025
Merged

Allow users to override OPENAI_API_URL to use a local LLM#2
kamilmac merged 2 commits intokamilmac:mainfrom
EDToaster:main

Conversation

@EDToaster
Copy link
Copy Markdown
Contributor

@EDToaster EDToaster commented May 14, 2025

This commit adds the ability to override the OpenAI API endpoint. Ollama (and others) conform to the OpenAI chat completions API, which allows us to run Unibear against a local LLM.

Usage

For example, against Ollama models

OPENAI_API_URL=http://localhost:11434/v1 OPENAI_API_KEY=unibear unibear

@kamilmac kamilmac mentioned this pull request May 14, 2025
@EDToaster EDToaster requested a review from kamilmac May 14, 2025 16:18
@kamilmac kamilmac merged commit 731448f into kamilmac:main May 14, 2025
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants