Skip to content
This repository was archived by the owner on Nov 21, 2025. It is now read-only.

Add Custom REST api LLMs support#56

Merged
micr0-dev merged 4 commits intomainfrom
feature/remoteLLm
Apr 21, 2024
Merged

Add Custom REST api LLMs support#56
micr0-dev merged 4 commits intomainfrom
feature/remoteLLm

Conversation

@micr0-dev
Copy link
Copy Markdown
Owner

Allows for completely custom LLM support via REST API

Example config:

{
	"api_config": {
	  "url": "https://api.example.com/v1/chat/completions", // Replace with your API endpoint
	  "headers": {
		"Content-Type": "application/json",
		"Authorization": "Bearer 123124534545634", // Replace with your API key
		"Accept": "application/json"
	  },
	  "data_template": {
		"model": "example-model",
		"messages": "<PROMPT>" // This is where the prompt will be inserted
	  }
	}
  }

Can easily add support for ChatGPT, Claude, etc.

@micr0-dev micr0-dev self-assigned this Apr 21, 2024
@micr0-dev micr0-dev marked this pull request as ready for review April 21, 2024 15:01
@micr0-dev micr0-dev merged commit d14f07d into main Apr 21, 2024
@micr0-dev micr0-dev deleted the feature/remoteLLm branch April 21, 2024 15:03
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant