-
-
Notifications
You must be signed in to change notification settings - Fork 17.9k
Description
Check Existing Issues
- I have searched the existing issues and discussions.
Problem Description
CONTEXT:
When upgrading beyond 0.6.5, I noticed a requirement that the task model must be public. I now get an error that says “This model is not publicly available. Please select another model.” Prior to this, I could select any task model and it would work for all users without having to share the model with them.
This creates a problem for me because my use case requires offering a limited set of highly curated and customized models with very tailored system prompts and parameters, and not allowing access to other models.
Desired Solution you'd like
Either (1) restore the prior functionality that doesn’t require the task model to be public in order to be used behind the scenes for all of the tasks it does, or (2) allow the task models (even though public) to be hidden from all users.
I’d prefer (1) because it makes a lot more sense to me that the system has access to all models for whatever tasks it needs without having to make them public and expose the internal task model to everyone, instead of requiring a task model to be made public then hiding it from the public - that’s a contradiction that’s way more confusing than the system simply being able to use it.
Alternatives Considered
I can’t find any alternatives that are built in to the system now. I don’t want to maintain a separate code base to solve this issue.
Additional Context
Just FYI in case this matters - I prefer to use a model I’ve created in the workspace based on the task model I’ve created in ollama which I set to keepalive=forever so it’s always ready. I noticed in 0.6.9 that these workspace models disappeared from the task dropdown list, but they’ve returned again in 0.6.10, so I assume that was just a bug that’s now been resolved.