Hi, thank you for creating this repo. It's really helpful, it was the software I needed. I also do open source and I know that people never say thank you.

My question is: I'm new on this, what is the best tool that you recommend for running this on production? I was using ollama, but im not sure if it's the best.

Also, might be nice to allow discussions in this repo, that's the best way to answer this kind of questions and not create an issue.

Thank you very much.