sqlcoder is an open-source LLM that converts natural language to high-quality SQL queries, making it easy to query data for even complex schemas and questions
Run it locally with Ollama:
ollama.ai/library/sqlcod…
Mixtral 8x22B running on a MacBook Pro with Ollama
Works with the latest pre-release version of 0.1.32 and will be published to ollama.com/library/mixtral soon.
TinyLlama is a 1.1B model with the Llama 2 architecture, trained on 3 trillion tokens.
Its small size means it can run fast with little memory and compute requirements.
Neural Chat is a new model based on Mistral and fine-tuned by Intel.
It's currently the highest-ranked 7B model on the HuggingFace H4 open-source LLM leaderboard.
Ollama 0.2 can now:
* Run different models side-by-side
* Process multiple requests in parallel
This enables a whole new set of RAG, agent and model serving use cases. Ollama will automatically load and unload models dynamically based on how much memory is in the system.
Ollama 0.2 is here! Concurrency is now enabled by default.
ollama.com/download
This unlocks 2 major features:
Parallel requests
Ollama can now serve multiple requests at the same time, using only a little bit of additional memory for each request. This enables use cases
zephyr is a 7B model created by the HuggingFace H4 team.
It's a fine-tuned version of Mistral 7B that beats Llama 2 70B Chat on a series of benchmarks. Built-in alignment layers were removed to improve results.
Docker + Ollama
Deploy and run LLMs such as Llama 2 and Mistral in Docker using Ollama.
Chat with models locally in containers + export a port to serve models over a REST api.
GPU acceleration built in with both Intel and Arm image versions available
Notux is a new 8x7B mixture of experts (MoE) model by @argilla_io, created by fine-tuning Mixtral on a high-quality dataset.
It's currently the top-performing mixture of experts model on the Hugging Face Open LLM Leaderboard!
Starling is a new 7 billion parameter large language model by @BanghuaZ & team.
This model outperforms every model to-date except GPT-4 and GPT-4 Turbo on MT-Bench, a benchmark to assess chatbot helpfulness.
CodeGemma is a new collection of 2B and 7B models by Google that specialize in coding tasks:
* Fill-in-the-middle code completion
* Code generation
* Mathematical reasoning
* Instruction following
