ai/devstral-small-2 repository overview

⁠Devstral Small 2

GGUF version by Unsloth

⁠Description

Devstral is an agentic LLM for software engineering tasks. Devstral Small 2 excels at using tools to explore codebases, editing multiple files and power software engineering agents. The model achieves remarkable performance on SWE-bench.

This model is an Instruct model in FP8, fine-tuned to follow instructions, making it ideal for chat, agentic and instruction based tasks for SWE use cases.

⁠Key Features

The Devstral Small 2 Instruct model offers the following capabilities:

• Agentic Coding: Devstral is designed to excel at agentic coding tasks, making it a great choice for software engineering agents.
• Lightweight: with its compact size of just 24 billion parameters, Devstral is light enough to run on a single RTX 4090 or a Mac with 32GB RAM, making it an appropriate model for local deployment and on-device use.
• Apache 2.0 License: Open-source license allowing usage and modification for both commercial and non-commercial purposes.
• Context Window: A 256k context window.

Updates compared to Devstral Small 1.1:

• Vision Capabilities: Enables the model to analyze images and provide insights based on visual content, in addition to text.
• Improved Performance: Devstral Small 2 is a step-up compared to its predecessors.
• Attention Softmax Temperature: Devstral Small 2 uses the same architecture as Ministral 3 using rope-scaling as introduced by Llama 4 and Scalable-Softmax Is Superior for Attention.
• Better Generalization: Generalises better to diverse prompts and coding environments.

⁠Use Cases

AI Code Assistants, Agentic Coding, and Software Engineering Tasks. Leveraging advanced AI capabilities for complex tool integration and deep codebase understanding in coding environments.

⁠Use this AI model with Docker Model Runner

docker model run devstral-small-2

⁠Links

• Mistral AI Announcement⁠
• Hugging Face GGUF⁠