Mistral Small 4
Mistral Small 4 unifies chat instruction following, reasoning, coding, and image understanding in one configurable open-weight model. Its sparse expert architecture uses 128 experts, selecting four per token; the provider distinguishes six billion active expert parameters from eight billion including embedding and output layers. Users can choose direct answers or deeper reasoning per request. It is distributed under Apache 2.0 with support in common self-hosting runtimes. Despite the Small name, its total weights require considerably more memory than the earlier 24B Small models.
2026-03-16
119B total; 6B active (8B including embedding/output)
Mixture-of-experts Transformer, 128 experts, top-4 routing
Apache-2.0
Specifications
- Parameters
- 119B total; 6B active (8B including embedding/output)
- Architecture
- Mixture-of-experts Transformer, 128 experts, top-4 routing
- License
- Apache-2.0
- Context Window
- 262,144 tokens
- Type
- multimodal
- Modalities
- textimage
Benchmark Scores
Advanced Specifications
- Model Family
- Mistral Small
- API Access
- Available
- Chat Interface
- Not Available
Capabilities & Limitations
- Capabilities
- configurable reasoningvisioncodingagentic tasks
- Known Limitations
- Deployment requires multiple datacenter GPUs in published configurationsDeep reasoning adds latency
- Notable Use Cases
- multimodal assistantscoding agentsdocument analysis
- Tool Use Support
- Yes