SmolLM3
SmolLM3 is a Hugging Face open-weight model family. The 3B successor adds optional reasoning, six natively supported languages, and long-context capabilities. It is trained at 64K context and supports extension to 128K through YaRN. The public release includes training recipes, data mixture, and base/instruction weights for reproducible small-model research. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.
2025-07-08
3B
Dense decoder-only Transformer
Apache-2.0
Specifications
- Parameters
- 3B
- Architecture
- Dense decoder-only Transformer
- License
- Apache-2.0
- Context Window
- 131,072 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- SmolLM
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 3B Base3B Instruct/Reasoning
Capabilities & Limitations
- Capabilities
- text generationinstruction following
- Known Limitations
- Small models have limited broad knowledgeMedia support applies only to relevant tiers
- Notable Use Cases
- on-device assistantssmall-model researchprivate inference