Hugging Face logo

SmolLM3

Hugging FaceOpen WeightsPending Human Review

SmolLM3 is a Hugging Face open-weight model family. The 3B successor adds optional reasoning, six natively supported languages, and long-context capabilities. It is trained at 64K context and supports extension to 128K through YaRN. The public release includes training recipes, data mixture, and base/instruction weights for reproducible small-model research. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.

2025-07-08
3B
Dense decoder-only Transformer
Apache-2.0

Specifications

Parameters
3B
Architecture
Dense decoder-only Transformer
License
Apache-2.0
Context Window
131,072 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
SmolLM
API Access
Not Available
Chat Interface
Not Available
Variants
3B Base3B Instruct/Reasoning

Capabilities & Limitations

Capabilities
text generationinstruction following
Known Limitations
Small models have limited broad knowledgeMedia support applies only to relevant tiers
Notable Use Cases
on-device assistantssmall-model researchprivate inference

Related Models