SmolLM2
SmolLM2 is a Hugging Face open-weight model family. The second generation extends training data and token budgets for small-device assistants. It improves instruction following, mathematics, code, and concise chat, with base and instruction variants across three sizes. A later 16K instruction checkpoint is a long-context variant rather than an independently named generation. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.
2024-10-31
135M, 360M, 1.7B
Dense decoder-only Transformer
Apache-2.0
Specifications
- Parameters
- 135M, 360M, 1.7B
- Architecture
- Dense decoder-only Transformer
- License
- Apache-2.0
- Context Window
- 8,192 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- SmolLM
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 135M360M1.7BBase/Instruct1.7B Instruct 16K
Capabilities & Limitations
- Capabilities
- text generationinstruction following
- Known Limitations
- Small models have limited broad knowledgeMedia support applies only to relevant tiers
- Notable Use Cases
- on-device assistantssmall-model researchprivate inference