Hugging Face logo

SmolLM2

Hugging FaceOpen WeightsPending Human Review

SmolLM2 is a Hugging Face open-weight model family. The second generation extends training data and token budgets for small-device assistants. It improves instruction following, mathematics, code, and concise chat, with base and instruction variants across three sizes. A later 16K instruction checkpoint is a long-context variant rather than an independently named generation. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.

2024-10-31
135M, 360M, 1.7B
Dense decoder-only Transformer
Apache-2.0

Specifications

Parameters
135M, 360M, 1.7B
Architecture
Dense decoder-only Transformer
License
Apache-2.0
Context Window
8,192 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
SmolLM
API Access
Not Available
Chat Interface
Not Available
Variants
135M360M1.7BBase/Instruct1.7B Instruct 16K

Capabilities & Limitations

Capabilities
text generationinstruction following
Known Limitations
Small models have limited broad knowledgeMedia support applies only to relevant tiers
Notable Use Cases
on-device assistantssmall-model researchprivate inference

Related Models