Hugging Face logo

SmolLM

Hugging FaceOpen WeightsPending Human Review

SmolLM is a Hugging Face open-weight model family. The first small-model family uses carefully curated educational, synthetic, and web data to support inexpensive local language generation. Base and instruction sizes run on relatively modest hardware but are not substitutes for larger models on demanding reasoning. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.

2024-07-16
135M, 360M, 1.7B
Dense decoder-only Transformer
Apache-2.0

Specifications

Parameters
135M, 360M, 1.7B
Architecture
Dense decoder-only Transformer
License
Apache-2.0
Context Window
2,048 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
SmolLM
API Access
Not Available
Chat Interface
Not Available
Variants
135M360M1.7BBase/Instruct

Capabilities & Limitations

Capabilities
text generationinstruction following
Known Limitations
Small models have limited broad knowledgeMedia support applies only to relevant tiers
Notable Use Cases
on-device assistantssmall-model researchprivate inference

Related Models