SmolLM
SmolLM is a Hugging Face open-weight model family. The first small-model family uses carefully curated educational, synthetic, and web data to support inexpensive local language generation. Base and instruction sizes run on relatively modest hardware but are not substitutes for larger models on demanding reasoning. Apache-2.0 licensing supports local deployment and adaptation. Model outputs can hallucinate and reflect training biases; multimodal tiers can also misread fine visual details.
2024-07-16
135M, 360M, 1.7B
Dense decoder-only Transformer
Apache-2.0
Specifications
- Parameters
- 135M, 360M, 1.7B
- Architecture
- Dense decoder-only Transformer
- License
- Apache-2.0
- Context Window
- 2,048 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- SmolLM
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 135M360M1.7BBase/Instruct
Capabilities & Limitations
- Capabilities
- text generationinstruction following
- Known Limitations
- Small models have limited broad knowledgeMedia support applies only to relevant tiers
- Notable Use Cases
- on-device assistantssmall-model researchprivate inference