DeepSeekMath
DeepSeekMath is a 7B mathematics-focused language-model family built through continued pretraining of DeepSeek-Coder-Base-v1.5 on mathematical web content, followed by instruction tuning and reinforcement learning. Its paper introduces Group Relative Policy Optimization (GRPO), an approach subsequently used in reasoning-model research. Base, Instruct, and RL checkpoints are available. The model targets mathematical problem solving and structured reasoning rather than an all-purpose multimodal assistant. Weights are distributed under the custom DeepSeek Model License, with commercial use supported under its terms.
2024-02-05
7B
Decoder-only Transformer
DeepSeek Model License
Specifications
- Parameters
- 7B
- Architecture
- Decoder-only Transformer
- License
- DeepSeek Model License
- Context Window
- 4,096 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- DeepSeek
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- DeepSeekMath-7B-BaseDeepSeekMath-7B-InstructDeepSeekMath-7B-RL
Capabilities & Limitations
- Capabilities
- mathematical reasoningchain-of-thoughtsymbolic problem solving
- Known Limitations
- A 7B specialized model can fail on advanced mathematical derivations.Model weights have custom licensing terms.
- Notable Use Cases
- mathematics researchmath tutoring prototypesreinforcement-learning studies