DeepSeek logo

DeepSeekMath

DeepSeekOpen WeightsPending Human Review

DeepSeekMath is a 7B mathematics-focused language-model family built through continued pretraining of DeepSeek-Coder-Base-v1.5 on mathematical web content, followed by instruction tuning and reinforcement learning. Its paper introduces Group Relative Policy Optimization (GRPO), an approach subsequently used in reasoning-model research. Base, Instruct, and RL checkpoints are available. The model targets mathematical problem solving and structured reasoning rather than an all-purpose multimodal assistant. Weights are distributed under the custom DeepSeek Model License, with commercial use supported under its terms.

2024-02-05
7B
Decoder-only Transformer
DeepSeek Model License

Specifications

Parameters
7B
Architecture
Decoder-only Transformer
License
DeepSeek Model License
Context Window
4,096 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
DeepSeek
API Access
Not Available
Chat Interface
Not Available
Variants
DeepSeekMath-7B-BaseDeepSeekMath-7B-InstructDeepSeekMath-7B-RL

Capabilities & Limitations

Capabilities
mathematical reasoningchain-of-thoughtsymbolic problem solving
Known Limitations
A 7B specialized model can fail on advanced mathematical derivations.Model weights have custom licensing terms.
Notable Use Cases
mathematics researchmath tutoring prototypesreinforcement-learning studies

Related Models