DeepSeek-Coder-V2
DeepSeek-Coder-V2 is an open-weight coding MoE family built by continuing pretraining from DeepSeek-V2 on additional code and mathematics data. It supports 338 programming languages, repository-scale context, and fill-in-the-middle completion. The family includes 236B and 16B Lite checkpoints, each with base and instruct versions. The 128K context specification applies to the published family. Downloadable weights use the DeepSeek Model License; historical deepseek-coder API access has migrated to later models.
2024-06-17
236B total / 21B active; Lite 16B total / 2.4B active
Mixture of Experts (DeepSeekMoE) with Multi-head Latent Attention
DeepSeek Model License
Specifications
- Parameters
- 236B total / 21B active; Lite 16B total / 2.4B active
- Architecture
- Mixture of Experts (DeepSeekMoE) with Multi-head Latent Attention
- License
- DeepSeek Model License
- Context Window
- 128,000 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- DeepSeek
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- DeepSeek-Coder-V2-BaseDeepSeek-Coder-V2-InstructDeepSeek-Coder-V2-Lite-BaseDeepSeek-Coder-V2-Lite-InstructDeepSeek-Coder-V2-Instruct-0724
Capabilities & Limitations
- Capabilities
- code generationcode debuggingmathematicsfill-in-the-middle completion
- Known Limitations
- Custom license applies to model weights.Hosted coder aliases now serve later models; reproducibility requires a named checkpoint.
- Notable Use Cases
- repository-scale codingIDE completionsoftware engineering research