Mistral NeMo
Mistral NeMo is a 12B multilingual language model developed jointly by Mistral and NVIDIA. It provides base and instruction-tuned Apache-2.0 weights and long context for local and enterprise applications. The Tekken tokenizer improves token efficiency for many languages and code. It was designed for practical deployment with quantization support, but real memory use still depends on precision and context length. Its bilingual and multilingual quality should be measured on the actual languages required by an application.
2024-07-18
12B
Dense decoder-only Transformer
Apache-2.0
Specifications
- Parameters
- 12B
- Architecture
- Dense decoder-only Transformer
- License
- Apache-2.0
- Context Window
- 131,072 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- Mistral NeMo
- API Access
- Available
- Chat Interface
- Not Available
- Multilingual Support
- Yes
- Variants
- BaseInstruct
Capabilities & Limitations
- Capabilities
- multilingualcodinginstruction following
- Known Limitations
- Language quality varies across languagesQuantization and long context affect deployment
- Notable Use Cases
- local assistantsdomain fine-tuningenterprise chat