Mistral AI logo

Mistral NeMo

Mistral AIOpen WeightsPending Human Review

Mistral NeMo is a 12B multilingual language model developed jointly by Mistral and NVIDIA. It provides base and instruction-tuned Apache-2.0 weights and long context for local and enterprise applications. The Tekken tokenizer improves token efficiency for many languages and code. It was designed for practical deployment with quantization support, but real memory use still depends on precision and context length. Its bilingual and multilingual quality should be measured on the actual languages required by an application.

2024-07-18
12B
Dense decoder-only Transformer
Apache-2.0

Specifications

Parameters
12B
Architecture
Dense decoder-only Transformer
License
Apache-2.0
Context Window
131,072 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
Mistral NeMo
API Access
Available
Chat Interface
Not Available
Multilingual Support
Yes
Variants
BaseInstruct

Capabilities & Limitations

Capabilities
multilingualcodinginstruction following
Known Limitations
Language quality varies across languagesQuantization and long context affect deployment
Notable Use Cases
local assistantsdomain fine-tuningenterprise chat

Related Models