FlexOlmo
FlexOlmo is Ai2’s modular open language model for combining independently trained data-domain experts without pooling their underlying data. Seven expert branches cover public-mix, news, mathematics, code, academic writing, creative writing, and Reddit. Its 33B mixture-of-experts model demonstrates selective inclusion and exclusion of datasets through expert composition and routing. Ai2 releases weights and methods to study flexible data collaboration and governance. The expert label describes a training domain rather than a guaranteed factual specialty, and removing an expert can change behavior on other domains.
2025-07-09
33B total
Modular mixture-of-experts Transformer
Apache-2.0
Specifications
- Parameters
- 33B total
- Architecture
- Modular mixture-of-experts Transformer
- License
- Apache-2.0
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- FlexOlmo
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 7x7B expert configuration
Capabilities & Limitations
- Capabilities
- text generationmodular expert composition
- Known Limitations
- Research modelExpert selection affects capabilities
- Notable Use Cases
- data-governance researchmodular language-model training