Allen Institute for AI logo

FlexOlmo

Allen Institute for AIOpen WeightsPending Human Review

FlexOlmo is Ai2’s modular open language model for combining independently trained data-domain experts without pooling their underlying data. Seven expert branches cover public-mix, news, mathematics, code, academic writing, creative writing, and Reddit. Its 33B mixture-of-experts model demonstrates selective inclusion and exclusion of datasets through expert composition and routing. Ai2 releases weights and methods to study flexible data collaboration and governance. The expert label describes a training domain rather than a guaranteed factual specialty, and removing an expert can change behavior on other domains.

2025-07-09
33B total
Modular mixture-of-experts Transformer
Apache-2.0

Specifications

Parameters
33B total
Architecture
Modular mixture-of-experts Transformer
License
Apache-2.0
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
FlexOlmo
API Access
Not Available
Chat Interface
Not Available
Variants
7x7B expert configuration

Capabilities & Limitations

Capabilities
text generationmodular expert composition
Known Limitations
Research modelExpert selection affects capabilities
Notable Use Cases
data-governance researchmodular language-model training

Related Models