Allen Institute for AI logo

OLMo

Allen Institute for AIOpen WeightsPending Human Review

OLMo is a fully open Ai2 language-model family. The original Open Language Model project releases model weights, Dolma training data, code, logs, and intermediate checkpoints to make the full language-model development process inspectable. Base models are designed for continuation rather than polished chat; later instruction and April/July data refreshes belong to this family. Apache-2.0 weights permit adaptation and deployment under the published terms. Outputs can hallucinate, and smaller tiers or different training stages should not be assumed to share identical capabilities.

2024-02-01
1B, 7B
Dense decoder-only Transformer
Apache-2.0

Specifications

Parameters
1B, 7B
Architecture
Dense decoder-only Transformer
License
Apache-2.0
Context Window
2,048 tokens
Type
text
Modalities
text

Benchmark Scores

Advanced Specifications

Model Family
Olmo
API Access
Not Available
Chat Interface
Not Available
Variants
1B7BInstructApril/July 2024 refreshes

Capabilities & Limitations

Capabilities
text generationinstruction following
Known Limitations
Generated outputs can be incorrectPerformance varies by task and deployment
Notable Use Cases
language-model researchself-hosted assistance

Related Models