OLMo
OLMo is a fully open Ai2 language-model family. The original Open Language Model project releases model weights, Dolma training data, code, logs, and intermediate checkpoints to make the full language-model development process inspectable. Base models are designed for continuation rather than polished chat; later instruction and April/July data refreshes belong to this family. Apache-2.0 weights permit adaptation and deployment under the published terms. Outputs can hallucinate, and smaller tiers or different training stages should not be assumed to share identical capabilities.
2024-02-01
1B, 7B
Dense decoder-only Transformer
Apache-2.0
Specifications
- Parameters
- 1B, 7B
- Architecture
- Dense decoder-only Transformer
- License
- Apache-2.0
- Context Window
- 2,048 tokens
- Type
- text
- Modalities
- text
Benchmark Scores
Advanced Specifications
- Model Family
- Olmo
- API Access
- Not Available
- Chat Interface
- Not Available
- Variants
- 1B7BInstructApril/July 2024 refreshes
Capabilities & Limitations
- Capabilities
- text generationinstruction following
- Known Limitations
- Generated outputs can be incorrectPerformance varies by task and deployment
- Notable Use Cases
- language-model researchself-hosted assistance