Anthropic logo

Claude 3.5 Haiku

AnthropicProprietaryVerified

Anthropics fastest model at time of launch, delivering intelligence at blazing speeds. Claude 3.5 Haiku is optimized for quick responses while maintaining high quality.

2024-10-22
Decoder-only Transformer
Proprietary

Specifications

Architecture
Decoder-only Transformer
License
Proprietary
Context Window
200,000 tokens
Max Output
8,192 tokens
Training Data Cutoff
July 2024
Type
multimodal
Modalities
textimage

Benchmark Scores

DROP83.1

Discrete Reasoning Over Paragraphs (DROP) requires models to resolve references in a passage and per...

The FACTS Grounding Leaderboard evaluates LLMs' ability to generate factually accurate long-form res...

GPQA41.6

Graduate-level Problems in Quantitative Analysis (GPQA) evaluates advanced reasoning on graduate-lev...

Evaluates code generation capabilities by asking models to complete Python functions based on docstr...

MATH69.4

A dataset of 12,500 challenging competition mathematics problems requiring multi-step reasoning....

MGSM85.6

Multilingual Grade School Math (MGSM) extends GSM8K to 10 languages....

Massive Multitask Language Understanding (MMLU) tests knowledge across 57 subjects including mathema...

Software Engineering Benchmark (SWE-bench) evaluates models on real-world software engineering tasks...

Tool Augmented Understanding Benchmark (TAU-bench) evaluates models on their ability to use tools....

Testing long-term coherence in agents by simulating a vending machine business. Agents manage orderi...

Advanced Specifications

Model Family
Claude
API Access
Available
Chat Interface
Available
Multilingual Support
Yes

Capabilities & Limitations

Capabilities
fast responsesbasic reasoninginstruction following
Notable Use Cases
real-time assistancecustomer supportquick information retrieval
Function Calling Support
Yes
Tool Use Support
Yes

Related Models