Anthropic logo

Claude 3.5 Haiku

AnthropicProprietaryVerified

Anthropics fastest model at time of launch, delivering intelligence at blazing speeds. Claude 3.5 Haiku is optimized for quick responses while maintaining high quality.

2024-10-22
Decoder-only Transformer
Proprietary

Specifications

Architecture
Decoder-only Transformer
License
Proprietary
Context Window
200,000 tokens
Max Output
8,192 tokens
Training Data Cutoff
July 2024
Type
multimodal
Modalities
textimage

Benchmark Scores

GPQA41.6

Graduate-level Problems in Quantitative Analysis (GPQA) evaluates advanced reasoning on graduate-lev...

MMLU65

Massive Multitask Language Understanding (MMLU) tests knowledge across 57 subjects including mathema...

SWE-bench40.6

Software Engineering Benchmark (SWE-bench) evaluates models on real-world software engineering tasks...

HumanEval88.1

Evaluates code generation capabilities by asking models to complete Python functions based on docstr...

MATH69.4

A dataset of 12,500 challenging competition mathematics problems requiring multi-step reasoning....

MGSM85.6

Multilingual Grade School Math (MGSM) extends GSM8K to 10 languages....

DROP83.1

Discrete Reasoning Over Paragraphs (DROP) requires models to resolve references in a passage and per...

TAU-bench51

Tool Augmented Understanding Benchmark (TAU-bench) evaluates models on their ability to use tools....

See all benchmarks

Advanced Specifications

Model Family
Claude
API Access
Available
Chat Interface
Available
Multilingual Support
Yes

Capabilities & Limitations

Capabilities
fast responsesbasic reasoninginstruction following
Notable Use Cases
real-time assistancecustomer supportquick information retrieval
Function Calling Support
Yes
Tool Use Support
Yes

Related Models