Grade School Math 8K (GSM8K) consists of 8.5K high-quality grade school math word problems.

GSM8K

Claude 3.5 Sonnet raises the industry bar for intelligence, outperforming competitor models and Claude 3 Opus on a wide range of evaluations, with the speed and cost of a mid-tier model. It operates at twice the speed of Claude 3 Opus.

Claude 3.5 Sonnet

Anthropic's most intelligent model at release, with best-in-market performance on highly complex tasks. It can navigate open-ended prompts with remarkable fluency and human-like understanding. Pricing at launch: $15 per million input tokens, $75 per million output tokens.

Claude 3 Opus

Anthropic's balanced model that strikes an ideal balance between intelligence and speed for enterprise workloads. Delivers strong performance at a lower cost compared to its peers. Pricing at launch: $3 per million input tokens, $15 per million output tokens.

Claude 3 Sonnet

Second-generation Qwen model (72B parameters) open-sourced under Alibaba's Qianwen License. Trained on 3T tokens; released alongside smaller variants and intended as foundation for Alibaba's enterprise AI services.

Qwen-2

A powerful Mixture-of-Experts (MoE) language model with 671B total parameters and 37B activated for each token. Features Multi-head Latent Attention (MLA) and DeepSeekMoE architectures with innovative auxiliary-loss-free load balancing and multi-token prediction training. Pre-trained on 14.8T high-quality tokens with only 2.788M H800 GPU hours.

DeepSeek-V3

Anthropic's fastest and most compact model at the time of launch with near-instant responsiveness. Answers simple queries and requests with unmatched speed while maintaining good quality. Pricing at launch: $0.25 per million input tokens, $1.25 per million output tokens.

Claude 3 Haiku

Gemma 3 is a collection of lightweight, state-of-the-art open models built from the same research and technology that powers Gemini 2.0 models. The most capable model you can run on a single GPU or TPU, delivering state-of-the-art performance for its size and outperforming Llama3-405B, DeepSeek-V3 and o3-mini in preliminary human preference evaluations on LMArena's leaderboard. Features advanced text and visual reasoning capabilities, 128K token context window, function calling, and support for over 140 languages.

Gemma 3

DeepSeek LLM is an advanced language model comprising 67 billion parameters, trained from scratch on a vast dataset of 2 trillion tokens in both English and Chinese. The model demonstrates superior general capabilities, outperforming Llama2 70B Base in reasoning, coding, math, and Chinese comprehension. Available in both Base and Chat variants with 7B and 67B parameter sizes.

Rank	Model	Provider	Score	Parameters	Released	Type
1	Claude 3.5 Sonnet	Anthropic	96.4		2024-06-20	Multimodal
2	Claude 3 Opus	Anthropic	95		2024-03-04	Multimodal
3	Claude 3 Sonnet	Anthropic	92.3		2024-03-04	Multimodal
4	Qwen-2	Alibaba	89.5	72B	2024-06-11	Text
5	DeepSeek-V3	DeepSeek	89.3	671B total, 37B activated	2024-12-26	Text
6	Claude 3 Haiku	Anthropic	88.9		2024-03-04	Multimodal
7	Gemma 3	Google	78.5	1B, 4B, 12B, 27B	2025-03-12	Multimodal
8	DeepSeek LLM	DeepSeek	63.4	67B	2023-11-01	Text

GSM8K

GSM8K Leaderboard

About GSM8K

Description

Methodology

Publication

Related Benchmarks

AIME-2024

AIME-2025

AIME