Grade School Math 8K (GSM8K) consists of 8.5K high-quality grade school math word problems.

GSM8K

Claude 3.5 Sonnet raises the industry bar for intelligence, outperforming competitor models and Claude 3 Opus on a wide range of evaluations, with the speed and cost of a mid-tier model. It operates at twice the speed of Claude 3 Opus.

Claude 3.5 Sonnet

Moonshot's latest Mixture-of-Experts model with 32 billion activated parameters and 1 trillion total parameters. Achieves state-of-the-art performance in frontier knowledge, math, and coding among non-thinking models. Meticulously optimized for agentic tasks with sophisticated tool-use capabilities and multi-turn interactions.

Kimi K2

Anthropic's most intelligent model at release, with best-in-market performance on highly complex tasks. It can navigate open-ended prompts with remarkable fluency and human-like understanding. Pricing at launch: $15 per million input tokens, $75 per million output tokens.

Claude 3 Opus

Anthropic's balanced model that strikes an ideal balance between intelligence and speed for enterprise workloads. Delivers strong performance at a lower cost compared to its peers. Pricing at launch: $3 per million input tokens, $15 per million output tokens.

Claude 3 Sonnet

Second-generation Qwen model (72B parameters) open-sourced under Alibaba's Qianwen License. Trained on 3T tokens; released alongside smaller variants and intended as foundation for Alibaba's enterprise AI services.

Qwen-2

A powerful Mixture-of-Experts (MoE) language model with 671B total parameters and 37B activated for each token. Features Multi-head Latent Attention (MLA) and DeepSeekMoE architectures with innovative auxiliary-loss-free load balancing and multi-token prediction training. Pre-trained on 14.8T high-quality tokens with only 2.788M H800 GPU hours.

DeepSeek-V3

Anthropic's fastest and most compact model at the time of launch with near-instant responsiveness. Answers simple queries and requests with unmatched speed while maintaining good quality. Pricing at launch: $0.25 per million input tokens, $1.25 per million output tokens.

Claude 3 Haiku

A sparse Mixture-of-Experts (SMoE) model that uses only 39B active parameters out of 141B total, offering unparalleled cost efficiency for its size. Sets a new standard for performance and efficiency within the AI community.

Mixtral 8×22B

Anthropic's most capable system at release, representing a continuous evolution from previous Claude models. Trained via unsupervised learning, RLHF, and Constitutional AI with both supervised and reinforcement learning phases. Features improved helpfulness, honesty, and harmlessness (HHH) with enhanced coding abilities, longer output generation up to 4000 tokens, and better structured data formatting capabilities.

Claude 2

Gemma 3 is a collection of lightweight, state-of-the-art open models built from the same research and technology that powers Gemini 2.0 models. The most capable model you can run on a single GPU or TPU, delivering state-of-the-art performance for its size and outperforming Llama3-405B, DeepSeek-V3 and o3-mini in preliminary human preference evaluations on LMArena's leaderboard. Features advanced text and visual reasoning capabilities, 128K token context window, function calling, and support for over 140 languages.

Rank	Model	Provider	Score	Parameters	Released	Type
1	Claude 3.5 Sonnet	Anthropic	96.4		2024-06-20	Multimodal
2	Kimi K2	Moonshot AI	95	1T total, 32B activated	2025-07-11	Text
3	Claude 3 Opus	Anthropic	95		2024-03-04	Multimodal
4	Claude 3 Sonnet	Anthropic	92.3		2024-03-04	Multimodal
5	Qwen-2	Alibaba	89.5	72B	2024-06-11	Text
6	DeepSeek-V3	DeepSeek	89.3	671B total, 37B activated	2024-12-26	Text
7	Claude 3 Haiku	Anthropic	88.9		2024-03-04	Multimodal
8	Mixtral 8×22B	Mistral AI	88	141B (39B active)	2024-04-17	Text
9	Claude 2	Anthropic	88	~130B	2023-07-11	Text
10	Gemma 3	Google	78.5	1B, 4B, 12B, 27B	2025-03-12	Multimodal

GSM8K

GSM8K Leaderboard

About GSM8K

Methodology

Publication

Related Benchmarks

AIME-2024

AIME-2025

AIME