Grade School Math 8K (GSM8K) consists of 8.5K high-quality grade school math word problems.

GSM8K

Claude 3.5 Sonnet raises the industry bar for intelligence, outperforming competitor models and Claude 3 Opus on a wide range of evaluations, with the speed and cost of a mid-tier model. It operates at twice the speed of Claude 3 Opus.

Claude 3.5 Sonnet

Anthropic's most intelligent model at release, with best-in-market performance on highly complex tasks. It can navigate open-ended prompts with remarkable fluency and human-like understanding. Pricing at launch: $15 per million input tokens, $75 per million output tokens.

Claude 3 Opus

Nemotron 3 Nano is a 31.6B parameter hybrid large language model developed by NVIDIA, released on December 15, 2025. It employs a novel Hybrid Mamba-Transformer Mixture-of-Experts (MoE) architecture, activating only ~3.2B parameters per token for efficient inference. Optimized for agentic AI, reasoning, and coding, it supports a 1 million token context window and features a 'Reasoning ON/OFF' toggle with a configurable thinking budget. NVIDIA has released the model with open weights, training data, and training recipes under the NVIDIA Open Model License.

Nemotron 3 Nano

Anthropic's balanced model that strikes an ideal balance between intelligence and speed for enterprise workloads. Delivers strong performance at a lower cost compared to its peers. Pricing at launch: $3 per million input tokens, $15 per million output tokens.

Claude 3 Sonnet

Second-generation Qwen model (72B parameters) open-sourced under Alibaba's Qianwen License. Trained on 3T tokens; released alongside smaller variants and intended as foundation for Alibaba's enterprise AI services.

Qwen-2

A powerful Mixture-of-Experts (MoE) language model with 671B total parameters and 37B activated for each token. Features Multi-head Latent Attention (MLA) and DeepSeekMoE architectures with innovative auxiliary-loss-free load balancing and multi-token prediction training. Pre-trained on 14.8T high-quality tokens with only 2.788M H800 GPU hours.

DeepSeek-V3

Anthropic's fastest and most compact model at the time of launch with near-instant responsiveness. Answers simple queries and requests with unmatched speed while maintaining good quality. Pricing at launch: $0.25 per million input tokens, $1.25 per million output tokens.

Claude 3 Haiku

A sparse Mixture-of-Experts (SMoE) model that uses only 39B active parameters out of 141B total, offering unparalleled cost efficiency for its size. Sets a new standard for performance and efficiency within the AI community.

Mixtral 8×22B

Anthropic's most capable system at release, representing a continuous evolution from previous Claude models. Trained via unsupervised learning, RLHF, and Constitutional AI with both supervised and reinforcement learning phases. Features improved helpfulness, honesty, and harmlessness (HHH) with enhanced coding abilities, longer output generation up to 4000 tokens, and better structured data formatting capabilities.

Claude 2

The Thinking checkpoint is a distinct reasoning tier that produces intermediate thinking traces before its final answer. It targets offline mathematics, instruction following, and tool selection on memory-constrained hardware. Quantized deployment can fit below 1GB, although exact memory and throughput depend on the hardware, precision, and context. Downloadable weights use the Liquid Open Model License, whose commercial-use conditions should be checked before deployment. Local inference supports private customization, while task reliability and performance require evaluation on the intended hardware.

Rank	Model	Provider	Score	Parameters	Released	Type
1	Claude 3.5 Sonnet	Anthropic	96.4		2024-06-20	Multimodal
2	Claude 3 Opus	Anthropic	95		2024-03-04	Multimodal
3	Nemotron 3 Nano	NVIDIA	92.34	31.6B (Total), ~3.2B (Active)	2025-12-15	Text
4	Claude 3 Sonnet	Anthropic	92.3		2024-03-04	Multimodal
5	Qwen-2	Alibaba	89.5	72B	2024-06-11	Text
6	DeepSeek-V3	DeepSeek	89.3	671B total, 37B activated	2024-12-26	Text
7	Claude 3 Haiku	Anthropic	88.9		2024-03-04	Multimodal
8	Mixtral 8×22B	Mistral AI	88	141B (39B active)	2024-04-17	Text
9	Claude 2	Anthropic	88	~130B	2023-07-11	Text
10	LFM2.5 1.2B Thinking	Liquid AI	85.6	1.17B	2026-01-20	Text

GSM8K

GSM8K Leaderboard

About GSM8K

Methodology

Publication

Related Benchmarks

AIME-2024

AIME-2025

AIME