American Invitational Mathematics Examination (AIME) 2025 problems.

AIME-2025

xAI's most advanced model yet, blending superior reasoning with extensive pretraining knowledge. Trained on the Colossus supercluster with 10x the compute of previous state-of-the-art models. Features test-time compute and reasoning capabilities through reinforcement learning, allowing it to think for seconds to minutes while correcting errors and exploring alternatives. Achieved an Elo score of 1402 in the Chatbot Arena.

Grok 3

A smaller model optimized for fast, cost-efficient reasoning. Achieves remarkable performance for its size and cost, particularly in math, coding, and visual tasks. It is the best-performing benchmarked model on AIME 2024 and 2025, with significantly higher usage limits than o3.

o4-mini

xAI's latest generation model with enhanced mathematical reasoning capabilities, showing significant improvements in competition-level mathematics benchmarks. Features 2x faster end-to-end latency, supports 5 different voices, and achieves 10x daily user seconds compared to previous models.

Grok 4

A smaller, more efficient version of Grok 3 from xAI. Represents a new frontier in cost-efficient reasoning, particularly strong on STEM tasks that don't require as much world knowledge. Also features test-time compute and reasoning capabilities through the Grok 3 mini (Think) variant, achieving impressive performance on mathematical and coding benchmarks while being more resource-efficient than the full Grok 3 model.

Grok 3 Mini

Gemini 2.5 Pro is capable of reasoning through its thoughts before responding, resulting in enhanced performance and improved accuracy. Features Deep Think, an enhanced reasoning mode, and native audio outputs that capture subtle nuances of speech.

Gemini 2.5 Pro

Third-generation Qwen model featuring hybrid reasoning capabilities that can switch between thinking and non-thinking modes. Trained on 36 trillion tokens (double that of Qwen2.5), with support for 119 languages and dialects. Available in 6 dense models (0.6B to 32B parameters) and 2 MoE models (30B/3B active and 235B/22B active).

Qwen-3

Improved across key benchmarks for reasoning, multimodality, code and long context while getting even more efficient. Best for fast performance on complex tasks.

Gemini 2.5 Flash

Google's most cost-efficient and fastest 2.5 model yet. Higher quality than 2.0 Flash-Lite on coding, math, science, reasoning and multimodal benchmarks. Excels at high-volume, latency-sensitive tasks like translation and classification.

Gemini 2.5 Flash-Lite

Moonshot's latest Mixture-of-Experts model with 32 billion activated parameters and 1 trillion total parameters. Achieves state-of-the-art performance in frontier knowledge, math, and coding among non-thinking models. Meticulously optimized for agentic tasks with sophisticated tool-use capabilities and multi-turn interactions.

Kimi K2

A powerful Mixture-of-Experts (MoE) language model with 671B total parameters and 37B activated for each token. Features Multi-head Latent Attention (MLA) and DeepSeekMoE architectures with innovative auxiliary-loss-free load balancing and multi-token prediction training. Pre-trained on 14.8T high-quality tokens with only 2.788M H800 GPU hours.

Rank	Model	Provider	Score	Parameters	Released	Type
1	Grok 3	xAI	93.3	Unknown (multi-trillion estimated)	2025-02-19	Multimodal
2	o4-mini	OpenAI	92.7		2025-04-16	Multimodal
3	Grok 4	xAI	91.7	Unknown	2025-07-09	Multimodal
4	Grok 3 Mini	xAI	90.8	Unknown	2025-02-19	Multimodal
5	Gemini 2.5 Pro	Google	83		2025-05-06	Multimodal
6	Qwen-3	Alibaba	81.5	235B (22B active)	2025-04-29	Text
7	Gemini 2.5 Flash	Google	72		2025-05-20	Multimodal
8	Gemini 2.5 Flash-Lite	Google	63.1		2025-06-17	Multimodal
9	Kimi K2	Moonshot AI	49.5	1T total, 32B activated	2025-07-11	Text
10	DeepSeek-V3	DeepSeek	46.7	671B total, 37B activated	2024-12-26	Text

AIME-2025

AIME-2025 Leaderboard

About AIME-2025

Methodology

Publication

Related Benchmarks

AIME-2024

AIME

GSM8K