LiveCodeBench v6

codingPending Human Review

Benchmark for evaluating LLMs on code generation tasks from contests.

Published: 2024
Score Range: 0-100
Top Score: 46.9

LiveCodeBench v6 Leaderboard

RankModelProviderScoreParametersReleasedType
1DeepSeek-V3DeepSeek
46.9
671B total, 37B activated2024-12-26Text
2Claude Opus 4Anthropic
44.7
2025-05-22Multimodal
3Gemini 2.5 FlashGoogle
44.7
2025-05-20Multimodal
4GPT-4.1OpenAI
44.7
2025-04-14Multimodal

About LiveCodeBench v6

Methodology

LiveCodeBench v6 evaluates model performance using a standardized scoring methodology. Scores are reported on a scale of 0 to 100, where higher scores indicate better performance. For detailed information about the scoring system and methodology, please refer to the original paper.

Publication

This benchmark was published in 2024.Website

Related Benchmarks