Aider-Polyglot
coding
Tests models on their ability to write code in multiple programming languages.
Published: 2024
Scale: 0-100
Top Score: 81.3
Aider-Polyglot Leaderboard
| Rank | Model | Provider | Score | Parameters | Released | Type |
|---|---|---|---|---|---|---|
| 1 | o3 | OpenAI | 81.3 | 2025-04-16 | Multimodal | |
| 2 | Gemini 2.5 Pro | 76.5 | 2025-05-06 | Multimodal | ||
| 3 | o4-mini | OpenAI | 68.9 | 2025-04-16 | Multimodal | |
| 4 | Gemini 2.5 Flash | 61.9 | 2025-05-20 | Multimodal | ||
| 5 | Qwen-3 | Alibaba | 61.8 | 235B (22B active) | 2025-04-29 | Text |
| 6 | DeepSeek-R1 | DeepSeek | 53.3 | 671B (37B activated) | 2025-01-20 | Text |
| 7 | DeepSeek-V3 | DeepSeek | 49.6 | 671B total, 37B activated | 2024-12-26 | Text |
About Aider-Polyglot
Description
Tests models on their ability to write code in multiple programming languages.
Methodology
Aider-Polyglot evaluates models on a scale of 0 to 100. Higher scores indicate better performance. For detailed information about the methodology, please refer to the original paper.
Publication
This benchmark was published in 2024.Read the full paper