AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
Aider-Polyglot Edit
A challenging multi-language coding benchmark that evaluates models' code editing abilities across C++, Go, Java, JavaScript, Python, and Rust. Contains 225 of Exercism's most difficult programming problems, selected as problems that were solved by 3 or fewer out of 7 top coding models. The benchmark focuses on code editing tasks and measures both correctness of solutions and proper edit format usage. Designed to re-calibrate evaluation scales so top models score between 5-50%.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 10
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| DeepSeek-V3 | 0.797 | Not recorded | Not recorded | 2024-12-25 · model_announcement | LLM Stats |
| Gemini 2.5 Pro | 0.727 | Not recorded | Not recorded | 2025-05-20 · model_announcement | LLM Stats |
| o3-mini | 0.604 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| o4-mini | 0.582 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Gemini 2.5 Flash | 0.567 | Not recorded | Not recorded | 2025-05-20 · model_announcement | LLM Stats |
| GPT-4.1 | 0.529 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| GPT-4.5 | 0.449 | Not recorded | Not recorded | 2025-02-27 · model_announcement | LLM Stats |
| GPT-4.1 mini | 0.316 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| GPT-4o | 0.182 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| GPT-4.1 nano | 0.062 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |