AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Aider-Polyglot

A coding benchmark that evaluates LLMs on 225 challenging Exercism programming exercises across C++, Go, Java, JavaScript, Python, and Rust. Models receive two attempts to solve each problem, with test error feedback provided after the first attempt if it fails. The benchmark measures both initial problem-solving ability and capacity to edit code based on error feedback, providing an end-to-end evaluation of code generation and editing capabilities across multiple programming languages.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 22

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
GPT-50.88未收录未收录2025-08-07 · model_announcementLLM Stats
Gemini 2.5 Pro Preview 06-050.822未收录未收录2025-06-05 · model_announcementLLM Stats
o30.813未收录未收录2025-04-16 · model_announcementLLM Stats
Gemini 2.5 Pro0.765未收录未收录2025-05-20 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.745未收录未收录2025-09-29 · model_announcementLLM Stats
DeepSeek-R1-05280.716未收录未收录2025-05-28 · model_announcementLLM Stats
o4-mini0.689未收录未收录2025-04-16 · model_announcementLLM Stats
DeepSeek-V3.10.684未收录未收录2025-01-10 · model_announcementLLM Stats
o3-mini0.667未收录未收录2025-01-30 · model_announcementLLM Stats
Gemini 2.5 Flash0.619未收录未收录2025-05-20 · model_announcementLLM Stats
Qwen3-Coder 480B A35B Instruct0.618未收录未收录2025-01-31 · model_announcementLLM Stats
Kimi K2-Instruct-09050.6未收录未收录2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.6未收录未收录2025-07-11 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.573未收录未收录2025-07-22 · model_announcementLLM Stats
GPT-4.10.516未收录未收录2025-04-14 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.498未收录未收录2025-09-10 · model_announcementLLM Stats
DeepSeek-V30.496未收录未收录2024-12-25 · model_announcementLLM Stats
Magistral Medium0.471未收录未收录2025-06-10 · model_announcementLLM Stats
GPT-4.1 mini0.347未收录未收录2025-04-14 · model_announcementLLM Stats
GPT-4o0.307未收录未收录2024-08-06 · model_announcementLLM Stats
Gemini 2.5 Flash-Lite0.267未收录未收录2025-06-17 · model_announcementLLM Stats
GPT-4.1 nano0.098未收录未收录2025-04-14 · model_announcementLLM Stats