AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MultiPL-E

MultiPL-E is a scalable and extensible system for translating unit test-driven code generation benchmarks to multiple programming languages. It extends HumanEval and MBPP Python benchmarks to 18 additional programming languages, enabling evaluation of neural code generation models across diverse programming paradigms and language features.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 13

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3-235B-A22B-Instruct-25070.879Not recordedNot recorded2025-07-22 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.878Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.861Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Kimi K2-Instruct-09050.857Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.857Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.754Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2.5 72B Instruct0.751Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.728Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2.5 7B Instruct0.704Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2 72B Instruct0.692Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Qwen3 235B A22B0.6594Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.658Not recordedNot recorded2025-03-27 · model_announcementLLM Stats
Qwen2 7B Instruct0.591Not recordedNot recorded2024-07-23 · model_announcementLLM Stats