AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MBPP+

MBPP+ is an enhanced version of MBPP (Mostly Basic Python Problems) with significantly more test cases (35x) for more rigorous evaluation. MBPP is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers, covering programming fundamentals and standard library functionality.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
MiMo-V2.5-Pro0.741Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.672Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.632Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
ERNIE 4.50.402Not recordedNot recorded2025-06-25 · model_announcementLLM Stats