AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

HumanEval+

Enhanced version of HumanEval that extends the original test cases by 80x using EvalPlus framework for rigorous evaluation of LLM-synthesized code functional correctness, detecting previously undetected wrong code

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 10

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Phi 4 Reasoning0.929Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Phi 4 Reasoning Plus0.923Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Granite 3.3 8B Base0.8609Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Granite 3.3 8B Instruct0.8609Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Phi 40.828Not recordedNot recorded2024-12-12 · model_announcementLLM Stats
IBM Granite 4.0 Tiny Preview0.783Not recordedNot recorded2025-05-02 · model_announcementLLM Stats
MiMo-V2.5-Pro0.756Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.524Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.512Not recordedNot recorded2024-09-19 · model_announcementLLM Stats
ERNIE 4.50.25Not recordedNot recorded2025-06-25 · model_announcementLLM Stats