AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

EvalPlus

A rigorous code synthesis evaluation framework that augments existing datasets with extensive test cases generated by LLM and mutation-based strategies to better assess functional correctness of generated code, including HumanEval+ with 80x more test cases

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2 Base0.803Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Qwen2 72B Instruct0.79Not recordedNot recorded2024-07-23 · model_announcementLLM Stats
Qwen3 235B A22B0.776Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
Qwen2 7B Instruct0.703Not recordedNot recorded2024-07-23 · model_announcementLLM Stats