AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

PaperBench

PaperBench is a benchmark for evaluating AI agents on their ability to replicate research papers. It tests models on complex, multi-step workflows involving code implementation, experimentation, and reproducing scientific results from academic publications.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.8 Max0.93Not recordedNot recorded2026-08-02 · model_announcementLLM Stats
Kimi K2.50.635Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
MiniMax M30.526Not recordedNot recorded2026-06-01 · model_announcementLLM Stats