AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

GDPval

Graded by expert human comparison against real deliverables, and the "-AA" variants are run by Artificial Analysis rather than the vendor, so an Elo here is not comparable to a vendor-run pass rate.

Evaluation context and evidence

Source
Model reports
Publisher
Not recorded
Benchmark release
2025-09-25
Collected
Not recorded
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 6

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Opus 51861.0eloELO rating, max effort, agentic loop with shell access and web browsing2026-07-24 · document_publicationClaude Opus 5
DeepSeek-V4-Pro1554.0elothink max, Elo2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Flash1395.0elothink max, Elo2026-06-25 · document_publicationDeepSeek-V4
Kimi K31686.0eloElo, reasoning=max2026-06-13 · document_publicationKimi K3
Hy4 preview1678.0eloGDPval-AA V2, Elo, official2026-08-28 · document_publicationHy4 preview
GLM-5.3-Flash1773.0eloGDPval-AA v2, evaluated by Artificial Analysis2026-08-27 · document_publicationGLM-5.3-Flash