AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

ARC-AGI-3

Interactive multi-step format, so the agent harness is part of the measurement. Scores are low and spread wide, which makes small absolute gaps look larger than they are.

Evaluation context and evidence

Source
Model reports
Publisher
Not recorded
Benchmark release
2026-01-15
Collected
Not recorded
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 1

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Opus 530.16percenthigh effort, verified score, semi-private evaluation set2026-07-24 · document_publicationClaude Opus 5