AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

FrontierCode

FrontierCode is Cognition's coding evaluation that tests whether models can pass difficult coding tasks while meeting the standards of high-quality production codebases. The Diamond subset contains the hardest problems.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Grok 4.60.613Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Claude Opus 50.534Not recordedNot recorded2026-07-24 · model_announcementLLM Stats
Claude Fable 50.463Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Claude Sonnet 50.388Not recordedNot recorded2026-06-30 · model_announcementLLM Stats