AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
FrontierCode 1.1
FrontierCode 1.1 evaluates whether coding-agent changes are mergeable, using unit tests, maintainer-defined rubrics, and verifiers. Runs flagged for unfair internet use receive a zero score.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 16
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Claude Fable 5 | 0.535 | Not recorded | Not recorded | 2026-06-09 · model_announcement | LLM Stats |
| Claude Opus 5 | 0.534 | Not recorded | Not recorded | 2026-07-24 · model_announcement | LLM Stats |
| GPT-5.6 Sol | 0.475 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| Claude Opus 4.8 | 0.465 | Not recorded | Not recorded | 2026-05-28 · model_announcement | LLM Stats |
| Gemini 3.7 Flash | 0.436 | Not recorded | Not recorded | 2026-08-13 · model_announcement | LLM Stats |
| GPT-5.5 | 0.43 | Not recorded | Not recorded | 2026-04-23 · model_announcement | LLM Stats |
| Claude Sonnet 5 | 0.427 | Not recorded | Not recorded | 2026-06-30 · model_announcement | LLM Stats |
| Grok 4.5 | 0.424 | Not recorded | Not recorded | 2026-07-16 · model_announcement | LLM Stats |
| GPT-5.6 Terra | 0.413 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| GPT-5.6 Luna | 0.398 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| Claude Opus 4.7 | 0.385 | Not recorded | Not recorded | 2026-04-16 · model_announcement | LLM Stats |
| Kimi K2.7 Code | 0.301 | Not recorded | Not recorded | 2026-06-12 · model_announcement | LLM Stats |
| GLM-5.2 | 0.245 | Not recorded | Not recorded | 2026-06-16 · model_announcement | LLM Stats |
| DeepSeek-V4-Pro-Max | 0.176 | Not recorded | Not recorded | 2026-04-23 · model_announcement | LLM Stats |
| MiniMax M3 | 0.147 | Not recorded | Not recorded | 2026-06-01 · model_announcement | LLM Stats |
| Qwen3.7-Plus | 0.102 | Not recorded | Not recorded | 2026-05-31 · model_announcement | LLM Stats |