AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
ARC-AGI
The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a benchmark designed to test general intelligence and abstract reasoning capabilities through visual grid-based transformation tasks. Each task consists of 2-5 demonstration pairs showing input grids transformed into output grids according to underlying rules, with test-takers required to infer these rules and apply them to novel test inputs. The benchmark uses colored grids (up to 30x30) with 10 discrete colors/symbols, designed to measure human-like general fluid intelligence and skill-acquisition efficiency with minimal prior knowledge.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- image
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 8
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| GPT-5.5 | 0.95 | Not recorded | Not recorded | 2026-04-23 · model_announcement | LLM Stats |
| GPT-5.4 | 0.937 | Not recorded | Not recorded | 2026-03-05 · model_announcement | LLM Stats |
| GPT-5.2 Pro | 0.905 | Not recorded | Not recorded | 2025-12-11 · model_announcement | LLM Stats |
| o3 | 0.88 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| GPT-5.2 | 0.862 | Not recorded | Not recorded | 2025-12-11 · model_announcement | LLM Stats |
| Inkling-Small | 0.84 | Not recorded | Not recorded | 2026-07-30 · model_announcement | LLM Stats |
| LongCat-Flash-Thinking | 0.503 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3-235B-A22B-Instruct-2507 | 0.418 | Not recorded | Not recorded | 2025-07-22 · model_announcement | LLM Stats |