AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

AIME 2025

All 30 problems from the 2025 American Invitational Mathematics Examination (AIME I and AIME II), testing olympiad-level mathematical reasoning with integer answers from 000-999. Used as an AI benchmark to evaluate large language models' ability to solve complex mathematical problems requiring multi-step logical deductions and structured symbolic reasoning.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
2025-02-12
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 115

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.21.0Not recordedNot recorded2025-12-11 · model_announcementLLM Stats
GPT-5.2 Pro1.0Not recordedNot recorded2025-12-11 · model_announcementLLM Stats
Gemini 3 Pro1.0Not recordedNot recorded2025-11-18 · model_announcementLLM Stats
Kimi K2-Thinking-09051.0Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
Grok-4 Heavy1.0Not recordedNot recorded2025-07-09 · model_announcementLLM Stats
Claude Opus 4.60.9979Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
Gemini 3 Flash0.997Not recordedNot recorded2025-12-17 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.996Not recordedNot recorded2026-01-14 · model_announcementLLM Stats
GPT-5.1 High0.996Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
Nemotron 3 Nano (30B A3B)0.992Not recordedNot recorded2025-12-15 · model_announcementLLM Stats
GPT OSS 20B High0.987Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
GPT-5.1 Medium0.984Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
Seed 2.0 Pro0.983Not recordedNot recorded2026-02-14 · model_announcementLLM Stats
Step-3.5-Flash0.973Not recordedNot recorded2026-02-02 · model_announcementLLM Stats
MAI-Thinking-10.97Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Sarvam-30B0.967Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
Sarvam-105B0.967Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
GPT-5.1 Codex High0.967Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
Kimi K2.50.961Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
DeepSeek-V3.2-Speciale0.96Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
GLM-4.70.957Not recordedNot recorded2025-12-22 · model_announcementLLM Stats
GPT-5 High0.946Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
GPT-50.946Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
MiMo-V2-Flash0.941Not recordedNot recorded2025-12-16 · model_announcementLLM Stats
GPT-5.10.94Not recordedNot recorded2025-11-13 · model_announcementLLM Stats
GPT-5.1 Thinking0.94Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
GPT-5.1 Instant0.94Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
GLM-4.60.939Not recordedNot recorded2025-09-30 · model_announcementLLM Stats
Grok-30.933Not recordedNot recorded2025-02-17 · model_announcementLLM Stats
DeepSeek-V3.20.931Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.931Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
Seed 2.0 Lite0.93Not recordedNot recorded2026-02-14 · model_announcementLLM Stats
K-EXAONE-236B-A23B0.928Not recordedNot recorded2025-12-31 · model_announcementLLM Stats
o4-mini0.927Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
GPT OSS 120B High0.925Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
Nova 2 Pro0.923Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.923Not recordedNot recorded2025-07-25 · model_announcementLLM Stats
Nova 2 Omni0.921Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Grok 4 Fast0.92Not recordedNot recorded2025-08-28 · model_announcementLLM Stats
Grok-40.917Not recordedNot recorded2025-07-09 · model_announcementLLM Stats
GLM-4.7-Flash0.916Not recordedNot recorded2026-01-19 · model_announcementLLM Stats
Mercury 20.911Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
GPT-5 mini0.911Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
Nova 2 Lite0.91Not recordedNot recorded2025-12-02 · model_announcementLLM Stats
Grok-3 Mini0.908Not recordedNot recorded2025-02-17 · model_announcementLLM Stats
LongCat-Flash-Thinking0.906Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.9021Not recordedNot recorded2026-03-11 · model_announcementLLM Stats
Command A+0.9Not recordedNot recorded2026-05-20 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.897Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.893Not recordedNot recorded2025-09-29 · model_announcementLLM Stats
GPT-5 Medium0.889Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
Gemini 2.5 Pro Preview 06-050.88Not recordedNot recorded2025-06-05 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.878Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Step3-VL-10B0.877Not recordedNot recorded2026-01-15 · model_announcementLLM Stats
DeepSeek-R1-05280.875Not recordedNot recorded2025-05-28 · model_announcementLLM Stats
ERNIE 5.00.87Not recordedNot recorded2026-01-22 · model_announcementLLM Stats
Claude Sonnet 4.50.87Not recordedNot recorded2025-09-29 · model_announcementLLM Stats
o30.864Not recordedNot recorded2025-04-16 · model_announcementLLM Stats
Mistral Medium 3.50.863Not recordedNot recorded2026-04-29 · model_announcementLLM Stats
GPT-5 nano0.852Not recordedNot recorded2025-08-07 · model_announcementLLM Stats
Ministral 3 (14B Reasoning 2512)0.85Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Mistral Small 40.838Not recordedNot recorded2026-03-16 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.837Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.831Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Gemini 2.5 Pro0.83Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Qwen3 Max0.816Not recordedNot recorded2025-12-15 · model_announcementLLM Stats
Qwen3 235B A22B0.815Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
GPT-5.5 Instant0.812Not recordedNot recorded2026-05-05 · model_announcementLLM Stats
MiniMax M2.10.81Not recordedNot recorded2025-12-23 · model_announcementLLM Stats
Claude Haiku 4.50.807Not recordedNot recorded2025-10-15 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.803Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Ministral 3 (8B Reasoning 2512)0.787Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
MiniCPM-SALA0.7833Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
MiniMax M20.78Not recordedNot recorded2025-10-27 · model_announcementLLM Stats
Claude Opus 4.10.78Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
Phi 4 Reasoning Plus0.78Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
MiniMax M1 80K0.769Not recordedNot recorded2025-06-16 · model_announcementLLM Stats
Claude Opus 40.755Not recordedNot recorded2025-05-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.747Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
MiniMax M1 40K0.746Not recordedNot recorded2025-06-16 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.745Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 32B0.729Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
Llama 3.1 Nemotron Ultra 253B v10.725Not recordedNot recorded2025-04-07 · model_announcementLLM Stats
Min istral 3 (3B Reasoning 2512)0.721Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Nemotron Nano 9B v20.721Not recordedNot recorded2025-08-18 · model_announcementLLM Stats
Gemini 2.5 Flash0.72Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Qwen3 30B A3B0.709Not recordedNot recorded2025-04-29 · model_announcementLLM Stats
Claude Sonnet 40.705Not recordedNot recorded2025-05-22 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.703Not recordedNot recorded2025-07-22 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.695Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.693Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.662Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Magistral Medium0.649Not recordedNot recorded2025-06-10 · model_announcementLLM Stats
LongCat-Flash-Lite0.6323Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
Phi 4 Reasoning0.629Not recordedNot recorded2025-04-30 · model_announcementLLM Stats
Magistral Small 25060.6276Not recordedNot recorded2025-06-10 · model_announcementLLM Stats
LongCat-Flash-Chat0.6125Not recordedNot recorded2025-08-29 · model_announcementLLM Stats
Llama-3.3 Nemotron Super 49B v10.584Not recordedNot recorded2025-03-18 · model_announcementLLM Stats
Claude 3.7 Sonnet0.548Not recordedNot recorded2025-02-24 · model_announcementLLM Stats
LFM2.5-2.6B0.5187Not recordedNot recorded2026-08-04 · model_announcementLLM Stats
Gemini 2.5 Flash-Lite0.498Not recordedNot recorded2025-06-17 · model_announcementLLM Stats
DeepSeek-V3.10.498Not recordedNot recorded2025-01-10 · model_announcementLLM Stats
Kimi K2-Instruct-09050.495Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.495Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Llama 3.1 Nemotron Nano 8B V10.471Not recordedNot recorded2025-03-18 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.466Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
GPT-4.10.464Not recordedNot recorded2025-04-14 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.459Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
GPT-5.1 Codex Mini0.421Not recordedNot recorded2025-11-12 · model_announcementLLM Stats
GPT-4.1 mini0.402Not recordedNot recorded2025-04-14 · model_announcementLLM Stats
Gemini Diffusion0.233Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.116Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.116Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.067Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.067Not recordedNot recorded2025-05-20 · model_announcementLLM Stats