AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

AIME 2025

Mathematical reasoning

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2025-02-12
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 270

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.2 (xhigh)0.99Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.986666666666667Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.97Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.966666666666667Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.966666666666667Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.963333333333333Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.956666666666667Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.956666666666667Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.95Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Kimi K2 Thinking0.946666666666667Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.946666666666667Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
GPT-5 (high)0.943333333333333Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.943333333333333Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
GPT-5.1 (high)0.94Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.934416666666667Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Grok 40.926666666666667Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.92Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GPT-5 (medium)0.916666666666667Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.916666666666667Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.913333333333333Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.91Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.91Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
GPT-5 mini (high)0.906666666666667Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
o4-mini (high)0.906666666666667Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.903333333333334Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.896666666666667Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.896666666666667Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.896666666666667Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.896666666666667Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.893333333333333Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.893333333333333Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Ring-1T0.893333333333333Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.89Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.886666666666667Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
o30.883333333333333Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.883333333333333Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
INTELLECT-30.88Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.88Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.88Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.876666666666667Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.876666666666667Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.875Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.866666666666667Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.86Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.853333333333333Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.85Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.85Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.846666666666667Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.846666666666667Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.846666666666667Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.843333333333333Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Ring-flash-2.00.836666666666667Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.836666666666667Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
GPT-5 nano (high)0.836666666666667Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 (low)0.83Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
MiniMax-M2.10.826666666666667Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.826666666666667Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.823333333333333Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.823333333333333Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Magistral Medium 1.20.82Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.82Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GLM-4.5-Air0.806666666666667Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Qwen3 Max0.806666666666667Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.803333333333333Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
Magistral Small 1.20.803333333333333Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.803333333333333Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.8Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Falcon-H1R-7B0.8Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
o1-preview0.796666666666667Not recordedNot recorded2024-09-12 · model_announcementArtificial Analysis
Doubao Seed Code0.793333333333333Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.786666666666667Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.783333333333333Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
K2-V2 (high)0.783333333333333Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.783333333333333Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
MiniMax-M20.783333333333333Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0.773333333333333Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.766666666666667Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.766666666666667Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.76Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.75Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.75Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.743333333333333Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.74Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.736666666666667Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Olmo 3 32B Think0.736666666666667Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.733333333333333Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.733333333333333Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.73Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.73Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.726666666666667Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.723333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.723333333333333Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.716666666666667Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
Ling-1T0.713333333333333Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Olmo 3 7B Think0.706666666666667Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.706666666666667Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.696666666666667Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.696666666666667Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.686666666666667Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.686666666666667Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.683333333333333Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.68Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.676666666666667Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.666666666666667Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.663333333333333Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.663333333333333Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Ling-flash-2.00.653333333333333Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
K2-V2 (medium)0.646666666666667Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.636666666666667Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.636666666666667Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.633333333333333Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 32B0.63Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.626666666666667Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.623333333333333Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.623333333333333Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.613333333333333Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
MiniMax M1 80k0.61Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.603333333333333Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.59Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.59Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Grok 30.58Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.58Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.576666666666667Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Kimi K2 09050.573333333333333Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Kimi K20.57Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.566666666666667Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.563333333333333Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.563333333333333Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.56Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.556666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.556666666666667Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 14B0.556666666666667Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.546666666666667Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.536666666666667Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.536666666666667Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.533333333333333Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.523333333333333Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.523333333333333Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.51Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.503333333333333Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.5Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.496666666666667Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Ling-mini-2.00.493333333333333Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.483333333333333Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.48Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.466666666666667Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.466666666666667Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.466666666666667Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-4.1 mini0.463333333333333Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.443333333333333Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.44Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Grok Code Fast 10.433333333333333Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 8B0.413333333333333Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Magistral Small 10.413333333333333Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.413333333333333Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.413333333333333Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.413333333333333Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
DeepSeek V3 03240.41Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Magistral Medium 10.403333333333333Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.393333333333333Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.393333333333333Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.39Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.386666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Medium 3.10.383333333333333Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Mistral Large 30.38Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.38Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.38Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.37Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.37Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.37Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Devstral 20.366666666666667Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Claude 4 Opus (Non-reasoning)0.363333333333333Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.363333333333333Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.353333333333333Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
K2-V2 (low)0.353333333333333Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
GPT-4.10.346666666666667Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.343333333333333Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Devstral Small 20.343333333333333Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.336666666666667Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Reka Flash 30.336666666666667Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Ministral 3 8B0.316666666666667Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
GPT-5 (minimal)0.316666666666667Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.306666666666667Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.306666666666667Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Mistral Medium 30.303333333333333Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.3Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Ministral 3 14B0.3Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.293333333333333Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
QwQ 32B0.29Not recordedNot recorded2025-03-05 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.29Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.273333333333333Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.273333333333333Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Mistral Small 3.20.27Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.266666666666667Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.263333333333333Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.26Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
GPT-4o (March 2025, chatgpt-4o-latest)0.256666666666667Not recordedNot recorded2025-03-27 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.256666666666667Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
LFM2 8B A1B0.253333333333333Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.243333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GPT-4.1 nano0.24Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.24Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.236666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.223333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 1.5B0.22Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Ministral 3 3B0.22Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.216666666666667Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.216666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.21Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.206666666666667Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3 32B (Non-reasoning)0.196666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 4 Maverick0.193333333333333Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.19Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.183333333333333Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.18Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Phi-40.18Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
Nova Premier0.173333333333333Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.153333333333333Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.153333333333333Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
GPT-4o mini0.146666666666667Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.143333333333333Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.14Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Llama 4 Scout0.14Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.14Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
MiniMax M1 40k0.136666666666667Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Granite 4.0 H Small0.136666666666667Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.133333333333333Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Command A0.13Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.126666666666667Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.113333333333333Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.11Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.106666666666667Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.103333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.103333333333333Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
LFM2 2.6B0.0833333333333333Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.08Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.0766666666666667Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0.0766666666666667Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.0733333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nova Pro0.07Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Nova Lite0.07Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.0666666666666667Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.0666666666666667Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Granite 4.0 1B0.0633333333333333Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.0633333333333333Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Granite 4.0 Micro0.06Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Nova Micro0.06Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.06Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Devstral Medium0.0466666666666667Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.0433333333333333Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Mistral Small 30.0433333333333333Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.04Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Mistral Small 3.10.0366666666666667Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
LFM2 1.2B0.0333333333333333Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
OLMo 2 32B0.0333333333333333Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.0333333333333333Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.0333333333333333Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.03Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Gemma 3 270M0.0233333333333333Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
Jamba 1.7 Large0.0233333333333333Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Pixtral Large0.0233333333333333Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.0166666666666667Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.0133333333333333Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
OLMo 2 7B0.00666666666666667Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.00333333333333333Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0.00333333333333333Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Granite 4.0 350M0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Molmo 7B-D0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis

Put this benchmark in context

Reasoning and math benchmarks