AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MATH
MATH dataset contains 12,500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels (1-5) across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- 2021-11-08
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 71
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| o3-mini | 0.979 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| o1 | 0.964 | Not recorded | Not recorded | 2024-12-17 · model_announcement | LLM Stats |
| MiniStral 3 (14B Instruct 2512) | 0.904 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Mistral Large 3 | 0.904 | Not recorded | Not recorded | 2025-09-01 · model_announcement | LLM Stats |
| Gemini 2.0 Flash | 0.897 | Not recorded | Not recorded | 2024-12-01 · model_announcement | LLM Stats |
| Kimi K2 0905 | 0.891 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| Gemma 3 27B | 0.89 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Ministral 3 (8B Instruct 2512) | 0.876 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Gemini 2.0 Flash-Lite | 0.868 | Not recorded | Not recorded | 2025-02-05 · model_announcement | LLM Stats |
| Gemini 1.5 Pro | 0.865 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| MiMo-V2.5-Pro | 0.862 | Not recorded | Not recorded | 2026-04-27 · model_announcement | LLM Stats |
| o1-preview | 0.855 | Not recorded | Not recorded | 2024-09-12 · model_announcement | LLM Stats |
| GPT-5 | 0.847 | Not recorded | Not recorded | 2025-08-07 · model_announcement | LLM Stats |
| Gemma 3 12B | 0.838 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Qwen2.5 32B Instruct | 0.831 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Qwen2.5 72B Instruct | 0.831 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Ministral 3 (3B Instruct 2512) | 0.83 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Qwen2.5 VL 32B Instruct | 0.822 | Not recorded | Not recorded | 2025-02-28 · model_announcement | LLM Stats |
| Phi 4 | 0.804 | Not recorded | Not recorded | 2024-12-12 · model_announcement | LLM Stats |
| Qwen2.5 14B Instruct | 0.8 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.783 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Gemini 1.5 Flash | 0.779 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| Llama 3.3 70B Instruct | 0.77 | Not recorded | Not recorded | 2024-12-06 · model_announcement | LLM Stats |
| Nova Pro | 0.766 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| GPT-4o | 0.766 | Not recorded | Not recorded | 2024-05-13 · model_announcement | LLM Stats |
| Grok-2 | 0.761 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Gemma 3 4B | 0.756 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Qwen2.5 7B Instruct | 0.755 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| DeepSeek-V2.5 | 0.747 | Not recorded | Not recorded | 2024-05-08 · model_announcement | LLM Stats |
| Llama 3.1 405B Instruct | 0.738 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Nova Lite | 0.733 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| Grok-2 mini | 0.73 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| GPT-4 Turbo | 0.726 | Not recorded | Not recorded | 2024-04-09 · model_announcement | LLM Stats |
| Qwen3 235B A22B | 0.7184 | Not recorded | Not recorded | 2025-04-29 · model_announcement | LLM Stats |
| Qwen2.5-Omni-7B | 0.715 | Not recorded | Not recorded | 2025-03-27 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.711 | Not recorded | Not recorded | 2024-06-21 · model_announcement | LLM Stats |
| Mistral Small 3 24B Instruct | 0.706 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| Kimi K2 Base | 0.702 | Not recorded | Not recorded | 2025-07-11 · model_announcement | LLM Stats |
| GPT-4o mini | 0.702 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |
| Mistral Small 3.2 24B Instruct | 0.6942 | Not recorded | Not recorded | 2025-06-20 · model_announcement | LLM Stats |
| Claude 3.5 Haiku | 0.694 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Mistral Small 3.1 24B Instruct | 0.693 | Not recorded | Not recorded | 2025-03-17 · model_announcement | LLM Stats |
| Nova Micro | 0.693 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| Llama 3.2 90B Instruct | 0.68 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Phi 4 Mini | 0.64 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| Llama 4 Maverick | 0.612 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Claude 3 Opus | 0.601 | Not recorded | Not recorded | 2024-02-29 · model_announcement | LLM Stats |
| Qwen2 72B Instruct | 0.597 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Phi-3.5-MoE-instruct | 0.595 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Gemini 1.5 Flash 8B | 0.587 | Not recorded | Not recorded | 2024-03-15 · model_announcement | LLM Stats |
| Qwen2.5-Coder 32B Instruct | 0.572 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Ministral 8B Instruct | 0.545 | Not recorded | Not recorded | 2024-10-16 · model_announcement | LLM Stats |
| Llama 3.2 11B Instruct | 0.519 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Grok-1.5 | 0.506 | Not recorded | Not recorded | 2024-03-28 · model_announcement | LLM Stats |
| Llama 4 Scout | 0.503 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Qwen2 7B Instruct | 0.496 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Phi-3.5-mini-instruct | 0.485 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Pixtral-12B | 0.481 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| Gemma 3 1B | 0.48 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Llama 3.2 3B Instruct | 0.48 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Qwen2.5-Coder 7B Instruct | 0.466 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Mistral Small 3 24B Base | 0.4598 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| Claude 3 Sonnet | 0.431 | Not recorded | Not recorded | 2024-02-29 · model_announcement | LLM Stats |
| GPT-3.5 Turbo | 0.431 | Not recorded | Not recorded | 2023-03-21 · model_announcement | LLM Stats |
| Gemma 2 27B | 0.423 | Not recorded | Not recorded | 2024-06-27 · model_announcement | LLM Stats |
| GPT-4 | 0.42 | Not recorded | Not recorded | 2023-06-13 · model_announcement | LLM Stats |
| Claude 3 Haiku | 0.389 | Not recorded | Not recorded | 2024-03-13 · model_announcement | LLM Stats |
| Gemma 2 9B | 0.366 | Not recorded | Not recorded | 2024-06-27 · model_announcement | LLM Stats |
| Gemini 1.0 Pro | 0.326 | Not recorded | Not recorded | 2024-02-15 · model_announcement | LLM Stats |
| Hermes 3 70B | 0.208 | Not recorded | Not recorded | 2024-08-15 · model_announcement | LLM Stats |
| ERNIE 4.5 | 0.124 | Not recorded | Not recorded | 2025-06-25 · model_announcement | LLM Stats |