AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MATH-500
MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- OpenAI
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 32
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| LongCat-Flash-Thinking | 0.992 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Sarvam-105B | 0.986 | Not recorded | Not recorded | 2026-03-06 · model_announcement | LLM Stats |
| GLM-4.5 | 0.982 | Not recorded | Not recorded | 2025-07-28 · model_announcement | LLM Stats |
| GLM-4.5-Air | 0.981 | Not recorded | Not recorded | 2025-07-28 · model_announcement | LLM Stats |
| Nemotron Nano 9B v2 | 0.978 | Not recorded | Not recorded | 2025-08-18 · model_announcement | LLM Stats |
| Kimi K2-Instruct-0905 | 0.974 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| Kimi K2 Instruct | 0.974 | Not recorded | Not recorded | 2025-07-11 · model_announcement | LLM Stats |
| Sarvam-30B | 0.97 | Not recorded | Not recorded | 2026-03-06 · model_announcement | LLM Stats |
| Llama 3.1 Nemotron Ultra 253B v1 | 0.97 | Not recorded | Not recorded | 2025-04-07 · model_announcement | LLM Stats |
| LongCat-Flash-Lite | 0.968 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| MiniMax M1 80K | 0.968 | Not recorded | Not recorded | 2025-06-16 · model_announcement | LLM Stats |
| Llama-3.3 Nemotron Super 49B v1 | 0.966 | Not recorded | Not recorded | 2025-03-18 · model_announcement | LLM Stats |
| LongCat-Flash-Chat | 0.964 | Not recorded | Not recorded | 2025-08-29 · model_announcement | LLM Stats |
| Claude 3.7 Sonnet | 0.962 | Not recorded | Not recorded | 2025-02-24 · model_announcement | LLM Stats |
| Kimi-k1.5 | 0.962 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| MiniMax M1 40K | 0.96 | Not recorded | Not recorded | 2025-06-16 · model_announcement | LLM Stats |
| DeepSeek R1 Zero | 0.959 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| Llama 3.1 Nemotron Nano 8B V1 | 0.954 | Not recorded | Not recorded | 2025-03-18 · model_announcement | LLM Stats |
| Phi 4 Mini Reasoning | 0.946 | Not recorded | Not recorded | 2025-04-30 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Llama 70B | 0.945 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Qwen 32B | 0.943 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| DeepSeek-V3 0324 | 0.94 | Not recorded | Not recorded | 2025-03-25 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Qwen 14B | 0.939 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Qwen 7B | 0.928 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| QwQ-32B | 0.906 | Not recorded | Not recorded | 2025-03-05 · model_announcement | LLM Stats |
| QwQ-32B-Preview | 0.906 | Not recorded | Not recorded | 2024-11-28 · model_announcement | LLM Stats |
| DeepSeek-V3 | 0.902 | Not recorded | Not recorded | 2024-12-25 · model_announcement | LLM Stats |
| o1-mini | 0.9 | Not recorded | Not recorded | 2024-09-12 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Llama 8B | 0.891 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| DeepSeek R1 Distill Qwen 1.5B | 0.839 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| Granite 3.3 8B Instruct | 0.6902 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Granite 3.3 8B Base | 0.6902 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |