AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MMLU
Massive Multitask Language Understanding benchmark testing knowledge across 57 diverse subjects including STEM, humanities, social sciences, and professional domains
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- 2020-09-07
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 101
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| GPT-5 | 0.925 | Not recorded | Not recorded | 2025-08-07 · model_announcement | LLM Stats |
| o1 | 0.918 | Not recorded | Not recorded | 2024-12-17 · model_announcement | LLM Stats |
| GPT-4.5 | 0.908 | Not recorded | Not recorded | 2025-02-27 · model_announcement | LLM Stats |
| o1-preview | 0.908 | Not recorded | Not recorded | 2024-09-12 · model_announcement | LLM Stats |
| Sarvam-105B | 0.906 | Not recorded | Not recorded | 2026-03-06 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Thinking | 0.906 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.904 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.904 | Not recorded | Not recorded | 2024-06-21 · model_announcement | LLM Stats |
| Kimi K2 0905 | 0.902 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| GPT-4.1 | 0.902 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| GPT OSS 120B | 0.9 | Not recorded | Not recorded | 2025-08-05 · model_announcement | LLM Stats |
| LongCat-Flash-Chat | 0.8971 | Not recorded | Not recorded | 2025-08-29 · model_announcement | LLM Stats |
| Kimi K2-Instruct-0905 | 0.895 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| Kimi K2 Instruct | 0.895 | Not recorded | Not recorded | 2025-07-11 · model_announcement | LLM Stats |
| MiMo-V2.5-Pro | 0.894 | Not recorded | Not recorded | 2026-04-27 · model_announcement | LLM Stats |
| Qwen3 VL 235B A22B Instruct | 0.888 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Qwen3 VL 32B Thinking | 0.887 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| GPT-4o | 0.887 | Not recorded | Not recorded | 2024-05-13 · model_announcement | LLM Stats |
| DeepSeek-V3 | 0.885 | Not recorded | Not recorded | 2024-12-25 · model_announcement | LLM Stats |
| Qwen3 235B A22B | 0.8781 | Not recorded | Not recorded | 2025-04-29 · model_announcement | LLM Stats |
| Kimi K2 Base | 0.878 | Not recorded | Not recorded | 2025-07-11 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Thinking | 0.876 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| GPT-4.1 mini | 0.875 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| Grok-2 | 0.875 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Kimi-k1.5 | 0.874 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| Llama 3.1 405B Instruct | 0.873 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| o3-mini | 0.869 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| Claude 3 Opus | 0.868 | Not recorded | Not recorded | 2024-02-29 · model_announcement | LLM Stats |
| GPT-4 Turbo | 0.865 | Not recorded | Not recorded | 2024-04-09 · model_announcement | LLM Stats |
| Qwen3 VL 32B Instruct | 0.864 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| GPT-4 | 0.864 | Not recorded | Not recorded | 2023-06-13 · model_announcement | LLM Stats |
| Grok-2 mini | 0.862 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Llama 3.3 70B Instruct | 0.86 | Not recorded | Not recorded | 2024-12-06 · model_announcement | LLM Stats |
| Llama 3.2 90B Instruct | 0.86 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Nova Pro | 0.859 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| Gemini 1.5 Pro | 0.859 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| GPT-4o | 0.857 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| LongCat-Flash-Lite | 0.8552 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| Llama 4 Maverick | 0.855 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| GPT OSS 20B | 0.853 | Not recorded | Not recorded | 2025-08-05 · model_announcement | LLM Stats |
| Qwen3 VL 8B Thinking | 0.852 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| o1-mini | 0.852 | Not recorded | Not recorded | 2024-09-12 · model_announcement | LLM Stats |
| Sarvam-30B | 0.851 | Not recorded | Not recorded | 2026-03-06 · model_announcement | LLM Stats |
| Qwen3 VL 30B A3B Instruct | 0.85 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Phi 4 | 0.848 | Not recorded | Not recorded | 2024-12-12 · model_announcement | LLM Stats |
| Mistral Large 2 | 0.84 | Not recorded | Not recorded | 2024-07-24 · model_announcement | LLM Stats |
| Llama 3.1 70B Instruct | 0.836 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Qwen2.5 32B Instruct | 0.833 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Qwen2 72B Instruct | 0.823 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| GPT-4o mini | 0.82 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |
| Qwen3 VL 4B Thinking | 0.815 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Grok-1.5 | 0.813 | Not recorded | Not recorded | 2024-03-28 · model_announcement | LLM Stats |
| Jamba 1.5 Large | 0.812 | Not recorded | Not recorded | 2024-08-22 · model_announcement | LLM Stats |
| Mistral Small 3.1 24B Base | 0.8101 | Not recorded | Not recorded | 2025-03-17 · model_announcement | LLM Stats |
| Mistral Small 3 24B Base | 0.8073 | Not recorded | Not recorded | 2025-01-30 · model_announcement | LLM Stats |
| Qwen3 VL 8B Instruct | 0.807 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Mistral Small 3.1 24B Instruct | 0.8062 | Not recorded | Not recorded | 2025-03-17 · model_announcement | LLM Stats |
| Mistral Small 3.2 24B Instruct | 0.805 | Not recorded | Not recorded | 2025-06-20 · model_announcement | LLM Stats |
| Nova Lite | 0.805 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| DeepSeek-V2.5 | 0.804 | Not recorded | Not recorded | 2024-05-08 · model_announcement | LLM Stats |
| Llama 3.1 Nemotron 70B Instruct | 0.802 | Not recorded | Not recorded | 2024-10-01 · model_announcement | LLM Stats |
| GPT-4.1 nano | 0.801 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| Qwen2.5 14B Instruct | 0.797 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Llama 4 Scout | 0.796 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Ministral 3 (14B Base 2512) | 0.794 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Hermes 3 70B | 0.7909 | Not recorded | Not recorded | 2024-08-15 · model_announcement | LLM Stats |
| Claude 3 Sonnet | 0.79 | Not recorded | Not recorded | 2024-02-29 · model_announcement | LLM Stats |
| Phi-3.5-MoE-instruct | 0.789 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Gemini 1.5 Flash | 0.789 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| Qwen2.5 VL 32B Instruct | 0.784 | Not recorded | Not recorded | 2025-02-28 · model_announcement | LLM Stats |
| Nova Micro | 0.776 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| Qwen3 VL 4B Instruct | 0.772 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Ministral 3 (8B Base 2512) | 0.761 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Command R+ | 0.757 | Not recorded | Not recorded | 2024-08-30 · model_announcement | LLM Stats |
| Gemma 2 27B | 0.752 | Not recorded | Not recorded | 2024-06-27 · model_announcement | LLM Stats |
| Claude 3 Haiku | 0.752 | Not recorded | Not recorded | 2024-03-13 · model_announcement | LLM Stats |
| Qwen2.5-Coder 32B Instruct | 0.751 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Llama 3.2 11B Instruct | 0.73 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Gemini 1.0 Pro | 0.718 | Not recorded | Not recorded | 2024-02-15 · model_announcement | LLM Stats |
| Gemma 2 9B | 0.713 | Not recorded | Not recorded | 2024-06-27 · model_announcement | LLM Stats |
| Ministral 3 (3B Base 2512) | 0.707 | Not recorded | Not recorded | 2025-12-04 · model_announcement | LLM Stats |
| Qwen2 7B Instruct | 0.705 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| GPT-3.5 Turbo | 0.698 | Not recorded | Not recorded | 2023-03-21 · model_announcement | LLM Stats |
| Jamba 1.5 Mini | 0.697 | Not recorded | Not recorded | 2024-08-22 · model_announcement | LLM Stats |
| Llama 3.1 8B Instruct | 0.694 | Not recorded | Not recorded | 2024-07-23 · model_announcement | LLM Stats |
| Pixtral-12B | 0.692 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| Phi-3.5-mini-instruct | 0.69 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Mistral NeMo Instruct | 0.68 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |
| Qwen2.5-Coder 7B Instruct | 0.676 | Not recorded | Not recorded | 2024-09-19 · model_announcement | LLM Stats |
| Phi 4 Mini | 0.673 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| Granite 3.3 8B Instruct | 0.6554 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Ministral 8B Instruct | 0.65 | Not recorded | Not recorded | 2024-10-16 · model_announcement | LLM Stats |
| Gemma 3n E4B Instructed | 0.649 | Not recorded | Not recorded | 2025-06-26 · model_announcement | LLM Stats |
| Gemma 3n E4B Instructed LiteRT Preview | 0.649 | Not recorded | Not recorded | 2025-05-20 · model_announcement | LLM Stats |
| Granite 3.3 8B Base | 0.6389 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Llama 3.2 3B Instruct | 0.634 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| IBM Granite 4.0 Tiny Preview | 0.604 | Not recorded | Not recorded | 2025-05-02 · model_announcement | LLM Stats |
| Gemma 3n E2B Instructed | 0.601 | Not recorded | Not recorded | 2025-06-26 · model_announcement | LLM Stats |
| Gemma 3n E2B Instructed LiteRT (Preview) | 0.601 | Not recorded | Not recorded | 2025-05-20 · model_announcement | LLM Stats |
| North Micro Vision Instruct | 0.504 | Not recorded | Not recorded | 2026-08-12 · model_announcement | LLM Stats |
| ERNIE 4.5 | 0.419 | Not recorded | Not recorded | 2025-06-25 · model_announcement | LLM Stats |