AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMLU-ProX

Extended version of MMLU-Pro providing additional challenging multiple-choice questions for evaluating language models across diverse academic and professional domains. Built on the foundation of the Massive Multitask Language Understanding benchmark framework.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 32

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.7 Max0.87Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Qwen3.7-Plus0.854Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Qwen3.6 Plus0.847Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.847Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.83Not recordedNot recorded2026-06-04 · model_announcementLLM Stats
Qwen3.5-27B0.822Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.822Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.81Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.81Not recordedNot recorded2025-07-25 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.806Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.794Not recordedNot recorded2025-07-22 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.7936Not recordedNot recorded2026-03-11 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.787Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.778Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.772Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.767Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Qwen3.5-9B0.763Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.761Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.734Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.5-4B0.715Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.709Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.707Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.654Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.65Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Nemotron 3 Nano (30B A3B)0.595Not recordedNot recorded2025-12-15 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.594Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.5-2B0.523Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3.5-0.8B0.346Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.199Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.199Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.081Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.081Not recordedNot recorded2025-05-20 · model_announcementLLM Stats