AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Multilingual MMLU

MMLU-ProX is a comprehensive multilingual benchmark covering 29 typologically diverse languages, building upon MMLU-Pro. Each language version consists of 11,829 identical questions enabling direct cross-linguistic comparisons. The benchmark evaluates large language models' reasoning capabilities across linguistic and cultural boundaries through challenging, reasoning-focused questions with 10 answer choices.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 5

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
o3-mini0.807Not recordedNot recorded2025-01-30 · model_announcementLLM Stats
Ministral 3 (14B Base 2512)0.742Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Ministral 3 (8B Base 2512)0.706Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Ministral 3 (3B Base 2512)0.652Not recordedNot recorded2025-12-04 · model_announcementLLM Stats
Phi 4 Mini0.493Not recordedNot recorded2025-02-01 · model_announcementLLM Stats