AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMMLU

Multilingual Massive Multitask Language Understanding dataset released by OpenAI, featuring professionally translated MMLU test questions across 14 languages including Arabic, Bengali, German, Spanish, French, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Swahili, Yoruba, and Chinese. Contains approximately 15,908 multiple-choice questions per language covering 57 subjects.

评测信息与证据

来源
LLM Stats
发布者
OpenAI
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 49

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude Mythos Preview0.927未收录未收录2026-04-07 · model_announcementLLM Stats
Gemini 3.1 Pro0.926未收录未收录2026-02-19 · model_announcementLLM Stats
Gemini 3 Flash0.918未收录未收录2025-12-17 · model_announcementLLM Stats
Gemini 3 Pro0.918未收录未收录2025-11-18 · model_announcementLLM Stats
Claude Opus 4.70.915未收录未收录2026-04-16 · model_announcementLLM Stats
Claude Opus 4.60.911未收录未收录2026-02-05 · model_announcementLLM Stats
Claude Opus 4.50.908未收录未收录2025-11-24 · model_announcementLLM Stats
Qwen3.7 Max0.903未收录未收录2026-05-19 · model_announcementLLM Stats
GPT-5.20.896未收录未收录2025-12-11 · model_announcementLLM Stats
Qwen3.6 Plus0.895未收录未收录2026-04-02 · model_announcementLLM Stats
Claude Opus 4.10.895未收录未收录2025-08-05 · model_announcementLLM Stats
Claude Sonnet 4.60.893未收录未收录2026-02-17 · model_announcementLLM Stats
Claude Sonnet 4.50.891未收录未收录2025-09-29 · model_announcementLLM Stats
Qwen3.7-Plus0.89未收录未收录2026-05-31 · model_announcementLLM Stats
Gemini 3.1 Flash-Lite0.889未收录未收录2026-03-03 · model_announcementLLM Stats
Claude Opus 40.888未收录未收录2025-05-22 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.885未收录未收录2026-02-16 · model_announcementLLM Stats
Gemma 4 31B0.884未收录未收录2026-04-02 · model_announcementLLM Stats
o10.877未收录未收录2024-12-17 · model_announcementLLM Stats
GPT-4.10.873未收录未收录2025-04-14 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.867未收录未收录2026-02-24 · model_announcementLLM Stats
Qwen3 235B A22B0.867未收录未收录2025-04-29 · model_announcementLLM Stats
Claude Sonnet 40.865未收录未收录2025-05-22 · model_announcementLLM Stats
Gemma 4 26B-A4B0.863未收录未收录2026-04-02 · model_announcementLLM Stats
Claude 3.7 Sonnet0.861未收录未收录2025-02-24 · model_announcementLLM Stats
Qwen3.5-27B0.859未收录未收录2026-02-24 · model_announcementLLM Stats
K-EXAONE-236B-A23B0.857未收录未收录2025-12-31 · model_announcementLLM Stats
Mistral Large 3 (675B Base)0.855未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512 Eagle)0.855未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512)0.855未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512 NVFP4)0.855未收录未收录2025-12-04 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.852未收录未收录2026-02-24 · model_announcementLLM Stats
GPT-4.50.851未收录未收录2025-02-27 · model_announcementLLM Stats
GPT OSS 120B High0.838未收录未收录2025-08-05 · model_announcementLLM Stats
Gemma 4 12B0.834未收录未收录2026-05-23 · model_announcementLLM Stats
Claude Haiku 4.50.83未收录未收录2025-10-15 · model_announcementLLM Stats
DiffusionGemma 26B-A4B0.815未收录未收录2026-06-10 · model_announcementLLM Stats
GPT-4o0.814未收录未收录2024-08-06 · model_announcementLLM Stats
Qwen3.5-9B0.812未收录未收录2026-03-02 · model_announcementLLM Stats
GPT-4.1 mini0.785未收录未收录2025-04-14 · model_announcementLLM Stats
Gemma 4 E4B0.766未收录未收录2026-04-02 · model_announcementLLM Stats
Qwen3.5-4B0.761未收录未收录2026-03-02 · model_announcementLLM Stats
Mistral Large 30.742未收录未收录2025-09-01 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.699未收录未收录2024-08-23 · model_announcementLLM Stats
Gemma 4 E2B0.674未收录未收录2026-04-02 · model_announcementLLM Stats
GPT-4.1 nano0.669未收录未收录2025-04-14 · model_announcementLLM Stats
Qwen3.5-2B0.631未收录未收录2026-03-02 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.554未收录未收录2024-08-23 · model_announcementLLM Stats
Qwen3.5-0.8B0.443未收录未收录2026-03-02 · model_announcementLLM Stats