Model reports

MMMLU

A language-count average. Two cards reporting "MMMLU" may be averaging over different language sets, so the counts must match to compare.

评测信息与证据

本站保留来源报告的结果，不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期；不同运行条件不能直接合并为统一排名。

按来源中的观察顺序展示，顺序不代表排名。日期保留原始精度。

模型	数值	单位	协议	报告日期与口径	来源
Claude Opus 4	88.8	percent	14 non-English languages, extended thinking up to 64K tokens	2025-05-22 · document_publication	Claude Opus 4 and Sonnet 4
Claude Sonnet 4	86.5	percent	14 non-English languages, extended thinking up to 64K tokens	2025-05-22 · document_publication	Claude Opus 4 and Sonnet 4
Gemini 3.1 Pro	92.6	percent	Thinking (High)	2026-02-19 · document_publication	Gemini 3.1 Pro
Gemma 4 (31B)	88.4	percent	as reported	2026-03-11 · document_publication	Gemma 4 (31B)
Qwen3.5-397B-A17B	88.5	percent	thinking (temp 0.6, top_p 0.95, top_k 20)	2026-02-16 · document_publication	Qwen3.5-397B-A17B