AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

AIME

pass@k, majority vote and Python tool access each shift this by double digits.

评测信息与证据

来源: Model reports
发布者: 未收录
评测发布日期: 2024-02-01
采集日期: 未收录
模态: 未收录

本站保留来源报告的结果，不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期；不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 10

按来源中的观察顺序展示，顺序不代表排名。日期保留原始精度。

模型	数值	单位	协议	报告日期与口径	来源
Claude Opus 4	75.5	percent	extended thinking up to 64K tokens, top-p 0.95, no parallel test-time compute	2025-05-22 · document_publication	Claude Opus 4 and Sonnet 4
Claude Sonnet 4	70.5	percent	extended thinking up to 64K tokens, top-p 0.95, no parallel test-time compute	2025-05-22 · document_publication	Claude Opus 4 and Sonnet 4
DeepSeek-R1	79.8	percent	Pass@1	2025-01-22 · document_publication	DeepSeek-R1
DeepSeek-V3	39.2	percent	Pass@1	2024-12-27 · document_publication	DeepSeek-V3
Gemma 4 (31B)	89.2	percent	no tools	2026-03-11 · document_publication	Gemma 4 (31B)
Qwen3.5-397B-A17B	91.3	percent	thinking (temp 0.6, top_p 0.95, top_k 20)	2026-02-16 · document_publication	Qwen3.5-397B-A17B
Qwen3-235B-A22B (Thinking)	85.7	percent	thinking mode	2025-05-14 · document_publication	Qwen3
GLM-5.1	95.3	percent	AIME 2026, as reported	2026-04-03 · document_publication	GLM-5.1
GLM-5.2	99.2	percent	AIME 2026, temp 1.0, top_p 0.95, max gen 163840 tokens, GPT-5.5 (medium) judge	2026-06-16 · document_publication	GLM-5.2
GLM-5	92.7	percent	AIME 2026 I, temp 1.0, top_p 0.95, GPT-5.2 (medium) judge	2026-02-11 · document_publication	GLM-5