AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

Humanity's Last Exam

Tool access and test-time compute budget move this score more than model capability does, so two reported figures are rarely comparable. Cards increasingly report no-tools and with-tools figures as separate numbers.

评测信息与证据

来源
Model reports
发布者
未收录
评测发布日期
2025-01-23
采集日期
未收录
模态
未收录

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 27

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
DeepSeek-V4-Pro7.7percentnon-think, pass@1, no tools2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro34.5percentthink high, pass@1, no tools2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro44.7percentthink high, pass@1, with tools2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro37.7percentthink max, pass@1, no tools2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro48.2percentthink max, pass@1, with tools2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro-081360.0percentmax reasoning effort, temp 1.0, top_p 0.95, with tools2026-08-13 · document_publicationDeepSeek-V4-Pro-0813
DeepSeek-V4-Pro-081342.7percentmax reasoning effort, temp 1.0, top_p 0.95, without tools2026-08-13 · document_publicationDeepSeek-V4-Pro-0813
DeepSeek-V4-Flash34.8percentthink max, pass@1, no tools2026-06-25 · document_publicationDeepSeek-V4
Gemini 2.5 Pro21.6percentno tools2025-06-17 · document_publicationGemini 2.5 Pro
Claude 4 Opus10.7percentno tools, Scale leaderboard2025-06-17 · document_publicationGemini 2.5 Pro
Claude 4 Sonnet7.8percentno tools, Scale leaderboard2025-06-17 · document_publicationGemini 2.5 Pro
o3 high20.3percentno tools, Scale leaderboard2025-06-17 · document_publicationGemini 2.5 Pro
Gemini 3.1 Pro44.4percentThinking (High), No tools2026-02-19 · document_publicationGemini 3.1 Pro
Gemini 3.1 Pro51.4percentThinking (High), Search (blocklist) + Code2026-02-19 · document_publicationGemini 3.1 Pro
Gemma 4 (31B)19.5percentno tools2026-03-11 · document_publicationGemma 4 (31B)
Gemma 4 (31B)26.5percentwith search2026-03-11 · document_publicationGemma 4 (31B)
Kimi K356.0percentreasoning=max, with general tools2026-06-13 · document_publicationKimi K3
Kimi K343.5percentreasoning=max, without tools2026-06-13 · document_publicationKimi K3
Qwen3.5-397B-A17B28.7percentthinking (temp 0.6, top_p 0.95, top_k 20), no tools2026-02-16 · document_publicationQwen3.5-397B-A17B
Qwen3.5-397B-A17B48.3percentthinking (temp 0.6, top_p 0.95, top_k 20), with tools2026-02-16 · document_publicationQwen3.5-397B-A17B
Qwen3.5-397B-A17B37.6percentthinking (temp 0.6, top_p 0.95, top_k 20), no tools, HLE-Verified dataset2026-02-16 · document_publicationQwen3.5-397B-A17B
Hy4 preview55.4percentw/ tools2026-08-28 · document_publicationHy4 preview
Hy4 preview43.4percentw/o tools2026-08-28 · document_publicationHy4 preview
GLM-5.131.0percentas reported2026-04-03 · document_publicationGLM-5.1
GLM-5.240.5percenttext-only subset, temp 1.0, top_p 0.95, max gen 163840 tokens, GPT-5.5 (medium) judge2026-06-16 · document_publicationGLM-5.2
GLM-5.3-Flash55.3percentHLE w/ tools, full set, temp 1.0, top_p 0.95, max gen 163840 tokens, max context 300K with context management, GPT-5.6-luna (medium) judge2026-08-27 · document_publicationGLM-5.3-Flash
GLM-530.5percenttext-only subset, temp 1.0, top_p 0.95, GPT-5.2 (medium) judge2026-02-11 · document_publicationGLM-5