AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

FrontierChallenge

Pass-rate results are model-scaffold measurements over the 97 released tasks with one trajectory per system-task pair, so a reported percentage is not a model-only number and does not estimate reliability beyond this release or under a different scaffold.

评测信息与证据

来源
Model reports
发布者
未收录
评测发布日期
2026-08-25
采集日期
未收录
模态
未收录

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 13

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Apodex 1.110.3percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Claude Opus 517.5percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
DeepSeek V4 Flash-073112.4percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
DeepSeek V4 Pro-081313.4percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
GLM-5.23.1percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Gemini 3.7 Flash10.3percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Grok 4.620.6percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Kimi K317.5percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Qwen 3.8 Max15.5percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
Qwen3.5-397B-A17B4.1percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Claude Code2026-08-25 · document_publicationFrontierChallenge leaderboard
GPT-5.6 Sol20.6percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Codex2026-08-25 · document_publicationFrontierChallenge leaderboard
GPT-5.6 Terra (max)15.5percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Codex2026-08-25 · document_publicationFrontierChallenge leaderboard
Apodex 1.112.4percent97 released tasks; one trajectory per system-task pair; pass = native Score >= 99.9; agent scaffold: Frontier Agent (Agent Team)2026-08-25 · document_publicationFrontierChallenge leaderboard