AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

Terminal-Bench

Environment image, timeout and permitted commands change results independently of the model. Version and harness both matter: 2.0 and 2.1 are different instruments, and cards report Terminus, Claude Code and Codex harness numbers for the same version. Frontier-Bench is this series' next version rather than a separate benchmark: frontierbench.ai now bills it as "Terminal-Bench 3.0 (formerly Frontier-Bench)", built by the makers of Harbor and Terminal-Bench, so its mentions are counted here. Merging it did not raise this count: all three cards that named Frontier-Bench (Claude Opus 5, Claude Fable 5 and Mythos 5, Kimi K3) also report Terminal-Bench in the same document, and the counting unit is the document, so each still adds one. Being a new version, its task set is not comparable to a 2.x number. Not to be confused with Cognition's FrontierCode, a separate instrument recorded separately despite the shared prefix.

评测信息与证据

来源
Model reports
发布者
未收录
评测发布日期
2025-05-19
采集日期
未收录
模态
未收录

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 15

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude Opus 443.2percentno extended thinking2025-05-22 · document_publicationClaude Opus 4 and Sonnet 4
DeepSeek-V4-Pro59.1percentnon-think2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro63.3percentthink high2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro67.9percentthink max2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro-081387.9percentmax reasoning effort, temp 1.0, top_p 0.952026-08-13 · document_publicationDeepSeek-V4-Pro-0813
DeepSeek-V4-Flash56.9percentthink max2026-06-25 · document_publicationDeepSeek-V4
Gemini 3.1 Pro68.5percentThinking (High), Terminus-2 harness2026-02-19 · document_publicationGemini 3.1 Pro
Kimi K388.3percentreasoning=max2026-06-13 · document_publicationKimi K3
Qwen3.5-397B-A17B52.5percentthinking (temp 0.6, top_p 0.95, top_k 20)2026-02-16 · document_publicationQwen3.5-397B-A17B
Hy4 preview85.4percentTerminal-Bench 2.12026-08-28 · document_publicationHy4 preview
Grok 4.583.3percentas reported2026-07-08 · document_publicationGrok 4.5
GLM-5.163.5percentTerminal-Bench 2.0, Terminus-2 harness, as reported2026-04-03 · document_publicationGLM-5.1
GLM-5.281.0percentTerminal-Bench 2.1, Terminus-2, parser json, timeout 4h, temp 1.0, top_p 1.0, max_new_tokens 48k, max_episodes 500, 256K context2026-06-16 · document_publicationGLM-5.2
GLM-5.3-Flash84.3percentTerminal-Bench 2.1, Claude Code 2.1.207, temp 1.0, top_p 1, max_new_tokens 65536, 6h timeout2026-08-27 · document_publicationGLM-5.3-Flash
GLM-556.2percentTerminal-Bench 2.0, Terminus-2 harness, timeout 2h, temp 0.7, top_p 1.0, 128K context2026-02-11 · document_publicationGLM-5