AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

SWE-bench Multilingual

Per-language resolution rates differ widely, so an average hides which languages the model actually handles.

评测信息与证据

来源
Model reports
发布者
未收录
评测发布日期
2025-04-22
采集日期
未收录
模态
未收录

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 7

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
DeepSeek-V4-Pro69.8percentnon-think, resolved2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro74.1percentthink high, resolved2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro76.2percentthink max, resolved2026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Flash73.3percentthink max, resolved2026-06-25 · document_publicationDeepSeek-V4
Qwen3.5-397B-A17B69.3percentthinking (temp 0.6, top_p 0.95, top_k 20)2026-02-16 · document_publicationQwen3.5-397B-A17B
Hy4 preview82.9percentas printed in the report's benchmark table2026-08-28 · document_publicationHy4 preview
GLM-573.3percentOpenHands, tailored instruction prompt, temp 0.7, top_p 0.95, 200K context2026-02-11 · document_publicationGLM-5