AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

SWE-bench Multilingual

A multilingual benchmark for issue resolving in software engineering that covers Java, TypeScript, JavaScript, Go, Rust, C, and C++. Contains 1,632 high-quality instances carefully annotated from 2,456 candidates by 68 expert annotators, designed to evaluate Large Language Models across diverse software ecosystems beyond Python.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 38

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude Mythos Preview0.873未收录未收录2026-04-07 · model_announcementLLM Stats
Claude Opus 4.80.844未收录未收录2026-05-28 · model_announcementLLM Stats
Laguna S 2.10.785未收录未收录2026-07-21 · model_announcementLLM Stats
Claude Sonnet 50.783未收录未收录2026-06-30 · model_announcementLLM Stats
Qwen3.7 Max0.783未收录未收录2026-05-19 · model_announcementLLM Stats
Claude Opus 4.60.7783未收录未收录2026-02-05 · model_announcementLLM Stats
Kimi K2.60.767未收录未收录2026-04-20 · model_announcementLLM Stats
MiniMax M2.70.765未收录未收录2026-03-18 · model_announcementLLM Stats
DeepSeek-V4-Pro-Max0.762未收录未收录2026-04-23 · model_announcementLLM Stats
Hy30.758未收录未收录2026-07-06 · model_announcementLLM Stats
Qwen3.7-Plus0.758未收录未收录2026-05-31 · model_announcementLLM Stats
Qwen3.6 Plus0.738未收录未收录2026-04-02 · model_announcementLLM Stats
DeepSeek-V4-Flash-Max0.733未收录未收录2026-04-23 · model_announcementLLM Stats
Kimi K2.50.73未收录未收录2026-01-27 · model_announcementLLM Stats
MiniMax M2.10.725未收录未收录2025-12-23 · model_announcementLLM Stats
MiMo-V2-Pro0.717未收录未收录2026-03-18 · model_announcementLLM Stats
MiMo-V2-Flash0.717未收录未收录2025-12-16 · model_announcementLLM Stats
Qwen3.6-27B0.713未收录未收录2026-04-21 · model_announcementLLM Stats
DeepSeek-V4-Flash-04230.702未收录未收录2026-04-23 · model_announcementLLM Stats
DeepSeek-V3.20.702未收录未收录2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.702未收录未收录2025-12-01 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.693未收录未收录2026-02-16 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.677未收录未收录2026-06-04 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.672未收录未收录2026-04-16 · model_announcementLLM Stats
GLM-4.70.667未收录未收录2025-12-22 · model_announcementLLM Stats
MAI-Code-1-Flash0.655未收录未收录2026-06-02 · model_announcementLLM Stats
Laguna XS 2.10.631未收录未收录2026-07-02 · model_announcementLLM Stats
Kimi K2-Thinking-09050.611未收录未收录2025-09-05 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.579未收录未收录2025-09-29 · model_announcementLLM Stats
MiniMax M20.565未收录未收录2025-10-27 · model_announcementLLM Stats
Qwen3-Coder 480B A35B Instruct0.547未收录未收录2025-01-31 · model_announcementLLM Stats
DeepSeek-V3.10.545未收录未收录2025-01-10 · model_announcementLLM Stats
Kimi K2-Instruct-09050.473未收录未收录2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.473未收录未收录2025-07-11 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.4578未收录未收录2026-03-11 · model_announcementLLM Stats
Nemotron 3.5 Lightning (30B A3B)0.3933未收录未收录2026-08-11 · model_announcementLLM Stats
LongCat-Flash-Lite0.381未收录未收录2026-02-05 · model_announcementLLM Stats
DeepSeek-R1-05280.305未收录未收录2025-05-28 · model_announcementLLM Stats