AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Tau2 Telecom

τ²-Bench telecom domain evaluates conversational agents in a dual-control environment modeled as a Dec-POMDP, where both agent and user use tools in shared telecommunications troubleshooting scenarios that test coordination and communication capabilities.

评测信息与证据

来源
LLM Stats
发布者
Sierra
评测发布日期
2025-06-09
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 35

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude Opus 4.60.993未收录未收录2026-02-05 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.993未收录未收录2026-01-14 · model_announcementLLM Stats
GPT-5.40.989未收录未收录2026-03-05 · model_announcementLLM Stats
GPT-5.20.987未收录未收录2025-12-11 · model_announcementLLM Stats
Claude Opus 4.50.982未收录未收录2025-11-24 · model_announcementLLM Stats
GPT-5.50.98未收录未收录2026-04-23 · model_announcementLLM Stats
Claude Sonnet 4.60.979未收录未收录2026-02-17 · model_announcementLLM Stats
MiMo-V2-Pro0.968未收录未收录2026-03-18 · model_announcementLLM Stats
GPT-50.967未收录未收录2025-08-07 · model_announcementLLM Stats
GPT-5.10.956未收录未收录2025-11-13 · model_announcementLLM Stats
GPT-5.1 Thinking0.956未收录未收录2025-11-12 · model_announcementLLM Stats
GPT-5.1 Instant0.956未收录未收录2025-11-12 · model_announcementLLM Stats
GPT-5.4 mini0.934未收录未收录2026-03-17 · model_announcementLLM Stats
Nova 2 Pro0.927未收录未收录2025-12-02 · model_announcementLLM Stats
GPT-5.4 nano0.925未收录未收录2026-03-17 · model_announcementLLM Stats
Muse Spark0.915未收录未收录2026-04-08 · model_announcementLLM Stats
MiniMax M2.10.87未收录未收录2025-12-23 · model_announcementLLM Stats
MiniMax M20.87未收录未收录2025-10-27 · model_announcementLLM Stats
Command A+0.85未收录未收录2026-05-20 · model_announcementLLM Stats
LongCat-Flash-Thinking0.831未收录未收录2025-09-22 · model_announcementLLM Stats
Claude Haiku 4.50.83未收录未收录2025-10-15 · model_announcementLLM Stats
Nova 2 Omni0.8未收录未收录2025-12-02 · model_announcementLLM Stats
Nova 2 Lite0.76未收录未收录2025-12-02 · model_announcementLLM Stats
LongCat-Flash-Chat0.7368未收录未收录2025-08-29 · model_announcementLLM Stats
LongCat-Flash-Lite0.728未收录未收录2026-02-05 · model_announcementLLM Stats
MAI-Code-1-Flash0.717未收录未收录2026-06-02 · model_announcementLLM Stats
Kimi K2-Instruct-09050.658未收录未收录2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.658未收录未收录2025-07-11 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.6436未收录未收录2026-03-11 · model_announcementLLM Stats
o30.582未收录未收录2025-04-16 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.456未收录未收录2025-07-25 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.439未收录未收录2025-09-10 · model_announcementLLM Stats
Nemotron 3 Nano (30B A3B)0.422未收录未收录2025-12-15 · model_announcementLLM Stats
GPT-4o0.235未收录未收录2024-08-06 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.132未收录未收录2025-09-10 · model_announcementLLM Stats