AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Tau2 Retail

τ²-bench retail domain evaluates conversational AI agents in customer service scenarios within a dual-control environment where both agent and user can interact with tools. Tests tool-agent-user interaction, rule adherence, and task consistency in retail customer support contexts.

评测信息与证据

来源
LLM Stats
发布者
Sierra
评测发布日期
2025-06-09
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 26

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude Opus 4.60.919未收录未收录2026-02-05 · model_announcementLLM Stats
Claude Sonnet 4.60.917未收录未收录2026-02-17 · model_announcementLLM Stats
Claude Opus 4.50.889未收录未收录2025-11-24 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.886未收录未收录2026-01-14 · model_announcementLLM Stats
Claude Haiku 4.50.832未收录未收录2025-10-15 · model_announcementLLM Stats
GPT-5.20.82未收录未收录2025-12-11 · model_announcementLLM Stats
GPT-50.811未收录未收录2025-08-07 · model_announcementLLM Stats
o30.802未收录未收录2025-04-16 · model_announcementLLM Stats
Nova 2 Omni0.783未收录未收录2025-12-02 · model_announcementLLM Stats
GPT-5.10.779未收录未收录2025-11-13 · model_announcementLLM Stats
GPT-5.1 Instant0.779未收录未收录2025-11-12 · model_announcementLLM Stats
GPT-5.1 Thinking0.779未收录未收录2025-11-12 · model_announcementLLM Stats
Nova 2 Pro0.777未收录未收录2025-12-02 · model_announcementLLM Stats
Nova 2 Lite0.765未收录未收录2025-12-02 · model_announcementLLM Stats
LongCat-Flash-Lite0.731未收录未收录2026-02-05 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.719未收录未收录2025-07-25 · model_announcementLLM Stats
LongCat-Flash-Thinking0.715未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.713未收录未收录2025-07-22 · model_announcementLLM Stats
LongCat-Flash-Chat0.7127未收录未收录2025-08-29 · model_announcementLLM Stats
Kimi K2-Instruct-09050.706未收录未收录2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.706未收录未收录2025-07-11 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.678未收录未收录2025-09-10 · model_announcementLLM Stats
GPT-4o0.634未收录未收录2024-08-06 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.6283未收录未收录2026-03-11 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.573未收录未收录2025-09-10 · model_announcementLLM Stats
Nemotron 3 Nano (30B A3B)0.569未收录未收录2025-12-15 · model_announcementLLM Stats