AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
Tau2 Telecom
τ²-Bench telecom domain evaluates conversational agents in a dual-control environment modeled as a Dec-POMDP, where both agent and user use tools in shared telecommunications troubleshooting scenarios that test coordination and communication capabilities.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Sierra
- Benchmark release
- 2025-06-09
- Collected
- 2026-08-17
- Modality
- text
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 35
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Claude Opus 4.6 | 0.993 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| LongCat-Flash-Thinking-2601 | 0.993 | Not recorded | Not recorded | 2026-01-14 · model_announcement | LLM Stats |
| GPT-5.4 | 0.989 | Not recorded | Not recorded | 2026-03-05 · model_announcement | LLM Stats |
| GPT-5.2 | 0.987 | Not recorded | Not recorded | 2025-12-11 · model_announcement | LLM Stats |
| Claude Opus 4.5 | 0.982 | Not recorded | Not recorded | 2025-11-24 · model_announcement | LLM Stats |
| GPT-5.5 | 0.98 | Not recorded | Not recorded | 2026-04-23 · model_announcement | LLM Stats |
| Claude Sonnet 4.6 | 0.979 | Not recorded | Not recorded | 2026-02-17 · model_announcement | LLM Stats |
| MiMo-V2-Pro | 0.968 | Not recorded | Not recorded | 2026-03-18 · model_announcement | LLM Stats |
| GPT-5 | 0.967 | Not recorded | Not recorded | 2025-08-07 · model_announcement | LLM Stats |
| GPT-5.1 | 0.956 | Not recorded | Not recorded | 2025-11-13 · model_announcement | LLM Stats |
| GPT-5.1 Thinking | 0.956 | Not recorded | Not recorded | 2025-11-12 · model_announcement | LLM Stats |
| GPT-5.1 Instant | 0.956 | Not recorded | Not recorded | 2025-11-12 · model_announcement | LLM Stats |
| GPT-5.4 mini | 0.934 | Not recorded | Not recorded | 2026-03-17 · model_announcement | LLM Stats |
| Nova 2 Pro | 0.927 | Not recorded | Not recorded | 2025-12-02 · model_announcement | LLM Stats |
| GPT-5.4 nano | 0.925 | Not recorded | Not recorded | 2026-03-17 · model_announcement | LLM Stats |
| Muse Spark | 0.915 | Not recorded | Not recorded | 2026-04-08 · model_announcement | LLM Stats |
| MiniMax M2.1 | 0.87 | Not recorded | Not recorded | 2025-12-23 · model_announcement | LLM Stats |
| MiniMax M2 | 0.87 | Not recorded | Not recorded | 2025-10-27 · model_announcement | LLM Stats |
| Command A+ | 0.85 | Not recorded | Not recorded | 2026-05-20 · model_announcement | LLM Stats |
| LongCat-Flash-Thinking | 0.831 | Not recorded | Not recorded | 2025-09-22 · model_announcement | LLM Stats |
| Claude Haiku 4.5 | 0.83 | Not recorded | Not recorded | 2025-10-15 · model_announcement | LLM Stats |
| Nova 2 Omni | 0.8 | Not recorded | Not recorded | 2025-12-02 · model_announcement | LLM Stats |
| Nova 2 Lite | 0.76 | Not recorded | Not recorded | 2025-12-02 · model_announcement | LLM Stats |
| LongCat-Flash-Chat | 0.7368 | Not recorded | Not recorded | 2025-08-29 · model_announcement | LLM Stats |
| LongCat-Flash-Lite | 0.728 | Not recorded | Not recorded | 2026-02-05 · model_announcement | LLM Stats |
| MAI-Code-1-Flash | 0.717 | Not recorded | Not recorded | 2026-06-02 · model_announcement | LLM Stats |
| Kimi K2-Instruct-0905 | 0.658 | Not recorded | Not recorded | 2025-09-05 · model_announcement | LLM Stats |
| Kimi K2 Instruct | 0.658 | Not recorded | Not recorded | 2025-07-11 · model_announcement | LLM Stats |
| Nemotron 3 Super (120B A12B) | 0.6436 | Not recorded | Not recorded | 2026-03-11 · model_announcement | LLM Stats |
| o3 | 0.582 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Qwen3-235B-A22B-Thinking-2507 | 0.456 | Not recorded | Not recorded | 2025-07-25 · model_announcement | LLM Stats |
| Qwen3-Next-80B-A3B-Thinking | 0.439 | Not recorded | Not recorded | 2025-09-10 · model_announcement | LLM Stats |
| Nemotron 3 Nano (30B A3B) | 0.422 | Not recorded | Not recorded | 2025-12-15 · model_announcement | LLM Stats |
| GPT-4o | 0.235 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| Qwen3-Next-80B-A3B-Instruct | 0.132 | Not recorded | Not recorded | 2025-09-10 · model_announcement | LLM Stats |