AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Terminal-Bench 2.0

Terminal-Bench 2.0 is an updated benchmark for testing AI agents' tool use ability to operate a computer via terminal. It evaluates how well models can handle real-world, end-to-end tasks autonomously, including compiling code, training models, setting up servers, system administration, security tasks, data science workflows, and cybersecurity vulnerabilities.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
2025-09-25
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 51

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.50.827Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Claude Mythos Preview0.82Not recordedNot recorded2026-04-07 · model_announcementLLM Stats
Claude Sonnet 50.804Not recordedNot recorded2026-06-30 · model_announcementLLM Stats
GPT-5.3 Codex0.773Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
Gemini 3.5 Flash0.762Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
GPT-5.40.751Not recordedNot recorded2026-03-05 · model_announcementLLM Stats
Claude Opus 4.80.746Not recordedNot recorded2026-05-28 · model_announcementLLM Stats
Qwen3.7-Plus0.703Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Qwen3.7 Max0.697Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Claude Opus 4.70.694Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
GLM-5.10.69Not recordedNot recorded2026-04-07 · model_announcementLLM Stats
Gemini 3.1 Pro0.685Not recordedNot recorded2026-02-19 · model_announcementLLM Stats
MiMo-V2.5-Pro0.684Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
DeepSeek-V4-Pro-Max0.679Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
Kimi K2.60.667Not recordedNot recorded2026-04-20 · model_announcementLLM Stats
MiMo-V2.50.658Not recordedNot recorded2026-04-22 · model_announcementLLM Stats
Claude Opus 4.60.654Not recordedNot recorded2026-02-05 · model_announcementLLM Stats
GPT-5.2 Codex0.64Not recordedNot recorded2026-01-14 · model_announcementLLM Stats
Qwen3.6 Plus0.616Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
GPT-5.4 mini0.6Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
Qwen3.6-27B0.593Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Claude Opus 4.50.593Not recordedNot recorded2025-11-24 · model_announcementLLM Stats
Claude Sonnet 4.60.591Not recordedNot recorded2026-02-17 · model_announcementLLM Stats
Muse Spark0.59Not recordedNot recorded2026-04-08 · model_announcementLLM Stats
MiMo-V2-Pro0.571Not recordedNot recorded2026-03-18 · model_announcementLLM Stats
MiniMax M2.70.57Not recordedNot recorded2026-03-18 · model_announcementLLM Stats
DeepSeek-V4-Flash-Max0.569Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
DeepSeek-V4-Flash-04230.566Not recordedNot recorded2026-04-23 · model_announcementLLM Stats
GLM-50.562Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
MAI-Code-1-Flash0.548Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Gemini 3 Pro0.542Not recordedNot recorded2025-11-18 · model_announcementLLM Stats
GPT-5.1 Codex0.528Not recordedNot recorded2025-11-19 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.525Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.515Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Step-3.5-Flash0.51Not recordedNot recorded2026-02-02 · model_announcementLLM Stats
Kimi K2.50.508Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.494Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Gemini 3 Flash0.476Not recordedNot recorded2025-12-17 · model_announcementLLM Stats
DeepSeek-V3.20.464Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.464Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.2-Speciale0.464Not recordedNot recorded2025-12-01 · model_announcementLLM Stats
GPT-5.4 nano0.463Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
MAI-Thinking-10.46Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Qwen3.5-27B0.416Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
GLM-4.70.41Not recordedNot recorded2025-12-22 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.405Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
MiMo-V2-Flash0.385Not recordedNot recorded2025-12-16 · model_announcementLLM Stats
Laguna XS 2.10.375Not recordedNot recorded2026-07-02 · model_announcementLLM Stats
Qwen3-Coder 480B A35B Instruct0.375Not recordedNot recorded2025-01-31 · model_announcementLLM Stats
North Mini Code 1.00.36Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.31Not recordedNot recorded2026-03-11 · model_announcementLLM Stats