AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

Terminal-Bench 2.1

Terminal-Bench 2.1 is an updated release of the Terminal-Bench benchmark that tests AI agents' ability to operate a computer via the terminal. It evaluates how well models handle real-world, end-to-end tasks autonomously, including compiling code, training models, setting up servers, system administration, data science workflows, and security tasks.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
2026-05-05
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 28

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.6 Sol0.888Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Kimi K30.883Not recordedNot recorded2026-07-16 · model_announcementLLM Stats
GLM-5.30.882Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
DeepSeek-V4-Pro-08130.879Not recordedNot recorded2026-08-13 · model_announcementLLM Stats
GPT-5.6 Terra0.874Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Qwen3.8 Max0.866Not recordedNot recorded2026-08-02 · model_announcementLLM Stats
Gemini 3.7 Flash0.858Not recordedNot recorded2026-08-13 · model_announcementLLM Stats
GPT-5.6 Luna0.847Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Claude Fable 50.843Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Grok 4.50.833Not recordedNot recorded2026-07-16 · model_announcementLLM Stats
Muse Spark 1.20.829Not recordedNot recorded2026-08-05 · model_announcementLLM Stats
DeepSeek-V4-Flash-07310.827Not recordedNot recorded2026-07-31 · model_announcementLLM Stats
GLM-5.20.827Not recordedNot recorded2026-06-16 · model_announcementLLM Stats
Muse Spark 1.10.8Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Gemini 3.6 Flash0.78Not recordedNot recorded2026-07-21 · model_announcementLLM Stats
Qwen3.8-27B0.73Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
Hy30.717Not recordedNot recorded2026-07-06 · model_announcementLLM Stats
Seed 2.1 Pro0.71Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
Laguna S 2.10.702Not recordedNot recorded2026-07-21 · model_announcementLLM Stats
Seed 2.1 Turbo0.676Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
MiniMax M30.66Not recordedNot recorded2026-06-01 · model_announcementLLM Stats
Inkling-Small0.647Not recordedNot recorded2026-07-30 · model_announcementLLM Stats
MAI-Code-1.1-Flash0.629Not recordedNot recorded2026-08-11 · model_announcementLLM Stats
Solar Pro 40.57Not recordedNot recorded2026-08-06 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.564Not recordedNot recorded2026-06-04 · model_announcementLLM Stats
Gemini 3.5 Flash-Lite0.54Not recordedNot recorded2026-07-21 · model_announcementLLM Stats
Muse Glimmer-30B0.517Not recordedNot recorded2026-08-10 · model_announcementLLM Stats
Nemotron 3.5 Lightning (30B A3B)0.2458Not recordedNot recorded2026-08-11 · model_announcementLLM Stats