AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
AutomationBench is a tool-use benchmark that evaluates AI agents on automating real-world workflows, testing their ability to orchestrate tools and complete multi-step automation tasks.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| GLM-5.3 | 0.482 | Not recorded | Not recorded | 2026-08-14 · model_announcement | LLM Stats |
| DeepSeek-V4-Pro-0813 | 0.318 | Not recorded | Not recorded | 2026-08-13 · model_announcement | LLM Stats |
| Kimi K3 | 0.308 | Not recorded | Not recorded | 2026-07-16 · model_announcement | LLM Stats |
| Gemini 3.7 Flash | 0.304 | Not recorded | Not recorded | 2026-08-13 · model_announcement | LLM Stats |
| Qwen3.8 Max | 0.273 | Not recorded | Not recorded | 2026-08-02 · model_announcement | LLM Stats |
| Claude Opus 5 | 0.26 | Not recorded | Not recorded | 2026-07-24 · model_announcement | LLM Stats |
| DeepSeek-V4-Flash-0731 | 0.251 | Not recorded | Not recorded | 2026-07-31 · model_announcement | LLM Stats |
| GPT-5.6 Sol | 0.181 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| Claude Fable 5 | 0.174 | Not recorded | Not recorded | 2026-06-09 · model_announcement | LLM Stats |
| GPT-5.6 Terra | 0.152 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| GPT-5.6 Luna | 0.149 | Not recorded | Not recorded | 2026-07-09 · model_announcement | LLM Stats |
| Claude Sonnet 5 | 0.135 | Not recorded | Not recorded | 2026-06-30 · model_announcement | LLM Stats |