AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

AutomationBench

AutomationBench is a tool-use benchmark that evaluates AI agents on automating real-world workflows, testing their ability to orchestrate tools and complete multi-step automation tasks.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 12

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GLM-5.30.482Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
DeepSeek-V4-Pro-08130.318Not recordedNot recorded2026-08-13 · model_announcementLLM Stats
Kimi K30.308Not recordedNot recorded2026-07-16 · model_announcementLLM Stats
Gemini 3.7 Flash0.304Not recordedNot recorded2026-08-13 · model_announcementLLM Stats
Qwen3.8 Max0.273Not recordedNot recorded2026-08-02 · model_announcementLLM Stats
Claude Opus 50.26Not recordedNot recorded2026-07-24 · model_announcementLLM Stats
DeepSeek-V4-Flash-07310.251Not recordedNot recorded2026-07-31 · model_announcementLLM Stats
GPT-5.6 Sol0.181Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Claude Fable 50.174Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
GPT-5.6 Terra0.152Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
GPT-5.6 Luna0.149Not recordedNot recorded2026-07-09 · model_announcementLLM Stats
Claude Sonnet 50.135Not recordedNot recorded2026-06-30 · model_announcementLLM Stats