AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

Model reports

Tool Decathlon

Aggregates ten heterogeneous tool suites; the per-suite spread is wide.

Evaluation context and evidence

Source
Model reports
Publisher
Not recorded
Benchmark release
2025-10-28
Collected
Not recorded
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 8

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
DeepSeek-V4-Pro51.8percentthink max, pass@12026-04-22 · document_publicationDeepSeek-V4-Pro
DeepSeek-V4-Pro-081374.1percentmax reasoning effort, temp 1.0, top_p 0.952026-08-13 · document_publicationDeepSeek-V4-Pro-0813
DeepSeek-V4-Flash47.8percentthink max, pass@12026-06-25 · document_publicationDeepSeek-V4
Kimi K376.5percentreasoning=max2026-06-13 · document_publicationKimi K3
Qwen3.5-397B-A17B38.3percentthinking (temp 0.6, top_p 0.95, top_k 20)2026-02-16 · document_publicationQwen3.5-397B-A17B
GLM-5.140.7percentas reported2026-04-03 · document_publicationGLM-5.1
GLM-5.248.2percentofficial evaluation service, max_token 128K2026-06-16 · document_publicationGLM-5.2
GLM-538.0percentas reported2026-02-11 · document_publicationGLM-5