AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

ITBench-AA

Kubernetes incident root-cause analysis

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 33

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.6 Sol (max)0.562146892655367Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.510357815442561Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Kimi K3 (max)0.476930320150659Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.466572504708098Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.458097928436911Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GLM-5.2 (max)0.426553672316384Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
Qwen3.7 Max0.424670433145009Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.403483992467043Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GPT-5.6 Luna (max)0.403201506591337Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.402542372881356Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.398022598870057Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.383239171374765Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.382297551789077Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.372881355932203Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.354990583804143Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.352165725047081Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.340866290018832Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Grok 4.3 (high)0.327212806026365Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.315160075329567Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Kimi K2.60.311864406779661Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.303309120258273Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Step 3.7 Flash0.302730696798493Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.273069679849341Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
MiniMax-M2.70.264595103578154Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.243879472693032Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.236346516007533Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.215160075329567Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.186440677966102Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.178907721280603Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.12909604519774Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.0564971751412429Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.0112994350282486Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.00564971751412429Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis

Put this benchmark in context

Tools and agents benchmarks