AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

τ²-Bench Telecom

Agentic tool use

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2025-06-12
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 440

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
JT-35B-Flash0.991228070175439Not recordedNot recorded2026-05-14 · model_announcementArtificial Analysis
GLM-5.2 (max)0.991228070175439Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GLM-4.7-Flash (Reasoning)0.988304093567251Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
GLM-5-Turbo0.985380116959064Not recordedNot recorded2026-03-15 · model_announcementArtificial Analysis
GLM 5V Turbo (Reasoning)0.985380116959064Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
Step 3.7 Flash0.985380116959064Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.985380116959064Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
GLM-5 (Reasoning)0.982456140350877Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.976608187134503Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Grok 4.3 (high)0.976608187134503Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Qwen3.6 Plus0.976608187134503Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GLM-5 (Non-reasoning)0.973684210526316Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
GLM-5.1 (Non-reasoning)0.970760233918129Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Grok 4.20 0309 (Reasoning)0.964912280701754Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.961988304093567Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Kimi K2.60.95906432748538Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Qwen3.6 Max Preview0.95906432748538Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.95906432748538Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.95906432748538Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.956140350877193Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Gemini 3.5 Flash (medium)0.956140350877193Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.956140350877193Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.956140350877193Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.953216374269006Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
MiniMax-M2.50.953216374269006Not recordedNot recorded2026-02-12 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.953216374269006Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
MiMo-V2-Pro0.950292397660819Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.950292397660819Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.950292397660819Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Qwen3.7 Max0.947368421052632Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.944444444444445Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Non-reasoning)0.944444444444445Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Step 3.5 Flash0.944444444444444Not recordedNot recorded2026-02-02 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.941520467836257Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.941520467836257Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.941520467836257Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.941520467836257Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Mistral Medium 3.50.941520467836257Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Kimi K2.6 (Non-reasoning)0.93859649122807Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.93859649122807Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.93859649122807Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.935672514619883Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.935672514619883Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
MiMo-V2-Flash (Feb 2026)0.932748538011696Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.932748538011696Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Tri-21B-think Preview0.932748538011696Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
JT-MINI0.929824561403509Not recordedNot recorded2026-04-15 · model_announcementArtificial Analysis
Qwen3.7 Plus0.929824561403509Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5.5 (high)0.929824561403509Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Kimi K2 Thinking0.929824561403509Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Reasoning)0.929824561403509Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.926900584795322Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Hy3-preview (Reasoning)0.926900584795322Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Ring-2.6-1T0.923976608187135Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
GPT-5.2 Codex (xhigh)0.921052631578947Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)0.921052631578947Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Qwen3.5 4B (Reasoning)0.921052631578947Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.91812865497076Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GLM-4.7-Flash (Non-reasoning)0.91812865497076Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Muse Spark0.915204678362573Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
Grok 4.3 (medium)0.912280701754386Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Non-reasoning)0.912280701754386Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
MiMo-V2-Omni0.912280701754386Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
MiMo-V2.50.906432748538012Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.906432748538012Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.906432748538012Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.903508771929824Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Kimi K2.7 Code0.900584795321637Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
Trinity Large Thinking0.900584795321637Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
Ling-2.6-1T0.89766081871345Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.894736842105263Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
KAT Coder Pro V20.894736842105263Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.891812865497076Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
MiniMax-M30.888888888888889Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
Grok 4.3 (low)0.888888888888889Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.885964912280702Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.885964912280702Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3.5 Omni Plus0.883040935672515Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
MiMo-V2-Omni-03270.880116959064328Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Qwen3.5 4B (Non-reasoning)0.87719298245614Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0.87719298245614Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
Step 3.5 Flash 26030.874269005847953Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.874269005847953Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
Qwen3.5 27B (Non-reasoning)0.871345029239766Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.871345029239766Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.871345029239766Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.868421052631579Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.868421052631579Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
MiniMax-M20.868421052631579Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
GPT-5 (medium)0.865497076023392Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.865497076023392Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.862573099415205Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
Solar Pro 30.862573099415205Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.862573099415205Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.862573099415205Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.3 Codex (xhigh)0.859649122807018Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Ling 2.6 Flash0.859649122807018Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
MiniMax-M2.10.853801169590643Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
Qwen3.5 9B (Non-reasoning)0.850877192982456Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.850877192982456Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.850877192982456Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 4.6 (Non-reasoning, High Effort)0.847953216374269Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
GPT-5 (high)0.847953216374269Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.847953216374269Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
MiniMax-M2.70.847953216374269Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.847953216374269Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.845029239766082Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.5 Omni Flash0.845029239766082Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
GPT-5 (low)0.842105263157895Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Non-reasoning)0.839181286549708Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.839181286549708Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
GPT-5.5 (low)0.839181286549708Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.839181286549707Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Qwen3 Max Thinking0.836257309941521Not recordedNot recorded2026-01-26 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.83625730994152Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.833333333333333Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.833333333333333Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.833333333333333Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.830409356725146Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiniCPM5-1B (Non-reasoning)0.824561403508772Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
GPT-5.1 (high)0.818713450292398Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0.815789473684211Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Nex-N2-Pro0.815789473684211Not recordedNot recorded2026-06-02 · model_announcementArtificial Analysis
Kimi K2.5 (Non-reasoning)0.812865497076023Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Tri-21B-Think0.809941520467836Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.809941520467836Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
MiniCPM5-1B (Reasoning)0.809941520467836Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
o30.807017543859649Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Command A+0.807017543859649Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.804093567251462Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.804093567251462Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.804093567251462Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, High Effort)0.795321637426901Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
LongCat Flash Lite0.795321637426901Not recordedNot recorded2026-01-28 · model_announcementArtificial Analysis
Qwen3 Coder Next0.795321637426901Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.789473684210526Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, Low Effort)0.789473684210526Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.783625730994152Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.780701754385965Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.780701754385965Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.769005847953216Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.760233918128655Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.760233918128655Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Grok Code Fast 10.757309941520468Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.757309941520468Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.757309941520468Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Grok 40.7485380117Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
GPT-5.4 (low)0.745614035087719Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.742690058479532Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Qwen3 Max0.742690058479532Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.742690058479532Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Claude Opus 4.7 (Non-reasoning, High Effort)0.739766081871345Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Kimi K2 09050.733918128654971Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.733918128654971Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
GPT-5.6 Terra (medium)0.728070175438596Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.728070175438596Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
MiMo-V2.5-Pro (Non-reasoning)0.725146198830409Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.719298245614035Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.716374269005848Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.713660933660934Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.710526315789474Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Mercury 20.707602339181287Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.704678362573099Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.704678362573099Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Grok 4.20 0309 (Non-reasoning)0.695906432748538Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.692982456140351Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.692982456140351Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0.690058479532164Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-5 mini (high)0.684210526315789Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.684210526315789Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.681286549707602Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.678362573099415Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.678362573099415Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Hy3-preview (Non-reasoning)0.675438596491228Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GPT-5 (minimal)0.669590643274854Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.657894736842105Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.657894736842105Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.657894736842105Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.654970760233918Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0.652046783625731Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.646198830409357Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.637426900584795Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.637426900584795Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
HyperNova 60B 26050.631578947368421Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.628654970760234Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
o10.625730994152047Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.619883040935672Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Kimi K20.611111111111111Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.605263157894737Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.60233918128655Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Non-reasoning)0.599415204678363Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.599415204678363Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.590643274853801Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Gemini 3.5 Flash (minimal)0.587719298245614Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Doubao Seed Code0.58187134502924Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
o4-mini (high)0.555555555555556Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.546783625730994Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.546783625730994Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.54093567251462Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.54093567251462Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0.532163742690059Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.532163742690059Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
GPT-4.1 mini0.529239766081871Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
GPT-5.4 nano (medium)0.526315789473684Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.523391812865497Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Magistral Medium 1.20.52046783625731Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.502923976608187Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.5Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.494152046783626Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.494152046783626Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5.5 Instant (May 2026)0.494152046783626Not recordedNot recorded2026-05-05 · model_announcementArtificial Analysis
Grok 30.488304093567252Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Solar Open 100B (Reasoning)0.482456140350877Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0.476608187134503Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-4.10.470760233918129Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
DeepSeek V3 03240.470760233918129Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Sarvam 105B (high)0.467836257309941Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
GLM-4.5-Air0.464912280701754Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.464912280701754Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.464912280701754Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.464912280701754Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.456140350877193Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.456140350877193Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0.453216374269006Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.450292397660819Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.447368421052632Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.435672514619883Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.435672514619883Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.432748538011696Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.429824561403509Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Granite 4.1 30B0.421052631578947Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.415204678362573Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.412280701754386Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.409356725146199Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Mistral Medium 3.10.406432748538012Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Non-reasoning)0.403508771929825Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Nova Premier0.383040935672515Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
Devstral Small (May '25)0.380116959064327Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.374269005847953Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
North Mini Code0.374269005847953Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.371345029239766Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.371345029239766Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
GPT-5.4 mini (medium)0.365497076023392Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.365497076023392Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
Pixtral Large0.365497076023392Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
GPT-5 nano (high)0.365497076023392Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.362573099415205Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
GPT-5.4 (Non-reasoning)0.359649122807018Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.350877192982456Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.347953216374269Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.347953216374269Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.345029239766082Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Sarvam 30B (high)0.345029239766082Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.345029239766082Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.345029239766082Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
MiniMax M1 80k0.342105263157895Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.339181286549708Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.339181286549708Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.333333333333333Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0.330409356725146Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Ling-1T0.327485380116959Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.327485380116959Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.324561403508772Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.321637426900585Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 4 12B (Non-reasoning)0.318713450292398Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.318713450292398Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.318713450292398Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.315789473684211Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
MiniMax M1 40k0.315789473684211Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.315789473684211Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
o3-mini (high)0.312865497076023Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.312865497076023Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.307017543859649Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.307017543859649Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.307017543859649Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.304093567251462Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.304093567251462Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.298245614035088Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Small 3.20.295321637426901Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.295321637426901Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.292397660818713Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.292397660818713Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.289473684210526Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
o3-mini0.286549707602339Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.283625730994152Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.283625730994152Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.280701754385965Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0.280701754385965Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.280701754385965Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.280701754385965Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Magistral Small 1.20.277777777777778Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Granite 4.1 8B0.277777777777778Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.277777777777778Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
K2-V2 (high)0.277777777777778Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Falcon-H1R-7B0.277777777777778Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.271929824561404Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Ministral 3 14B0.271929824561404Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.269005847953216Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Magistral Small 10.266081871345029Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
INTELLECT-30.266081871345029Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Ministral 3 8B0.266081871345029Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.266081871345029Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.266081871345029Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.266081871345029Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Ring-1T0.263157894736842Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.260233918128655Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 4 E4B (Non-reasoning)0.260233918128655Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.260233918128655Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.257309941520468Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.254385964912281Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.254385964912281Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
K2 Think V20.254385964912281Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Mistral Small 3.10.251461988304094Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.251461988304094Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.251461988304094Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Devstral 20.248538011695906Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Ministral 3 3B0.248538011695906Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.248538011695906Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
K2-V2 (medium)0.248538011695906Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.245614035087719Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
Mistral Large 30.245614035087719Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Mistral Medium 30.242690058479532Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.239766081871345Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.233918128654971Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.233918128654971Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Devstral Small 20.233918128654971Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.233918128654971Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Magistral Medium 10.230994152046784Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.230994152046784Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.228070175438596Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
Granite 4.0 1B0.228070175438596Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.225146198830409Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.225146198830409Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.225146198830409Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Gemma 4 E2B (Non-reasoning)0.222222222222222Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.222222222222222Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.222222222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.219298245614035Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.219298245614035Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.216374269005848Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.216374269005848Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.216374269005848Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nanbeige4.1-3B0.216374269005848Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.213450292397661Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Olmo 3.1 32B Instruct0.213450292397661Not recordedNot recorded2026-01-13 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.213450292397661Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Claude 3 Haiku0.210526315789474Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.210526315789474Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.210526315789474Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Ling-flash-2.00.207602339181287Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0.207602339181287Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0.207602339181287Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
K2-V2 (low)0.207602339181287Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.204678362573099Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Solar Mini0.201754385964912Not recordedNot recorded2024-01-25 · model_announcementArtificial Analysis
Devstral Medium0.198830409356725Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.198830409356725Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.195906432748538Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
LFM2.5-1.2B-Thinking0.195906432748538Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Granite 4.1 3B0.195906432748538Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.195906432748538Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Mistral Small 30.195906432748538Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.192982456140351Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.190058479532164Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.190058479532164Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.190058479532164Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.190058479532164Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Mistral Small 4 (Non-reasoning)0.184210526315789Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.184210526315789Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Llama 4 Maverick0.178362573099415Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Nova Lite0.175438596491228Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.172514619883041Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Granite 4.0 H Small0.172514619883041Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
GPT-4.1 nano0.172514619883041Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.16374269005848Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.16374269005848Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.16374269005848Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Step3 VL 10B0.160818713450292Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
LFM2.5-8B-A1B0.160818713450292Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.157894736842105Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Llama 4 Scout0.154970760233918Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.154970760233918Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Command A0.152046783625731Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.152046783625731Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.149122807017544Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.146198830409357Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.146198830409357Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.146198830409357Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Nova Micro0.140350877192982Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Nova Pro0.140350877192982Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
LFM2 2.6B0.134502923976608Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Jamba 1.7 Large0.134502923976608Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Ling-mini-2.00.131578947368421Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Granite 4.0 350M0.131578947368421Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Apertus 70B Instruct0.128654970760234Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
LFM2 1.2B0.125730994152047Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Granite 4.0 Micro0.125730994152047Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.125730994152047Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.125730994152047Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.116959064327485Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.114035087719298Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Apertus 8B Instruct0.114035087719298Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.114035087719298Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
LFM2 24B A2B0.111111111111111Not recordedNot recorded2026-02-25 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.108187134502924Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
LFM2.5-1.2B-Instruct0.108187134502924Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.105263157894737Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.105263157894737Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
LFM2 8B A1B0.105263157894737Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.105263157894737Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.10233918128655Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Gemma 3 270M0.0906432748538012Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
LFM2.5-VL-1.6B0.0847953216374269Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.0818713450292398Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.0497076023391813Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.0497076023391813Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.0409356725146199Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Mistral 7B Instruct0Not recordedNot recorded2023-09-27 · model_announcementArtificial Analysis
Olmo 3 7B Think0Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
Molmo2-8B0Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Ring-flash-2.00Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
OLMo 2 32B0Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Tiny Aya Global0Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
Molmo 7B-D0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Olmo 3 32B Think0Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Reka Flash 30Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Phi-40Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
OLMo 2 7B0Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis

Put this benchmark in context

Tools and agents benchmarks