AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

Terminal-Bench Hard

Agentic coding & terminal use

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2025-09-02
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 432

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
GPT-5.6 Sol (max)0.659090909090909Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.628787878787879Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.628787878787879Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.628787878787879Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.621212121212121Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.613636363636364Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.606060606060606Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.606060606060606Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GPT-5.5 (high)0.598484848484849Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.583333333333333Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.575757575757576Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.575757575757576Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.575757575757576Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.575757575757576Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 4.7 (Non-reasoning, High Effort)0.545454545454545Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.537878787878788Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
GPT-5.3 Codex (xhigh)0.53030303030303Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.53030303030303Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.522727272727273Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GPT-5.5 (low)0.522727272727273Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.515151515151515Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Qwen3.7 Max0.507575757575758Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GLM-5.2 (max)0.507575757575758Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.492424242424242Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
KAT Coder Pro V20.492424242424242Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Claude Opus 4.6 (Non-reasoning, High Effort)0.484848484848485Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.46969696969697Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.46969696969697Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3.7 Plus0.46969696969697Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
Gemini 3.5 Flash (minimal)0.462121212121212Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, High Effort)0.462121212121212Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)0.462121212121212Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.462121212121212Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GPT-5.1 (high)0.454545454545455Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Muse Spark0.454545454545455Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
Kimi K2.7 Code0.446969696969697Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
Kimi K2.60.439393939393939Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Qwen3.6 Max Preview0.439393939393939Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.439393939393939Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.6 Plus0.439393939393939Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.431818181818182Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GLM-5 (Reasoning)0.431818181818182Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
GPT-5.4 (low)0.431818181818182Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.431818181818182Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.431818181818182Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
MiniMax-M30.424242424242424Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.424242424242424Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GPT-5.5 Instant (May 2026)0.424242424242424Not recordedNot recorded2026-05-05 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, Low Effort)0.424242424242424Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
MiMo-V2.50.416666666666667Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.416666666666667Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.416666666666667Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.409090909090909Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Grok 4.20 0309 (Reasoning)0.409090909090909Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.409090909090909Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.409090909090909Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
MiMo-V2-Pro0.409090909090909Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
MiniMax-M2.70.393939393939394Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
Gemini 3.5 Flash (medium)0.393939393939394Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GLM-5 (Non-reasoning)0.393939393939394Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.386363636363636Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.386363636363636Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Kimi K2.6 (Non-reasoning)0.378787878787879Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GPT-5.4 (Non-reasoning)0.378787878787879Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.378787878787879Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GPT-5 (medium)0.378787878787879Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok 40.378787878787879Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Grok 4.3 (high)0.378787878787879Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Reasoning)0.378787878787879Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
GPT-5.2 Codex (xhigh)0.371212121212121Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
o30.371212121212121Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.363636363636364Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Non-reasoning)0.363636363636364Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.363636363636364Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
MiMo-V2-Omni-03270.356060606060606Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Non-reasoning)0.356060606060606Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
MiMo-V2.5-Pro (Non-reasoning)0.356060606060606Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Step 3.7 Flash0.356060606060606Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.356060606060606Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
GLM-5.1 (Non-reasoning)0.356060606060606Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.356060606060606Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.356060606060606Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.348484848484849Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiniMax-M2.50.348484848484849Not recordedNot recorded2026-02-12 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.348484848484849Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.348484848484849Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.348484848484849Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
MiMo-V2-Omni0.348484848484849Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.348484848484849Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.343352330715909Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5.4 mini (medium)0.340909090909091Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Hy3-preview (Reasoning)0.340909090909091Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Non-reasoning)0.340909090909091Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.340909090909091Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GLM-5-Turbo0.333333333333333Not recordedNot recorded2026-03-15 · model_announcementArtificial Analysis
GPT-5 mini (high)0.333333333333333Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.4 nano (medium)0.333333333333333Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Mistral Medium 3.50.333333333333333Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.333333333333333Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.325757575757576Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Step 3.5 Flash 26030.325757575757576Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GLM 5V Turbo (Reasoning)0.325757575757576Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
GPT-5 (high)0.325757575757576Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.325757575757576Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Qwen3.5 27B (Non-reasoning)0.318181818181818Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.318181818181818Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.318181818181818Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.318181818181818Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Hy3-preview (Non-reasoning)0.318181818181818Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.318181818181818Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
MiMo-V2-Flash (Feb 2026)0.310606060606061Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
North Mini Code0.310606060606061Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.310606060606061Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Ling-2.6-1T0.310606060606061Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.310606060606061Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.310606060606061Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.310606060606061Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Kimi K2 Thinking0.310606060606061Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.303030303030303Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Grok 4.3 (medium)0.303030303030303Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.303030303030303Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.303030303030303Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.295454545454545Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
JT-35B-Flash0.287878787878788Not recordedNot recorded2026-05-14 · model_announcementArtificial Analysis
MiniMax-M2.10.287878787878788Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.287878787878788Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.287878787878788Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.287878787878788Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.287878787878788Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Ring-2.6-1T0.287878787878788Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.28030303030303Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.272727272727273Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.272727272727273Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Step 3.5 Flash0.272727272727273Not recordedNot recorded2026-02-02 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.272727272727273Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Mercury 20.265151515151515Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.265151515151515Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.265151515151515Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Doubao Seed Code0.265151515151515Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
GPT-5 (low)0.265151515151515Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok 4.3 (low)0.265151515151515Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.257575757575758Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.257575757575758Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
MiniMax-M20.257575757575758Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.25Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.25Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Command A+0.25Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.25Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Non-reasoning)0.25Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.25Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.242424242424242Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.242424242424242Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.242424242424242Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.242424242424242Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
Qwen3 Max Thinking0.242424242424242Not recordedNot recorded2026-01-26 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.242424242424242Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.242424242424242Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
HyperNova 60B 26050.234848484848485Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
Kimi K2 09050.234848484848485Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.234848484848485Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.227272727272727Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Trinity Large Thinking0.227272727272727Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.227272727272727Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.21969696969697Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
GLM-4.7-Flash (Reasoning)0.21969696969697Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Grok 4.20 0309 (Non-reasoning)0.21969696969697Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
Qwen3.5 Omni Plus0.212121212121212Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.212121212121212Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.212121212121212Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Ling 2.6 Flash0.212121212121212Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0.212121212121212Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.212121212121212Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.204545454545455Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
GLM-4.5-Air0.204545454545455Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Qwen3 Max0.204545454545455Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.196969696969697Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.189393939393939Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
Devstral 20.189393939393939Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.189393939393939Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.189393939393939Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Kimi K2.5 (Non-reasoning)0.189393939393939Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Qwen3.5 9B (Non-reasoning)0.181818181818182Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
JT-MINI0.181818181818182Not recordedNot recorded2026-04-15 · model_announcementArtificial Analysis
Qwen3.5 4B (Reasoning)0.181818181818182Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.181818181818182Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GPT-5 (minimal)0.181818181818182Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 Coder Next0.181818181818182Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.181818181818182Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.174242424242424Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.174242424242424Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok Code Fast 10.174242424242424Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.174242424242424Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.174242424242424Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.174242424242424Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.174242424242424Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.166666666666667Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Non-reasoning)0.166666666666667Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.166666666666667Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.166666666666667Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Devstral Small 20.166666666666667Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.166666666666667Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Kimi K20.159090909090909Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
Mistral Large 30.159090909090909Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.159090909090909Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.151515151515152Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
DeepSeek V3 03240.151515151515152Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
o4-mini (high)0.151515151515152Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.151515151515152Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.143939393939394Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.143939393939394Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.143939393939394Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.143939393939394Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.143939393939394Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.1364Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.136363636363636Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-4.10.136363636363636Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.136363636363636Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.136363636363636Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
o10.128787878787879Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.128787878787879Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
Magistral Medium 1.20.128787878787879Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.128787878787879Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.121212121212121Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.121212121212121Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.121212121212121Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.121212121212121Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-5 nano (high)0.121212121212121Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemma 4 12B (Non-reasoning)0.113636363636364Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Grok 30.113636363636364Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Qwen3.5 4B (Non-reasoning)0.113636363636364Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.113636363636364Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.113636363636364Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.113636363636364Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Mistral Medium 3.10.106060606060606Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Mistral Small 4 (Non-reasoning)0.106060606060606Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Ling-1T0.106060606060606Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.106060606060606Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
LongCat Flash Lite0.106060606060606Not recordedNot recorded2026-01-28 · model_announcementArtificial Analysis
Ling-flash-2.00.106060606060606Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.106060606060606Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.106060606060606Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
K2-V2 (high)0.0984848484848485Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.0984848484848485Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.0984848484848485Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
INTELLECT-30.0909090909090909Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Magistral Medium 10.0909090909090909Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Devstral Medium0.0909090909090909Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.0909090909090909Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.0833333333333333Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Qwen3.5 Omni Flash0.0833333333333333Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.0833333333333333Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0.0833333333333333Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.0833333333333333Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0.0833333333333333Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
K2-V2 (medium)0.0833333333333333Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Mistral Small 3.10.0757575757575758Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.0757575757575758Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Ring-flash-2.00.0757575757575758Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Gemma 4 E4B (Non-reasoning)0.0757575757575758Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.0757575757575758Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
GPT-4.1 mini0.0757575757575758Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Solar Pro 30.0757575757575758Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.0757575757575758Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.0681818181818182Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.0681818181818182Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.0681818181818182Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
o3-mini0.0681818181818182Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Mistral Small 3.20.0681818181818182Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.0681818181818182Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.0681818181818182Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
K2 Think V20.0681818181818182Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.0681818181818182Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.0681818181818182Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Llama 4 Maverick0.0681818181818182Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.0681818181818182Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0.0681818181818182Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Ring-1T0.0681818181818182Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.0681818181818182Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Nova Premier0.0681818181818182Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.0681818181818182Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
o3-mini (high)0.0606060606060606Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.0606060606060606Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.0606060606060606Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.0606060606060606Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.0606060606060606Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Nova Pro0.0606060606060606Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.0606060606060606Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.0606060606060606Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.0606060606060606Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.0606060606060606Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Devstral Small (May '25)0.0606060606060606Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.053030303030303Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.053030303030303Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Step3 VL 10B0.053030303030303Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.053030303030303Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.053030303030303Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.053030303030303Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.053030303030303Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.0454545454545455Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Magistral Small 10.0454545454545455Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.0454545454545455Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.0454545454545455Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.0454545454545455Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.0454545454545455Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Magistral Small 1.20.0454545454545455Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Ministral 3 14B0.0454545454545455Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.0454545454545455Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Ministral 3 8B0.0454545454545455Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.0454545454545455Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.0454545454545455Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
K2-V2 (low)0.0454545454545455Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
LFM2.5-8B-A1B0.0454545454545455Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.0454545454545455Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0.0378787878787879Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.0378787878787879Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.0378787878787879Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.0378787878787879Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.0378787878787879Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Medium 30.0378787878787879Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0.0378787878787879Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.0378787878787879Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.0378787878787879Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
GPT-4.1 nano0.0378787878787879Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.0378787878787879Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.0378787878787879Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.0378787878787879Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
GLM-4.7-Flash (Non-reasoning)0.0378787878787879Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.0378787878787879Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Phi-40.0378787878787879Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.0303030303030303Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.0303030303030303Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.0303030303030303Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
MiniMax M1 80k0.0303030303030303Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.0303030303030303Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0.0303030303030303Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.0303030303030303Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.0303030303030303Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.0227272727272727Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.0227272727272727Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0.0227272727272727Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
MiniMax M1 40k0.0227272727272727Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.0227272727272727Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.0227272727272727Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Solar Open 100B (Reasoning)0.0227272727272727Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Granite 4.0 H Small0.0227272727272727Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Tri-21B-think Preview0.0227272727272727Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Gemma 4 E2B (Non-reasoning)0.0227272727272727Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Sarvam 30B (high)0.0227272727272727Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Jamba 1.7 Large0.0227272727272727Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Granite 4.1 3B0.0227272727272727Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.0227272727272727Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.0227272727272727Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.0227272727272727Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Falcon-H1R-7B0.0227272727272727Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.0227272727272727Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Granite 4.1 30B0.0227272727272727Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.0227272727272727Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.0151515151515152Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Granite 4.0 Micro0.0151515151515152Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.0151515151515152Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.0151515151515152Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Nova Micro0.0151515151515152Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Sarvam 105B (high)0.0151515151515152Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.0151515151515152Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.0151515151515152Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Llama 4 Scout0.0151515151515152Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Olmo 3 32B Think0.0151515151515152Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.0151515151515152Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.0151515151515152Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Claude 3 Haiku0.00757575757575758Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.00757575757575758Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.00757575757575758Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.00757575757575758Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Olmo 3 7B Think0.00757575757575758Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Command A0.00757575757575758Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Ling-mini-2.00.00757575757575758Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Nova Lite0.00757575757575758Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Tri-21B-Think0.00757575757575758Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.00757575757575758Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.00757575757575758Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
LFM2 2.6B0.00757575757575758Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.00757575757575758Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0.00757575757575758Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.00757575757575758Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Gemma 3 270M0Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
LFM2 1.2B0Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
LFM2.5-VL-1.6B0Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Molmo2-8B0Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
LFM2.5-1.2B-Instruct0Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Apertus 70B Instruct0Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
OLMo 2 32B0Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Granite 4.0 350M0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
LFM2.5-1.2B-Thinking0Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Ministral 3 3B0Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
LFM2 8B A1B0Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
MiniCPM5-1B (Reasoning)0Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Nanbeige4.1-3B0Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Tiny Aya Global0Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Granite 4.1 8B0Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Apertus 8B Instruct0Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Olmo 3.1 32B Instruct0Not recordedNot recorded2026-01-13 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Granite 4.0 1B0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Granite 4.0 H 350M0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Molmo 7B-D0Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Jamba 1.7 Mini0Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
MiniCPM5-1B (Non-reasoning)0Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Granite 4.0 H 1B0Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Reka Flash 30Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
OLMo 2 7B0Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
LFM2 24B A2B0Not recordedNot recorded2026-02-25 · model_announcementArtificial Analysis

Put this benchmark in context

Coding benchmarksTools and agents benchmarks