AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

IFBench

Instruction following

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2025-07-03
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 450

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Grok 4.3 (medium)0.833333333333333Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Grok 4.20 0309 (Reasoning)0.829251700680272Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
MiniMax-M30.828571428571429Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.813605442176871Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
Grok 4.3 (high)0.812925170068027Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Reasoning)0.812244897959184Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Grok 4.3 (low)0.80952380952381Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Qwen3.7 Max0.805442176870748Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0.804081632653061Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.798639455782313Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.795918367346939Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.791836734693877Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.790476190476191Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.787755102040816Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.779591836734694Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Qwen3.7 Plus0.779591836734694Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5.2 Codex (xhigh)0.776190476190476Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.772108843537415Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.771428571428571Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Qwen3.6 Max Preview0.765986394557823Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.764625850340136Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.763265306122449Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.762585034013605Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Kimi K2.60.759863945578231Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.759183673469388Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Muse Spark0.759183673469388Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.758503401360544Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.757142857142857Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
MiniMax-M2.70.757142857142857Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.75578231292517Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.75578231292517Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GPT-5 mini (high)0.754421768707483Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.754421768707483Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5.3 Codex (xhigh)0.753741496598639Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Qwen3.6 Plus0.751700680272109Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Gemini 3.5 Flash (medium)0.745578231292517Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.741496598639456Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Command A+0.739455782312925Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.739455782312925Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.735374149659864Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.734693877551021Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GLM-5.2 (max)0.733333333333333Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.73265306122449Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GLM-5-Turbo0.731972789115646Not recordedNot recorded2026-03-15 · model_announcementArtificial Analysis
GPT-5 (high)0.730612244897959Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.1 (high)0.728571428571429Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.726530612244898Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.725170068027211Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.724489795918367Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GLM-5 (Reasoning)0.72312925170068Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
MiniMax-M20.72312925170068Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
MiMo-V2-Flash (Feb 2026)0.718367346938776Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
MiniMax-M2.50.716326530612245Not recordedNot recorded2026-02-12 · model_announcementArtificial Analysis
GPT-5.5 (high)0.716326530612245Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.714965986394558Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
GPT-5.5 Instant (May 2026)0.714965986394558Not recordedNot recorded2026-05-05 · model_announcementArtificial Analysis
o30.714285714285714Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.712925170068027Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.712244897959184Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Solar Pro 30.712018140589569Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.71156462585034Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.710884353741497Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.710204081632653Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.70952380952381Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.707482993197279Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Qwen3 Max Thinking0.707482993197279Not recordedNot recorded2026-01-26 · model_announcementArtificial Analysis
GPT-5 (medium)0.706122448979592Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.704081632653061Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
o10.703401360544218Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.702040816326531Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.7Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiniMax-M2.10.698639455782313Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
Mercury 20.697959183673469Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.695918367346939Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.691836734693878Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.691156462585034Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.689795918367347Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
MiMo-V2-Pro0.68843537414966Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
Mistral Medium 3.50.687755102040816Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
o4-mini (high)0.687074829931973Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.685034013605442Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.683673469387755Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Kimi K2 Thinking0.680952380952381Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.67891156462585Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.67891156462585Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.675510204081633Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GPT-5 nano (high)0.675510204081633Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
MiMo-V2-Omni-03270.673469387755102Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Step 3.7 Flash0.672789115646258Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
o3-mini (high)0.671428571428571Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
MiMo-V2.50.671428571428571Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.66734693877551Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
KAT Coder Pro V20.666666666666667Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
GPT-5 (low)0.665986394557823Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.66530612244898Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Step 3.5 Flash 26030.66530612244898Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
HyperNova 60B 26050.664625850340136Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.662585034013605Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.661904761904762Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Nex-N2-Pro0.661904761904762Not recordedNot recorded2026-06-02 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0.659863945578231Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
GPT-5.4 (low)0.659183673469388Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.659183673469388Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.652380952380953Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.651020408163265Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5.4 mini (medium)0.647619047619048Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.646938775510204Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Step 3.5 Flash0.645578231292517Not recordedNot recorded2026-02-02 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.64421768707483Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.4 nano (medium)0.64421768707483Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.643537414965986Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.5 (low)0.643537414965986Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.642176870748299Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.638775510204082Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.63469387755102Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0.631972789115646Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Hy3-preview (Reasoning)0.631292517006803Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Kimi K2.7 Code0.631292517006803Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
K2 Think V20.627891156462585Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.622448979591837Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-5.6 Terra (medium)0.621768707482993Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.617687074829932Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.617006802721088Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.612244897959184Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
GLM 5V Turbo (Reasoning)0.610884353741497Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
GLM-4.7-Flash (Reasoning)0.608163265306122Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.606802721088435Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.606802721088435Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
K2-V2 (high)0.601360544217687Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.596598639455782Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DiffusionGemma 26B A4B0.594557823129252Not recordedNot recorded2026-06-10 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.593877551020408Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.586394557823129Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.582993197278912Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0.582312925170068Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.579591836734694Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.579591836734694Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.578231292517007Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Solar Open 100B (Reasoning)0.57687074829932Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
North Mini Code0.575510204081633Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Ling 2.6 Flash0.574149659863946Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.572789115646258Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.570068027210884Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.570068027210884Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
Ling-2.6-1T0.568707482993197Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.565986394557823Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.564625850340136Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Trinity Large Thinking0.562585034013605Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
LFM2.5-8B-A1B0.556462585034014Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.554421768707483Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GLM-5 (Non-reasoning)0.551700680272109Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.551020408163265Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
K2-V2 (medium)0.551020408163265Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.546938775510204Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Tri-21B-Think0.546258503401361Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.546258503401361Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Falcon-H1R-7B0.54421768707483Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.542857142857143Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.541496598639456Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.538095238095238Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.537414965986395Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Grok 40.536734693877551Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
MiMo-V2-Omni0.535374149659864Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.53469387755102Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)0.531292517006803Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.527210884353742Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.525850340136054Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.524489795918367Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.52312925170068Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.520408163265306Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Qwen3.5 4B (Reasoning)0.519727891156463Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GLM-5.1 (Non-reasoning)0.519727891156463Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Non-reasoning)0.516326530612245Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Doubao Seed Code0.514285714285714Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.512244897959184Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Qwen3.5 Omni Plus0.51156462585034Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.508163265306122Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.506802721088435Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.505442176870748Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.502721088435374Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Step3 VL 10B0.502040816326531Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.498639455782313Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.497959183673469Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.496598639455782Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Non-reasoning)0.493197278911565Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
MiniCPM5-1B (Reasoning)0.493197278911565Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.493197278911565Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Olmo 3 32B Think0.491156462585034Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.490476190476191Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.487074829931973Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
GPT-5.4 (Non-reasoning)0.484353741496599Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.482993197278912Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.481632653061224Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.480272108843537Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Hy3-preview (Non-reasoning)0.479591836734694Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Grok 4.20 0309 (Non-reasoning)0.478231292517007Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.476190476190476Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.474149659863946Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Gemini 3.5 Flash (minimal)0.472789115646259Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Non-reasoning)0.472108843537415Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Tri-21B-think Preview0.471428571428571Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.470748299319728Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Grok 30.469387755102041Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Qwen3.5 27B (Non-reasoning)0.469387755102041Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GLM-4.7-Flash (Non-reasoning)0.462585034013605Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.462585034013605Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.461224489795918Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.460544217687075Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
LFM2 24B A2B0.458503401360544Not recordedNot recorded2026-02-25 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.458503401360544Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Non-reasoning)0.457823129251701Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.457142857142857Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.45578231292517Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 (minimal)0.45578231292517Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.45578231292517Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Non-reasoning)0.454421768707483Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.453741496598639Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Gemma 4 12B (Non-reasoning)0.451700680272109Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.451020408163265Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.450340136054422Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Claude Opus 4.6 (Non-reasoning, High Effort)0.446258503401361Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Ring-1T0.445578231292517Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
Ring-2.6-1T0.445578231292517Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.444897959183673Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Magistral Small 1.20.443537414965986Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Granite 4.1 30B0.443537414965986Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Kimi K2.6 (Non-reasoning)0.442857142857143Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0.442176870748299Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Qwen3 Max0.441496598639456Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.440816326530612Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.440136054421769Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
LFM2.5-1.2B-Instruct0.438095238095238Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Kimi K2.5 (Non-reasoning)0.436734693877551Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Claude Opus 4.7 (Non-reasoning, High Effort)0.436054421768707Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.435374149659864Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.434013605442177Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.434013605442177Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Ring-flash-2.00.43265306122449Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Claude 4 Opus (Non-reasoning)0.43265306122449Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.431972789115646Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.431292517006803Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
LongCat Flash Lite0.430612244897959Not recordedNot recorded2026-01-28 · model_announcementArtificial Analysis
GPT-4.10.429931972789116Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.429931972789116Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
Magistral Medium 1.20.429931972789116Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
Llama 4 Maverick0.429931972789116Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.427891156462585Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
MiMo-V2.5-Pro (Non-reasoning)0.427210884353741Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.426530612244898Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.426530612244898Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, Low Effort)0.423809523809524Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
JT-35B-Flash0.420408163265306Not recordedNot recorded2026-05-14 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.420408163265306Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.419047619047619Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
LFM2.5-1.2B-Thinking0.418367346938776Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.418367346938776Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
MiniMax M1 80k0.417687074829932Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Kimi K2 09050.417006802721088Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.414965986394558Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Olmo 3 7B Think0.414965986394558Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.414965986394558Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Kimi K20.414965986394558Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
Grok Code Fast 10.413605442176871Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.413605442176871Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiniMax M1 40k0.412244897959184Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.412244897959184Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, High Effort)0.41156462585034Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.410884353741497Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
DeepSeek V3 03240.410204081632653Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
K2-V2 (low)0.40952380952381Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.405442176870748Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 4 E4B (Non-reasoning)0.405442176870748Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.405442176870748Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.404761904761905Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.402040816326531Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.399319727891157Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.398639455782313Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Mistral Medium 3.10.397959183673469Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.396598639455782Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.395918367346939Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.395918367346939Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
Llama 4 Scout0.395238095238095Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0.394557823129252Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Mistral Medium 30.392517006802721Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.391836734693878Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Olmo 3.1 32B Instruct0.391836734693878Not recordedNot recorded2026-01-13 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.391156462585034Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.390476190476191Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.389795918367347Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.389795918367347Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.38843537414966Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
QwQ 32B0.387755102040816Not recordedNot recorded2025-03-05 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.387074829931973Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Granite 4.1 8B0.386394557823129Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
GPT-4.1 mini0.382993197278912Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.381632653061225Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Devstral 20.380952380952381Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.380952380952381Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
OLMo 2 32B0.380952380952381Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Nova Pro0.380952380952381Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0.380272108843537Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3.5 Omni Flash0.379591836734694Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.37891156462585Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
Qwen3.5 9B (Non-reasoning)0.378231292517007Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.378231292517007Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.37687074829932Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
GLM-4.5-Air0.375510204081633Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.374829931972789Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0.370748299319728Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.370748299319728Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.370068027210884Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.368707482993197Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.36734693877551Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.36734693877551Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
JT-MINI0.366666666666667Not recordedNot recorded2026-04-15 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.365986394557823Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.365986394557823Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Command A0.364625850340136Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.364625850340136Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.363265306122449Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.363265306122449Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Large 30.361904761904762Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.361904761904762Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Nova Premier0.361904761904762Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
Claude 3 Haiku0.361224489795918Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.359863945578231Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
Nanbeige4.1-3B0.354421768707483Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Qwen3 Coder Next0.352380952380952Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
Jamba 1.7 Large0.351700680272109Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
MiniCPM5-1B (Non-reasoning)0.351700680272109Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Ling-1T0.347619047619048Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.347619047619048Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.347619047619048Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.345578231292517Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Pixtral Large0.344897959183673Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.34421768707483Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Sarvam 105B (high)0.343537414965986Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Ling-flash-2.00.343537414965986Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.342857142857143Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.342176870748299Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Nova Lite0.341496598639456Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
INTELLECT-30.340136054421769Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.337414965986395Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Granite 4.1 3B0.336734693877551Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Gemma 4 E2B (Non-reasoning)0.336054421768707Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.335374149659864Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.33469387755102Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Mistral Small 3.20.33469387755102Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.33469387755102Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3.5 4B (Non-reasoning)0.33265306122449Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-40.331972789115646Not recordedNot recorded2023-03-14 · model_announcementArtificial Analysis
LFM2.5-VL-1.6B0.331292517006803Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.331292517006803Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.330612244897959Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.329251700680272Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Mistral Small 4 (Non-reasoning)0.327891156462585Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.327891156462585Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.327210884353742Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.327210884353741Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.326530612244898Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.325170068027211Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.325170068027211Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.32312925170068Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Ministral 3 14B0.320408163265306Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
GPT-4.1 nano0.320408163265306Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.319047619047619Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.319047619047619Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.318367346938776Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0.318367346938775Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.318367346938775Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0.316326530612245Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Devstral Small (May '25)0.316326530612245Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.314965986394558Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0.314965986394558Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Granite 4.0 H Small0.314965986394558Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen3 32B (Non-reasoning)0.314965986394558Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.313605442176871Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.312925170068027Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.312244897959184Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.31156462585034Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Devstral Small 20.31156462585034Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
GPT-4o mini0.30952380952381Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.307482993197279Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.304081632653061Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Reka Flash 30.304081632653061Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.300680272108844Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Mistral Small 3.10.299319727891156Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Devstral Medium0.299319727891156Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Nova Micro0.293877551020408Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0.291156462585034Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Ministral 3 8B0.291156462585034Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.289795918367347Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.286394557823129Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.285714285714286Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.285714285714286Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.282993197278912Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.280952380952381Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.27891156462585Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.27891156462585Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.276190476190476Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.275510204081633Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.271428571428571Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Molmo2-8B0.269387755102041Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.268707482993197Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Ministral 3 3B0.268027210884354Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0.26734693877551Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
Sarvam 30B (high)0.264625850340136Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Mistral Small 30.263945578231293Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
LFM2 8B A1B0.262585034013605Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.261904761904762Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.261904761904762Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Apertus 70B Instruct0.258503401360544Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.258503401360544Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.255102040816327Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.253061224489796Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Magistral Medium 10.251020408163265Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Magistral Small 10.247619047619048Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Granite 4.0 Micro0.247619047619048Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0.245578231292517Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
OLMo 2 7B0.24421768707483Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.239455782312925Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0.238775510204082Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Ling-mini-2.00.236054421768707Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Phi-40.235374149659864Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.233333333333333Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.229931972789116Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 32B0.229251700680272Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0.227891156462585Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.224489795918367Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Apertus 8B Instruct0.223809523809524Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 14B0.22108843537415Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.220408163265306Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
LFM2 1.2B0.219727891156463Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.219047619047619Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0.215646258503401Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0.214965986394558Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.210884353741497Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.210884353741497Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Granite 4.0 1B0.205442176870748Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Tiny Aya Global0.201360544217687Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Mistral 7B Instruct0.199319727891156Not recordedNot recorded2023-09-27 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.199319727891156Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.198639455782313Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Molmo 7B-D0.196598639455782Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
LFM2 2.6B0.195238095238095Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 8B0.175510204081633Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.175510204081633Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Granite 4.0 350M0.159183673469388Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 1.5B0.131972789115646Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Gemma 3 270M0.12108843537415Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis

Put this benchmark in context

Language benchmarks