AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

SciCode

Coding

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2024-07-18
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 577

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.601851851851852Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.58912037037037Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Kimi K3 (max)0.586805555555556Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
Muse Spark 1.1 (xhigh)0.582175925925926Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemini 3.7 Flash (medium)0.578703703703704Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.569444444444444Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemini 3.7 Flash (high)0.568287037037037Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.565972222222222Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.564814814814815Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GLM-5.3 (max)0.564814814814815Not recordedNot recorded2026-08-18 · model_announcementArtificial Analysis
Muse Spark 1.2 (xhigh)0.563657407407407Not recordedNot recorded2026-08-05 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.561342592592593Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.561342592592593Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.561342592592593Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.560185185185185Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.5 (high)0.559027777777778Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Max Effort)0.556712962962963Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.554398148148148Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)0.549768518518518Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.2 Codex (xhigh)0.546296296296296Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Grok 4.6 (medium)0.546296296296296Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.545138888888889Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, High Effort)0.542824074074074Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Grok 4.5 (high)0.540509259259259Not recordedNot recorded2026-07-08 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.539351851851852Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)0.53587962962963Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Grok 4.6 (high)0.53587962962963Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Gemini 3.7 Flash (low)0.53587962962963Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Kimi K2.60.534722222222222Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.534722222222222Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.534722222222222Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-5.3 Codex (xhigh)0.532407407407407Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.53125Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Gemini 3.5 Flash (medium)0.530092592592593Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Qwen3.8 Max0.528935185185185Not recordedNot recorded2026-08-03 · model_announcementArtificial Analysis
Gemini 3.6 Flash (high)0.52662037037037Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
GPT-5.6 Luna (max)0.525462962962963Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.520833333333333Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)0.518518518518518Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Qwen3.8 2.4T A95B0.516203703703704Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.516203703703704Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.5 (low)0.516203703703704Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Grok 4.6 (xhigh)0.516203703703704Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Muse Spark0.515046296296296Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
Kimi K3 (low)0.511574074074074Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
GPT-5.6 Luna (high)0.506944444444444Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Medium Effort)0.506944444444444Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.505787037037037Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
GLM-5.2 (max)0.50462962962963Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GPT-5.4 (low)0.503472222222222Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5.5 Instant (May 2026)0.503472222222222Not recordedNot recorded2026-05-05 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.502314814814815Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Grok Build 0.1 06160.502314814814815Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
Claude Opus 4.7 (Non-reasoning, High Effort)0.501157407407407Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.501157407407407Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Luna (xhigh)0.5Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.5Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.498842592592593Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.498842592592593Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.498842592592593Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
DeepSeek V4 Flash 0731 (Reasoning, Max Effort)0.498842592592593Not recordedNot recorded2026-07-31 · model_announcementArtificial Analysis
GPT-5.6 Terra (medium)0.496527777777778Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.49537037037037Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)0.491898148148148Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.491898148148148Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.489583333333333Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Gemini 3.5 Flash (minimal)0.488425925925926Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Qwen3.7 Max0.488425925925926Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Inkling Small0.487268518518519Not recordedNot recorded2026-07-30 · model_announcementArtificial Analysis
GPT-5.5 Instant (June 2026)0.486111111111111Not recordedNot recorded2026-06-25 · model_announcementArtificial Analysis
Claude Sonnet 5 (Non-reasoning, High Effort)0.486111111111111Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Grok 4.6 (low)0.483796296296296Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Low Effort)0.480324074074074Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Hy30.475694444444444Not recordedNot recorded2026-07-06 · model_announcementArtificial Analysis
Kimi K2.7 Code0.474537037037037Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.47337962962963Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Grok 4.3 (high)0.47337962962963Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GPT-5.4 (Non-reasoning)0.471064814814815Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
GPT-5.6 Sol (Non-reasoning)0.471064814814815Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.469907407407407Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
MiniMax-M2.70.469907407407407Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, High Effort)0.46875Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Qwen3.6 Max Preview0.46875Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.46875Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.467592592592593Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
DeepSeek V4 Flash Vision (Reasoning, Max Effort)0.466435185185185Not recordedNot recorded2026-08-21 · model_announcementArtificial Analysis
o4-mini (high)0.465277777777778Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.46412037037037Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
GLM-5 (Reasoning)0.461805555555556Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.461805555555556Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Inkling (xhigh)0.460648148148148Not recordedNot recorded2026-07-15 · model_announcementArtificial Analysis
GPT-5.6 Luna (medium)0.458333333333333Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 4.6 (Non-reasoning, High Effort)0.457175925925926Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Grok 40.457175925925926Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
GPT-5.6 Luna (low)0.456018518518519Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Solar Open2 250B0.456018518518519Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Reasoning)0.456018518518519Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Qwen3.7 Plus0.454861111111111Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
MiniMax-M30.453703703703704Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.451388888888889Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.449074074074074Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Grok 4.20 0309 (Reasoning)0.446759259259259Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.446759259259259Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3.8 27B (xhigh)0.446759259259259Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Grok 4.3 (medium)0.445601851851852Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GPT-5.6 Terra (Non-reasoning)0.445601851851852Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Motif 3 (Beta)0.443287037037037Not recordedNot recorded2026-07-14 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.44212962962963Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
GPT-5.4 mini (medium)0.44212962962963Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.44212962962963Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, Low Effort)0.440972222222222Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.439814814814815Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.4375Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
GLM-5-Turbo0.436342592592593Not recordedNot recorded2026-03-15 · model_announcementArtificial Analysis
Solar Pro 40.436342592592593Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
Muse Glimmer (high)0.436342592592593Not recordedNot recorded2026-08-10 · model_announcementArtificial Analysis
GLM 5V Turbo (Reasoning)0.435185185185185Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.434027777777778Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GPT-5.1 (high)0.43287037037037Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.43287037037037Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
MiMo-V2.50.430555555555556Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Qwen3 Max Thinking0.430555555555556Not recordedNot recorded2026-01-26 · model_announcementArtificial Analysis
GPT-5 (high)0.429398148148148Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.428240740740741Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.428240740740741Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.427083333333333Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
MiniMax-M2.50.425925925925926Not recordedNot recorded2026-02-12 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.425925925925926Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiMo-V2-Pro0.424768518518519Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Non-reasoning)0.423611111111111Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Kimi K2 Thinking0.423611111111111Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
Ring-2.6-1T0.423611111111111Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.423611111111111Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Agnes 2.5 Pro Alpha0.422453703703704Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.420138888888889Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.420138888888889Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.420138888888889Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.418981481481481Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
Grok 4.3 (low)0.418981481481481Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Nex-N2-Pro0.417824074074074Not recordedNot recorded2026-06-02 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (May' 25)0.415509259259259Not recordedNot recorded2025-05-06 · model_announcementArtificial Analysis
Hy3-preview (Reasoning)0.412037037037037Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Non-reasoning)0.41087962962963Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
GPT-5 (medium)0.41087962962963Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.41087962962963Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Ling 3.0 Flash0.41087962962963Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis
o30.409722222222222Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
K-EXAONE 2.0 08030.409722222222222Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.409722222222222Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.409722222222222Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.4089793103Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Gemini 3.5 Flash-Lite0.408564814814815Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
Claude 4 Opus (Non-reasoning)0.408564814814815Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.408564814814815Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
MiniMax-M2.10.407407407407407Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
Doubao Seed Code0.407407407407407Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3.6 Plus0.407407407407407Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.40625Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Motif 30.40625Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.40625Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Qwen3.5 Omni Plus0.405092592592593Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.405092592592593Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.403935185185185Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-4.1 mini0.403935185185185Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Step 3.5 Flash0.403747266639333Not recordedNot recorded2026-02-02 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.402777777777778Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.402777777777778Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.40162037037037Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Step 3.7 Flash0.400462962962963Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.400462962962963Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.400462962962963Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.399305555555556Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
o3-mini0.399305555555556Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.399305555555556Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.399305555555556Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.399305555555556Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GPT-5.6 Luna (Non-reasoning)0.399305555555556Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.8 27B (low)0.398148148148148Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.398148148148148Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.398148148148148Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
o3-mini (high)0.397856419092825Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.395833333333333Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Kimi K2.5 (Non-reasoning)0.395833333333333Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Mistral Medium 3.50.395833333333333Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Kimi K2.6 (Non-reasoning)0.394675925925926Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.394675925925926Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
MiMo-V2-Omni-03270.394675925925926Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (Mar' 25)0.394675925925926Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.393518518518519Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Hy3-preview (Non-reasoning)0.393518518518519Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.393518518518518Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
GPT-5 mini (high)0.392361111111111Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Magistral Medium 1.20.392361111111111Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.391203703703704Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
INTELLECT-30.391203703703704Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
MiMo-V2.5-Pro (Non-reasoning)0.391203703703704Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GPT-5 (low)0.391203703703704Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.388888888888889Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.388888888888889Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5 (minimal)0.387731481481481Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.387731481481481Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Mercury 20.386574074074074Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.386574074074074Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.386574074074074Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.386574074074074Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Step 3.5 Flash 26030.385416666666667Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
A.X-K20.385416666666667Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.384259259259259Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
GPT-5.4 nano (medium)0.384259259259259Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
MiMo-V2-Flash (Feb 2026)0.383101851851852Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Qwen3 Max0.383101851851852Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GLM-5 (Non-reasoning)0.383101851851852Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
KAT Coder Pro V20.383101851851852Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
North Mini Code0.381944444444444Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
JT-4.1 Flash 236B A21B0.381944444444444Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.381944444444444Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
GPT-4.10.380787037037037Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Qwen3.8 27B (medium)0.380787037037037Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.37962962962963Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Command A+0.378472222222222Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
MiniMax M1 40k0.378472222222222Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.378472222222222Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.377314814814815Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.377314814814815Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.376157407407407Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 32B0.375690607734807Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.375Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.375Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.373842592592593Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
MiniMax M1 80k0.373842592592593Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.372685185185185Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Non-reasoning)0.372685185185185Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.372685185185185Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Non-reasoning)0.372685185185185Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.372685185185185Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Ling-2.6-1T0.37037037037037Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.37037037037037Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.369212962962963Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.369212962962963Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok 30.368055555555556Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.368055555555556Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Qwen3.5 27B (Non-reasoning)0.366898148148148Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
MiMo-V2-Omni0.366898148148148Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Ring-1T0.366898148148148Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.366898148148148Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Claude 3.5 Sonnet (Oct '24)0.365740740740741Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
GPT-4o (March 2025, chatgpt-4o-latest)0.365740740740741Not recordedNot recorded2025-03-27 · model_announcementArtificial Analysis
GPT-5 nano (high)0.365740740740741Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.365740740740741Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.364583333333333Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.364583333333333Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.362268518518519Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Mistral Large 30.362268518518519Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Grok Code Fast 10.362268518518518Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
GLM-5.1 (Non-reasoning)0.361111111111111Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Trinity Large Thinking0.361111111111111Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
GLM-5.2 (Non-reasoning)0.361111111111111Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
MiniMax-M20.361111111111111Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.359953703703704Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.359953703703704Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.359953703703704Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.358796296296296Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Reasoning)0.358796296296296Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.358796296296296Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
o10.357638888888889Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
DeepSeek V3 03240.357638888888889Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.357638888888889Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
QwQ 32B0.357638888888889Not recordedNot recorded2025-03-05 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.357142857142857Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.356481481481482Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.8 27B (Non-reasoning)0.356481481481481Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.356481481481481Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.354166666666667Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
LongCat 2.00.354166666666667Not recordedNot recorded2026-06-29 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.354166666666667Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.354166666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Ling-1T0.351851851851852Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Magistral Small 1.20.351851851851852Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.351851851851852Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.34837962962963Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0.34837962962963Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.34837962962963Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.34837962962963Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.347222222222222Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.346064814814815Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Kimi K20.344907407407407Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.34375Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.34375Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.34375Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.342592592592593Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
DiffusionGemma 26B A4B0.342592592592593Not recordedNot recorded2026-06-10 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.341435185185185Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.340277777777778Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
G9v3-39A5B0.340277777777778Not recordedNot recorded2026-08-20 · model_announcementArtificial Analysis
Gemini 2.0 Flash (experimental)0.340277777777778Not recordedNot recorded2024-12-11 · model_announcementArtificial Analysis
Mistral Medium 3.10.337962962962963Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.337962962962963Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GLM-4.7-Flash (Reasoning)0.336805555555556Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Qwen2.5 Max0.336805555555556Not recordedNot recorded2025-01-28 · model_announcementArtificial Analysis
GPT-4o (ChatGPT)0.334490740740741Not recordedNot recorded2025-02-15 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.333333333333333Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.333333333333333Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.333333333333333Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.333333333333333Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.331597222222222Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Devstral 20.331018518518519Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Mistral Medium 30.331018518518519Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.331018518518519Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
Llama 4 Maverick0.331018518518519Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.331018518518519Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
HyperNova 60B 26050.329861111111111Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
K2 Think V20.329861111111111Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.328703703703704Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Gemini 2.0 Flash Thinking Experimental (Jan '25)0.328621908127208Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Non-reasoning)0.327546296296296Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
o1-mini0.322916666666667Not recordedNot recorded2024-09-12 · model_announcementArtificial Analysis
Qwen3 Coder Next0.322916666666667Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
Grok 4.20 0309 (Non-reasoning)0.321759259259259Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.320601851851852Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
GPT-4 Turbo0.319444444444444Not recordedNot recorded2023-11-06 · model_announcementArtificial Analysis
Nemotron 3.5 Lightning0.315972222222222Not recordedNot recorded2026-08-11 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.315972222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Claude 3.5 Sonnet (June '24)0.315972222222222Not recordedNot recorded2024-06-21 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.314814814814815Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.3125Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Gemini 2.0 Pro Experimental (Feb '25)0.3125Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Step3 VL 10B0.311342592592593Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
GPT-4o (May '24)0.309027777777778Not recordedNot recorded2024-05-13 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.30787037037037Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.306712962962963Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Kimi K2 09050.306712962962963Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
GLM-4.5-Air0.305555555555556Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.305555555555556Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.304398148148148Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.304398148148148Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.302083333333333Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Llama 3.1 Tulu3 405B0.302083333333333Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.300925925925926Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.298611111111111Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.298611111111111Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Gemma 4 12B (Non-reasoning)0.297453703703704Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.297453703703704Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Magistral Medium 10.296875Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.296296296296296Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.296296296296296Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Gemini 1.5 Pro (Sep '24)0.295138888888889Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
Grok Beta0.295138888888889Not recordedNot recorded2024-08-13 · model_announcementArtificial Analysis
Devstral Medium0.293981481481481Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0.292824074074074Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.292824074074074Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.291666666666667Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Pixtral Large0.291666666666667Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
JT-35B-Flash0.290509259259259Not recordedNot recorded2026-05-14 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.290509259259259Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.290509259259259Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Ling-flash-2.00.289351851851852Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.288194444444444Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Devstral Small 20.288194444444444Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.287037037037037Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
K2-V2 (high)0.28587962962963Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Olmo 3 32B Think0.28587962962963Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Grok 2 (Dec '24)0.284722222222222Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.284722222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.284722222222222Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.284722222222222Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.283564814814815Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
LongCat Flash Lite0.283564814814815Not recordedNot recorded2026-01-28 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.282407407407407Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.282407407407407Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
Mistral Small 4 (Non-reasoning)0.28125Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Command A0.28125Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.28125Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.280092592592593Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
Qwen3 32B (Non-reasoning)0.280092592592593Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.278935185185185Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Nova Premier0.278935185185185Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0.277777777777778Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.277777777777778Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
Qwen3.5 9B (Non-reasoning)0.276821658615137Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.27662037037037Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.275462962962963Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.274305555555556Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
Gemini 1.5 Pro (May '24)0.273590716878101Not recordedNot recorded2024-05-15 · model_announcementArtificial Analysis
JT-MINI0.271990740740741Not recordedNot recorded2026-04-15 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.271990740740741Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Non-reasoning)0.271990740740741Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 32B0.270833333333333Not recordedNot recorded2024-11-11 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0.270833333333333Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Ling 2.6 Flash0.270833333333333Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.269675925925926Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Solar Open 100B (Reasoning)0.268518518518519Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Gemini 1.5 Flash (Sep '24)0.267361111111111Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.267361111111111Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.267361111111111Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Reka Flash 30.267361111111111Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Nanbeige4.1-3B0.26598440545809Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Mistral Small 3.10.265046296296296Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.265046296296296Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Small 3.20.263888888888889Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
Sarvam 105B (high)0.263888888888889Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.263888888888889Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.261574074074074Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.260416666666667Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Phi-40.260416666666667Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
GPT-4.1 nano0.259259259259259Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.259259259259259Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Granite 4.1 30B0.258101851851852Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.255787037037037Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Qwen3.5 Omni Flash0.25462962962963Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
GLM-4.7-Flash (Non-reasoning)0.25462962962963Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.252314814814815Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.252314814814815Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
K2-V2 (medium)0.252314814814815Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Feb '25)0.25Not recordedNot recorded2025-02-25 · model_announcementArtificial Analysis
Falcon-H1R-7B0.248842592592593Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.247685185185185Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Preview)0.246527777777778Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Solar Pro 30.246527777777778Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
Devstral Small (May '25)0.24537037037037Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0.244212962962963Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.243055555555556Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Ling 3.0 Tiny0.241898148148148Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
Magistral Small 10.240740740740741Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Mistral Saba0.240740740740741Not recordedNot recorded2025-02-17 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.239583333333333Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Llama 3.2 Instruct 90B (Vision)0.239583333333333Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 14B0.238683127572016Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.238425925925926Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Ministral 3 14B0.236111111111111Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Mistral Small 30.236111111111111Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Non-reasoning)0.232638888888889Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.232638888888889Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Claude 3 Opus0.232638888888889Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Hermes 3 - Llama-3.1 70B0.231481481481481Not recordedNot recorded2024-08-15 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.230324074074074Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen2.5 Instruct 32B0.229166666666667Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Sonar0.229166666666667Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Qwen2 Instruct 72B0.229166666666667Not recordedNot recorded2024-06-07 · model_announcementArtificial Analysis
Gemini 1.5 Flash-8B0.229166666666667Not recordedNot recorded2024-10-03 · model_announcementArtificial Analysis
Claude 3 Sonnet0.229166666666667Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
GPT-4o mini0.229166666666667Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0.229166666666667Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
DeepHermes 3 - Mistral 24B Preview (Non-reasoning)0.228009259259259Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Sonar Pro0.225694444444444Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.225694444444444Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
K2-V2 (low)0.22337962962963Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.221064814814815Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.219907407407407Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.21875Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Granite 4.1 8B0.217592592592593Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.211805555555556Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Olmo 3 7B Think0.211805555555556Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.209490740740741Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Granite 4.0 H Small0.209490740740741Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0.209490740740741Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Nova Pro0.208333333333333Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Mistral Large (Feb '24)0.208333333333333Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Ministral 3 8B0.208333333333333Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Celeris-10.207175925925926Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.203703703703704Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Gemma 4 E2B (Non-reasoning)0.203703703703704Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.199074074074074Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
Claude 2.00.194444444444444Not recordedNot recorded2023-07-11 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.193287037037037Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Sarvam 30B (high)0.19212962962963Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0.188598051724984Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.1875Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Jamba 1.7 Large0.1875Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Mixtral 8x22B Instruct0.1875Not recordedNot recorded2024-04-17 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.186342592592593Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Claude 3 Haiku0.186342592592593Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Jamba 1.6 Large0.184027777777778Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
Claude 2.10.184027777777778Not recordedNot recorded2023-11-21 · model_announcementArtificial Analysis
Qwen3.5 4B (Non-reasoning)0.18287037037037Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Gemini 1.5 Flash (May '24)0.180555555555556Not recordedNot recorded2024-05-14 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.180555555555556Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0.178240740740741Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
Tri-21B-think Preview0.177833202921231Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.177083333333333Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
G9v3-3B0.177083333333333Not recordedNot recorded2026-07-23 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.175925925925926Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.173611111111111Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.173611111111111Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Tri-21B-Think0.173611111111111Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.171296296296296Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Llama 4 Scout0.170138888888889Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Ring-flash-2.00.167824074074074Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.167824074074074Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Olmo 3.1 32B Instruct0.166666666666667Not recordedNot recorded2026-01-13 · model_announcementArtificial Analysis
Qwen3 4B (Non-reasoning)0.166666666666667Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Reasoning)0.164351851851852Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0.164351851851852Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Jamba 1.5 Large0.163194444444444Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
Qwen3.5 4B (Reasoning)0.161011531015357Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Mistral Small (Sep '24)0.15625Not recordedNot recorded2024-09-17 · model_announcementArtificial Analysis
Qwen2.5 Turbo0.152777777777778Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 7B0.148148148148148Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Ministral 3 3B0.143518518518519Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
LFM2.5-2.6B0.142361111111111Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis
Nova Lite0.138888888888889Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
DeepSeek Coder V2 Lite Instruct0.138888888888889Not recordedNot recorded2024-06-17 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.136574074074074Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Ling-mini-2.00.135416666666667Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Mistral Small (Feb '24)0.134259259259259Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Molmo2-8B0.133101851851852Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.131944444444444Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0.119402985074627Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Granite 4.0 Micro0.119212962962963Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Granite 4.1 3B0.119212962962963Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 8B0.118577075098814Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
DBRX Instruct0.118055555555556Not recordedNot recorded2024-03-27 · model_announcementArtificial Analysis
Mistral Medium0.118055555555556Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Llama 2 Chat 13B0.118055555555556Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
Command-R+ (Apr '24)0.118055555555556Not recordedNot recorded2024-04-04 · model_announcementArtificial Analysis
Gemini 1.0 Pro0.116898148148148Not recordedNot recorded2023-12-06 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.112268518518519Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Phi-4 Multimodal Instruct0.109953703703704Not recordedNot recorded2025-02-26 · model_announcementArtificial Analysis
LFM2 24B A2B0.108796296296296Not recordedNot recorded2026-02-25 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.107638888888889Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.103009259259259Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.100694444444444Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.100694444444444Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Jamba 1.6 Mini0.100694444444444Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
Nova Micro0.09375Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.0925925925925926Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.0925925925925926Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)0.0914351851851852Not recordedNot recorded2025-02-13 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0.0902777777777778Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Granite 4.0 1B0.0868055555555556Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct Preview (May '25)0.0856481481481481Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.0821759259259259Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.0810185185185185Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Jamba 1.5 Mini0.0798611111111111Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
OLMo 2 32B0.0798611111111111Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
LFM2.5-8B-A1B0.0775462962962963Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.0740740740740741Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.0729166666666667Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0.0717254663422547Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
LFM 40B0.0706018518518518Not recordedNot recorded2024-09-30 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.0694444444444444Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
LFM2 8B A1B0.068287037037037Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 1.5B0.0662251655629139Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Command-R (Mar '24)0.0625Not recordedNot recorded2024-03-12 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.0590277777777778Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Apertus 70B Instruct0.056712962962963Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.0520833333333333Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.0520833333333333Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
MiniCPM5-1B (Reasoning)0.0439814814814815Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.0428240740740741Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
LFM2.5-1.2B-Thinking0.0416666666666667Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.0405092592592593Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Apertus 8B Instruct0.0405092592592593Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Gemma 4 E4B (Non-reasoning)0.0393518518518519Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
QwQ 32B-Preview0.0381944444444444Not recordedNot recorded2024-11-27 · model_announcementArtificial Analysis
OLMo 2 7B0.037037037037037Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
Tiny Aya Global0.0358796296296296Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Molmo 7B-D0.0358796296296296Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.0347222222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
LFM2.5-VL-1.6B0.0300925925925926Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0.0289351851851852Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Mixtral 8x7B Instruct0.0277777777777778Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.0277777777777778Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0.0277777777777778Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
LFM2 1.2B0.025462962962963Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
LFM2 2.6B0.025462962962963Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Mistral 7B Instruct0.0243055555555556Not recordedNot recorded2023-09-27 · model_announcementArtificial Analysis
LFM2.5-1.2B-Instruct0.0231481481481481Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0.0208333333333333Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0.0173611111111111Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.0173611111111111Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
MiniCPM5-1B (Non-reasoning)0.0138888888888889Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.0127314814814815Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Granite 4.0 350M0.00925925925925926Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.00694444444444444Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Gemma 3 270M0Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Llama 2 Chat 7B0Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis

Put this benchmark in context

Coding benchmarks