AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

LiveCodeBench

Coding

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2024-03-12
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 343

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemini 3 Pro Preview (high)0.917460317460317Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.907936507936508Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.896296296296296Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.894179894179894Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.894179894179894Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.888888888888889Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.878306878306878Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.870899470899471Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
GPT-5.1 (high)0.867724867724868Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.867724867724868Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.862433862433862Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
o4-mini (high)0.859259259259259Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.857142857142857Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Kimi K2 Thinking0.852910052910053Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.848677248677249Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
GPT-5 (high)0.845502645502646Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.84021164021164Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
GPT-5 mini (high)0.838095238095238Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.835978835978836Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.831746031746032Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
MiniMax-M20.826455026455027Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.822222222222222Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Grok 40.819047619047619Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.811640211640211Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
MiniMax-M2.10.80952380952381Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
o30.808465608465608Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.807407407407407Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.801058201058201Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.797883597883598Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.796825396825397Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.789417989417989Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
GPT-5 nano (high)0.789417989417989Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.788359788359788Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.784126984126984Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.784126984126984Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (Mar' 25)0.777777777777778Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
INTELLECT-30.776719576719577Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.776719576719577Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (May' 25)0.77037037037037Not recordedNot recorded2025-05-06 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.77037037037037Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.768253968253968Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Qwen3 Max0.767195767195767Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Doubao Seed Code0.766137566137566Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.765079365079365Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
GPT-5 (low)0.762962962962963Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.762962962962963Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Magistral Medium 1.20.75026455026455Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.747089947089947Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.747089947089947Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.740740740740741Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.737566137566138Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.737566137566138Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.737566137566138Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.736507936507937Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
o3-mini (high)0.734391534391534Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.73015873015873Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.728042328042328Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Falcon-H1R-7B0.723809523809524Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.723809523809524Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Magistral Small 1.20.722751322751323Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
o3-mini0.717460317460317Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.714285714285714Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.713227513227513Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.711111111111111Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
MiniMax M1 80k0.711111111111111Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.706878306878307Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.706878306878307Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5 (medium)0.702645502645503Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.700529100529101Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.697354497354497Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.696296296296296Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.695238095238095Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0.695238095238095Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.695238095238095Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.694179894179894Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
K2-V2 (high)0.694179894179894Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.692063492063492Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.687830687830688Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.687830687830688Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.685714285714286Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.683597883597884Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
GLM-4.5-Air0.683597883597884Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
o10.679365079365079Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.679365079365079Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Ling-1T0.677248677248677Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Olmo 3 32B Think0.671957671957672Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.668783068783069Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.663492063492063Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.66031746031746Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
MiniMax M1 40k0.657142857142857Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Grok Code Fast 10.657142857142857Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.656084656084656Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.655026455026455Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.6535448276Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.652910052910053Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.651851851851852Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.650793650793651Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.650793650793651Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.645502645502645Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Ring-1T0.643386243386243Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.641269841269841Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.641269841269841Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.641269841269841Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.638095238095238Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.635978835978836Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
QwQ 32B0.630687830687831Not recordedNot recorded2025-03-05 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.628571428571429Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
Ring-flash-2.00.627513227513227Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.625396825396825Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.622222222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.616931216931217Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Olmo 3 7B Think0.616931216931217Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.615873015873016Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.614814814814815Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Kimi K2 09050.60952380952381Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.604232804232804Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.593650793650794Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.592592592592593Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.592592592592593Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.591534391534391Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.59047619047619Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Ling-flash-2.00.58941798941799Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.585185185185185Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.576719576719577Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
o1-mini0.575661375661376Not recordedNot recorded2024-09-12 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.575661375661376Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.561904761904762Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.560846560846561Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
GPT-5 (minimal)0.557671957671958Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Kimi K20.555555555555556Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.554497354497354Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.546031746031746Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.546031746031746Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.544973544973545Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.542857142857143Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Claude 4 Opus (Non-reasoning)0.541798941798942Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
K2-V2 (medium)0.540740740740741Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.535449735449735Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.529100529100529Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Magistral Medium 10.526984126984127Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.523809523809524Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.522751322751323Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.516402116402116Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.515343915343915Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Magistral Small 10.514285714285714Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.514285714285714Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.513227513227513Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.511111111111111Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.505820105820106Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Reasoning)0.504761904761905Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.495238095238095Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.494179894179894Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.493121693121693Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-4.1 mini0.482539682539683Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.476190476190476Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.473015873015873Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.473015873015873Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.471957671957672Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.46984126984127Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.468783068783069Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.466666666666667Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.464550264550264Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Large 30.464550264550264Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Reasoning)0.462433862433862Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-4.10.457142857142857Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.448677248677249Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Devstral 20.447619047619048Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Reka Flash 30.434920634920635Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Ling-mini-2.00.428571428571429Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Grok 30.425396825396825Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
GPT-4o (March 2025, chatgpt-4o-latest)0.425396825396825Not recordedNot recorded2025-03-27 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.424338624338624Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.422222222222222Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.410582010582011Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Mistral Medium 3.10.406349206349206Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Non-reasoning)0.406349206349206Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.406349206349206Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek V3 03240.405291005291005Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.403174603174603Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.402116402116402Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.401058201058201Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.4Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Mistral Medium 30.4Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.398941798941799Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
Llama 4 Maverick0.396825396825397Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.393650793650794Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
K2-V2 (low)0.392592592592593Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Non-reasoning)0.385185185185185Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Claude 3.5 Sonnet (Oct '24)0.380952380952381Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.377777777777778Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.376719576719577Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 14B0.375661375661376Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.35978835978836Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.358730158730159Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
Qwen2.5 Max0.358730158730159Not recordedNot recorded2025-01-28 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.353439153439153Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.352380952380952Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Ministral 3 14B0.351322751322751Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Devstral Small 20.348148148148148Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Gemini 2.0 Pro Experimental (Feb '25)0.347089947089947Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.346031746031746Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.344973544973545Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.342857142857143Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
QwQ 32B-Preview0.336507936507937Not recordedNot recorded2024-11-27 · model_announcementArtificial Analysis
Devstral Medium0.336507936507937Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.334391534391534Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
GPT-4o (May '24)0.334391534391534Not recordedNot recorded2024-05-13 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.332275132275132Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
GPT-4.1 nano0.325925925925926Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.321693121693122Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemini 2.0 Flash Thinking Experimental (Jan '25)0.320634920634921Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.31957671957672Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.317460317460317Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
Nova Premier0.317460317460317Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
Gemini 1.5 Pro (Sep '24)0.316402116402116Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.314285714285714Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.308994708994709Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.307936507936508Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.304761904761905Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.304761904761905Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Ministral 3 8B0.302645502645503Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Llama 4 Scout0.299470899470899Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 32B0.295238095238095Not recordedNot recorded2024-11-11 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0.295238095238095Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
Sonar0.295238095238095Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.293121693121693Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.293121693121693Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
GPT-4 Turbo0.291005291005291Not recordedNot recorded2023-11-06 · model_announcementArtificial Analysis
Llama 3.1 Tulu3 405B0.291005291005291Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.28994708994709Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.28994708994709Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.287830687830688Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Qwen3 32B (Non-reasoning)0.287830687830688Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Command A0.286772486772487Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0.28042328042328Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.28042328042328Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Claude 3 Opus0.279365079365079Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.277248677248677Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.276190476190476Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Sonar Pro0.275132275132275Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Mistral Small 3.20.275132275132275Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
Gemini 1.5 Flash (Sep '24)0.273015873015873Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 32B0.26984126984127Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.268783068783069Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0.266666666666667Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Grok 2 (Dec '24)0.266666666666667Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.265608465608466Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.265608465608466Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Pixtral Large0.261375661375661Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Devstral Small (May '25)0.258201058201058Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.253968253968254Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Mistral Small 30.251851851851852Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Granite 4.0 H Small0.250793650793651Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen2.5 Instruct 32B0.247619047619048Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Ministral 3 3B0.246560846560847Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Gemini 1.5 Pro (May '24)0.244444444444444Not recordedNot recorded2024-05-15 · model_announcementArtificial Analysis
Grok Beta0.241269841269841Not recordedNot recorded2024-08-13 · model_announcementArtificial Analysis
GPT-4o mini0.233862433862434Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 8B0.232804232804233Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Nova Pro0.232804232804233Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Qwen3 4B (Non-reasoning)0.232804232804233Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.231746031746032Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Phi-40.230687830687831Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
Gemini 1.5 Flash-8B0.216931216931217Not recordedNot recorded2024-10-03 · model_announcementArtificial Analysis
Llama 3.2 Instruct 90B (Vision)0.213756613756614Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Mistral Small 3.10.211640211640212Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.20952380952381Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Gemini 2.0 Flash (experimental)0.20952380952381Not recordedNot recorded2024-12-11 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.202116402116402Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0.197883597883598Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Gemini 1.5 Flash (May '24)0.195767195767196Not recordedNot recorded2024-05-14 · model_announcementArtificial Analysis
Claude 2.10.194708994708995Not recordedNot recorded2023-11-21 · model_announcementArtificial Analysis
DeepHermes 3 - Mistral 24B Preview (Non-reasoning)0.194708994708995Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Hermes 3 - Llama-3.1 70B0.188359788359788Not recordedNot recorded2024-08-15 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Feb '25)0.185185185185185Not recordedNot recorded2025-02-25 · model_announcementArtificial Analysis
Jamba 1.7 Large0.180952380952381Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Granite 4.0 Micro0.17989417989418Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Preview)0.178835978835979Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Mistral Large (Feb '24)0.177777777777778Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Claude 3 Sonnet0.174603174603175Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Jamba 1.6 Large0.172486772486772Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
Claude 2.00.171428571428571Not recordedNot recorded2023-07-11 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.169312169312169Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Nova Lite0.167195767195767Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Qwen2.5 Turbo0.162962962962963Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.15978835978836Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Qwen2 Instruct 72B0.158730158730159Not recordedNot recorded2024-06-07 · model_announcementArtificial Analysis
DeepSeek Coder V2 Lite Instruct0.157671957671958Not recordedNot recorded2024-06-17 · model_announcementArtificial Analysis
Claude 3 Haiku0.154497354497354Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
LFM2 8B A1B0.151322751322751Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
Mixtral 8x22B Instruct0.148148148148148Not recordedNot recorded2024-04-17 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.146031746031746Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Jamba 1.5 Large0.142857142857143Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
Mistral Small (Sep '24)0.140740740740741Not recordedNot recorded2024-09-17 · model_announcementArtificial Analysis
Nova Micro0.13968253968254Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct Preview (May '25)0.137566137566138Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.136507936507936Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.136507936507936Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Phi-4 Multimodal Instruct0.131216931216931Not recordedNot recorded2025-02-26 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.126984126984127Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.125925925925926Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.125925925925926Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 7B0.125925925925926Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Command-R+ (Apr '24)0.121693121693122Not recordedNot recorded2024-04-04 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.120634920634921Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.116402116402116Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Gemini 1.0 Pro0.116402116402116Not recordedNot recorded2023-12-06 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0.116402116402116Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.115343915343915Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
OpenChat 3.5 (1210)0.115343915343915Not recordedNot recorded2023-12-18 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.112169312169312Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Mistral Small (Feb '24)0.111111111111111Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.11005291005291Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Claude Instant0.108994708994709Not recordedNot recorded2023-03-14 · model_announcementArtificial Analysis
Mistral Medium0.0994708994708995Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Llama 2 Chat 70B0.0984126984126984Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
Llama 2 Chat 13B0.0984126984126984Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
LFM 40B0.0962962962962963Not recordedNot recorded2024-09-30 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0.0962962962962963Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.0952380952380952Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
DBRX Instruct0.0931216931216931Not recordedNot recorded2024-03-27 · model_announcementArtificial Analysis
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)0.0846560846560847Not recordedNot recorded2025-02-13 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.0825396825396825Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
LFM2 2.6B0.0814814814814815Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.073015873015873Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Jamba 1.6 Mini0.0708994708994709Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 1.5B0.0698412698412698Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
OLMo 2 32B0.0677248677248677Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Mixtral 8x7B Instruct0.0656084656084656Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Jamba 1.5 Mini0.0624338624338624Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.0613756613756614Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Command-R (Mar '24)0.0476190476190476Not recordedNot recorded2024-03-12 · model_announcementArtificial Analysis
Granite 4.0 1B0.0465608465608466Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Mistral 7B Instruct0.0455026455026455Not recordedNot recorded2023-09-27 · model_announcementArtificial Analysis
OLMo 2 7B0.0412698412698413Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
Molmo 7B-D0.0391534391534391Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 350M0.0243386243386243Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
LFM2 1.2B0.0201058201058201Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0.019047619047619Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.019047619047619Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.0169312169312169Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Gemma 3 270M0.00317460317460317Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
Llama 2 Chat 7B0.00211640211640212Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis

Put this benchmark in context

Coding benchmarks