AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

GDPval-AA v2 (normalized score)

Agentic real-world work tasks

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2026-06-15
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 213

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Opus 5 (Adaptive Reasoning, Max Effort)0.667335Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)0.655505Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GLM-5.3 (max)0.63293Not recordedNot recorded2026-08-18 · model_announcementArtificial Analysis
Grok 4.6 (xhigh)0.630635Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 4.6 (high)0.62088Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 4.6 (medium)0.619775Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.6154149999999999Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Qwen3.8 Max0.61501Not recordedNot recorded2026-08-03 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, High Effort)0.612855Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Qwen3.8 2.4T A95B0.6084550000000001Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.608Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Kimi K3 (max)0.58761Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.587545Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DeepSeek V4 Flash Vision (Reasoning, Max Effort)0.5874400000000001Not recordedNot recorded2026-08-21 · model_announcementArtificial Analysis
Muse Spark 1.2 (xhigh)0.561315Not recordedNot recorded2026-08-05 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.5585549999999999Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Medium Effort)0.557905Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)0.5463150000000001Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)0.542875Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.5409700000000001Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-5.6 Luna (max)0.538695Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.5365650000000001Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.536045Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DeepSeek V4 Flash 0731 (Reasoning, Max Effort)0.52926Not recordedNot recorded2026-07-31 · model_announcementArtificial Analysis
Grok 4.6 (low)0.5261950000000001Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.52373Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.8 27B (xhigh)0.520615Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Gemini 3.7 Flash (high)0.513555Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.6 Luna (xhigh)0.51216Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.8 27B (medium)0.5094500000000001Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Grok 4.5 (high)0.509185Not recordedNot recorded2026-07-08 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.504745Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GLM-5.2 (max)0.5025599999999999Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Xhigh Effort)0.49853499999999995Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Gemini 3.7 Flash (medium)0.49813Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Qwen3.8 27B (low)0.49455499999999997Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.49428999999999995Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.49295500000000003Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.6 Luna (high)0.4825Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GPT-5.5 (high)0.48202Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Low Effort)0.47753999999999996Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Gemini 3.7 Flash (low)0.47620500000000004Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.47133500000000006Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemini 3.6 Flash (high)0.459545Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
GPT-5.6 Terra (medium)0.45310500000000004Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, High Effort)0.45042499999999996Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
GLM-5.2 (Non-reasoning)0.446735Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.445895Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
MiniMax-M30.44215999999999994Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5.6 Sol (Non-reasoning)0.44018499999999994Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Muse Spark 1.1 (xhigh)0.437485Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.43690999999999997Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.43679499999999993Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Sonnet 5 (Non-reasoning, High Effort)0.43392499999999995Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.42066999999999993Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.40145500000000006Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Medium Effort)0.40048500000000004Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.39572500000000005Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Solar Pro 40.38665999999999995Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
GPT-5.6 Luna (medium)0.386395Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Kimi K3 (low)0.386255Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
Motif 30.38611Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Inkling Small0.38433000000000006Not recordedNot recorded2026-07-30 · model_announcementArtificial Analysis
Qwen3.7 Max0.38408000000000003Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
G9v3-39A5B0.38261Not recordedNot recorded2026-08-20 · model_announcementArtificial Analysis
JT-4.1 Flash 236B A21B0.38244000000000006Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.38204499999999997Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.3785Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.37816999999999995Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Motif 3 (Beta)0.37727499999999997Not recordedNot recorded2026-07-14 · model_announcementArtificial Analysis
Nex-N2-Pro0.37510000000000004Not recordedNot recorded2026-06-02 · model_announcementArtificial Analysis
GPT-5.6 Terra (Non-reasoning)0.372105Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Inkling (xhigh)0.36819500000000005Not recordedNot recorded2026-07-15 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Low Effort)0.35958500000000004Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Grok Build 0.1 06160.35685Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
Hy30.35671Not recordedNot recorded2026-07-06 · model_announcementArtificial Analysis
Qwen3.8 27B (Non-reasoning)0.35547Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Kimi K2.60.34571Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.344985Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Kimi K2.7 Code0.34426Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
GPT-5.5 (low)0.34319500000000003Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Agnes 2.5 Pro Alpha0.33558000000000004Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.33486Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.33391999999999994Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.33105499999999993Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
MiniMax-M2.70.3296Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
GPT-5.6 Luna (low)0.3275Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.327265Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
MiMo-V2.50.325085Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Muse Spark0.323495Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
Gemini 3.5 Flash-Lite0.320005Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.31992999999999994Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Qwen3.6 Plus0.31956500000000004Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.312395Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Solar Open2 250B0.31187Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
A.X-K20.30672000000000005Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.30503499999999995Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Ling 3.0 Flash0.3026849999999999Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.30229999999999996Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.29920500000000005Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Grok 4.3 (high)0.294135Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
GPT-5 (high)0.292495Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5.6 Luna (Non-reasoning)0.28702999999999995Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.27821Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.27790499999999996Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
LongCat 2.00.26555999999999996Not recordedNot recorded2026-06-29 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.259945Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Step 3.7 Flash0.25978500000000004Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.25382499999999997Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
GPT-5.1 (high)0.24779Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.243445Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
K-EXAONE 2.0 08030.239545Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.23269Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.23227499999999998Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
Muse Glimmer (high)0.22797000000000003Not recordedNot recorded2026-08-10 · model_announcementArtificial Analysis
Qwen3.7 Plus0.22315Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5 mini (high)0.21994Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.21716500000000002Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Mistral Medium 3.50.216635Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Ring-2.6-1T0.211425Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.206815Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
KAT Coder Pro V20.20349Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.20285000000000003Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.19697000000000003Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.191365Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.18704Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.18251499999999998Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
G9v3-3B0.18170499999999998Not recordedNot recorded2026-07-23 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.17089999999999997Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Nemotron 3.5 Lightning0.16306Not recordedNot recorded2026-08-11 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.15543Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.14985Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.14958Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.1455Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Ling 3.0 Tiny0.13713499999999998Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.13369Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.12355500000000001Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Devstral 20.12094999999999999Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.11845999999999998Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Devstral Small 20.11689499999999999Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Qwen3 Coder Next0.10877999999999997Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
GPT-5.5 Instant (June 2026)0.10804500000000002Not recordedNot recorded2026-06-25 · model_announcementArtificial Analysis
Command A+0.10687999999999999Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
Mercury 20.09931999999999999Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.09931999999999999Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.09093000000000001Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.090755Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.08522500000000002Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
HyperNova 60B 26050.07888999999999999Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.07697500000000003Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.07366500000000002Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.07189499999999999Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.07187Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Mistral Large 30.07026999999999999Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Mistral Medium 3.10.054050000000000015Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Mistral Small 3.10.05155000000000001Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.04479000000000002Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.04431999999999999Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.044Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.03283999999999997Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Trinity Large Thinking0.031255Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.03089499999999998Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
DiffusionGemma 26B A4B0.026625Not recordedNot recorded2026-06-10 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.02341500000000002Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Ling 2.6 Flash0.022444999999999993Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
North Mini Code0.02110000000000002Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
Celeris-10.017845000000000028Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.014995000000000005Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
GPT-4.1 mini0.0031200000000000047Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Claude 3.5 Haiku0Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
o3-mini (high)0Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
Mistral Small 3.20Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
K2 Think V20Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Ministral 3 3B0Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
GPT-40Not recordedNot recorded2023-03-14 · model_announcementArtificial Analysis
Magistral Small 1.20Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Ministral 3 14B0Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
GPT-4.1 nano0Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
DeepSeek V3 03240Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Nanbeige4.1-3B0Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Magistral Medium 1.20Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Granite 4.1 3B0Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Llama 4 Maverick0Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Ministral 3 8B0Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Llama 4 Scout0Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GPT-4o mini0Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
Solar Pro 30Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
gpt-oss-120b (low)0Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Granite 4.1 30B0Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
LFM2.5-2.6B0Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis

Put this benchmark in context

Tools and agents benchmarks