AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

Artificial Analysis

GPQA Diamond

Scientific reasoning

Evaluation context and evidence

Source
Artificial Analysis
Publisher
Not recorded
Benchmark release
2023-11-20
Collected
2026-08-25
Modality
Not recorded

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 586

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Grok 4.6 (high)0.94949494949495Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Gemini 3.7 Flash (high)0.945454545454545Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Gemini 3.1 Pro Preview0.941414141414141Not recordedNot recorded2026-02-19 · model_announcementArtificial Analysis
GPT-5.6 Sol (max)0.941414141414141Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Xhigh Effort)0.937373737373737Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, High Effort)0.937373737373737Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.5 (xhigh)0.935353535353535Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Grok 4.6 (medium)0.935353535353535Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Qwen3.8 2.4T A95B0.935353535353535Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 4.6 (xhigh)0.935353535353535Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Kimi K3 (max)0.935353535353535Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
GPT-5.5 (high)0.932323232323232Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Max Effort)0.932323232323232Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Grok 4.5 (high)0.931313131313131Not recordedNot recorded2026-07-08 · model_announcementArtificial Analysis
GPT-5.6 Sol (xhigh)0.931313131313131Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
MiniMax-M30.929292929292929Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
Gemini 3.6 Flash (high)0.928282828282828Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
DeepSeek V4 Pro 0813 (Reasoning, Max Effort)0.928282828282828Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
GPT-5.6 Sol (high)0.928282828282828Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.8 Max0.927272727272727Not recordedNot recorded2026-08-03 · model_announcementArtificial Analysis
GPT-5.5 (medium)0.926262626262626Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GPT-5.6 Sol (medium)0.926262626262626Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback)0.926262626262626Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
GPT-5.6 Terra (max)0.925252525252525Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3.7 Max0.923232323232323Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Gemini 3.5 Flash (high)0.922222222222222Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Gemini 3.5 Flash (medium)0.921212121212121Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
Gemini 3.7 Flash (medium)0.921212121212121Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Claude Opus 4.8 (Adaptive Reasoning, Max Effort)0.92020202020202Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-5.4 (xhigh)0.92020202020202Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Medium Effort)0.919191919191919Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GLM-5.3 (max)0.917171717171717Not recordedNot recorded2026-08-18 · model_announcementArtificial Analysis
GPT-5.3 Codex (xhigh)0.915151515151515Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
Claude Opus 4.7 (Adaptive Reasoning, Max Effort)0.914141414141414Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
DeepSeek V4 Flash Vision (Reasoning, Max Effort)0.913131313131313Not recordedNot recorded2026-08-21 · model_announcementArtificial Analysis
Kimi K2.60.911111111111111Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Claude Sonnet 5 (Adaptive Reasoning, Max Effort)0.911111111111111Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
GPT-5.6 Luna (max)0.911111111111111Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Reasoning)0.911111111111111Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
GPT-5.5 (low)0.91010101010101Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
GPT-5.6 Terra (xhigh)0.908080808080808Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (high)0.908080808080808Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
DeepSeek V4 Flash 0731 (Reasoning, Max Effort)0.908080808080808Not recordedNot recorded2026-07-31 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, High Effort)0.905050505050505Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Qwen3.8 27B (xhigh)0.905050505050505Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Muse Spark 1.2 (xhigh)0.904040404040404Not recordedNot recorded2026-08-05 · model_announcementArtificial Analysis
GPT-5.2 (xhigh)0.903030303030303Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Grok 4.3 (high)0.901010101010101Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Gemini 3.7 Flash (low)0.901010101010101Not recordedNot recorded2026-08-13 · model_announcementArtificial Analysis
Qwen3.7 Plus0.9Not recordedNot recorded2026-06-01 · model_announcementArtificial Analysis
GPT-5.2 Codex (xhigh)0.898989898989899Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
GPT-5.6 Sol (low)0.897979797979798Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Reasoning)0.897979797979798Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Muse Spark 1.1 (xhigh)0.897979797979798Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Hy30.896969696969697Not recordedNot recorded2026-07-06 · model_announcementArtificial Analysis
Claude Opus 4.6 (Adaptive Reasoning, Max Effort)0.895959595959596Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
GPT-5.6 Terra (high)0.895959595959596Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Kimi K2.7 Code0.895959595959596Not recordedNot recorded2026-06-12 · model_announcementArtificial Analysis
Grok Build 0.1 06160.894949494949495Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
Inkling Small0.894949494949495Not recordedNot recorded2026-07-30 · model_announcementArtificial Analysis
GPT-5.6 Luna (xhigh)0.894949494949495Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GLM-5.2 (max)0.894949494949495Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, Max Effort)0.893939393939394Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Reasoning)0.892929292929293Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Nex-N2-Pro0.891919191919192Not recordedNot recorded2026-06-02 · model_announcementArtificial Analysis
GPT-5.6 Luna (high)0.891919191919192Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Solar Pro 40.890909090909091Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
Grok 4.3 (medium)0.88989898989899Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Claude Opus 5 (Adaptive Reasoning, Low Effort)0.888888888888889Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
Qwen3.6 Max Preview0.887878787878788Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Reasoning, Max Effort)0.887878787878788Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemini 3 Pro Preview (low)0.886868686868687Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Grok 4.20 0309 (Reasoning)0.884848484848485Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
Claude Opus 4.7 (Non-reasoning, High Effort)0.884848484848485Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Muse Spark0.883838383838384Not recordedNot recorded2026-04-08 · model_announcementArtificial Analysis
Qwen3.6 Plus0.881818181818182Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Kimi K2.5 (Reasoning)0.878787878787879Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Grok 4.6 (low)0.878787878787879Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Grok 40.876767676767677Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Agnes 2.5 Pro Alpha0.875757575757576Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
GPT-5.4 mini (xhigh)0.874747474747475Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Adaptive Reasoning, Max Effort)0.874747474747475Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
MiniMax-M2.70.873737373737374Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
GPT-5.1 (high)0.872727272727273Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Inkling (xhigh)0.871717171717172Not recordedNot recorded2026-07-15 · model_announcementArtificial Analysis
GPT-5.6 Terra (medium)0.871717171717172Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
DeepSeek V3.2 Speciale0.870707070707071Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GPT-5.4 (low)0.870707070707071Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
MiMo-V2-Pro0.86969696969697Not recordedNot recorded2026-03-18 · model_announcementArtificial Analysis
Motif 3 (Beta)0.868686868686869Not recordedNot recorded2026-07-14 · model_announcementArtificial Analysis
GLM-5.1 (Reasoning)0.867676767676768Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Nemotron 3 Ultra 550B A55B (Reasoning)0.866666666666667Not recordedNot recorded2026-06-04 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Reasoning, High Effort)0.866666666666667Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Hy3-preview (Reasoning)0.866666666666667Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
MiMo-V2.5-Pro0.865656565656566Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Claude Opus 4.5 (Reasoning)0.865656565656566Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
GPT-5.2 (medium)0.863636363636364Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3.5 397B A17B (Non-reasoning)0.860606060606061Not recordedNot recorded2026-02-16 · model_announcementArtificial Analysis
Qwen3 Max Thinking0.860606060606061Not recordedNot recorded2026-01-26 · model_announcementArtificial Analysis
GPT-5.1 Codex (high)0.85959595959596Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
GPT-5.6 Luna (medium)0.858585858585859Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
GLM-4.7 (Reasoning)0.858585858585858Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
Qwen3.5 27B (Reasoning)0.857575757575758Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Reasoning)0.856565656565657Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Solar Open2 250B0.856565656565657Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
A.X-K20.856565656565657Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Gemma 4 31B (Reasoning)0.856565656565657Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Ring-2.6-1T0.856565656565657Not recordedNot recorded2026-05-08 · model_announcementArtificial Analysis
MiMo-V2-Omni-03270.854545454545455Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
Ling 3.0 Flash0.854545454545454Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis
KAT Coder Pro V20.854545454545454Not recordedNot recorded2026-03-27 · model_announcementArtificial Analysis
GPT-5 (high)0.853535353535353Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Grok 4.1 Fast (Reasoning)0.852525252525253Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
MiMo-V2.50.84949494949495Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Nanbeige4.1-3B0.84949494949495Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
MiniMax-M2.50.848484848484848Not recordedNot recorded2026-02-12 · model_announcementArtificial Analysis
GLM-5-Turbo0.847474747474747Not recordedNot recorded2026-03-15 · model_announcementArtificial Analysis
Grok 4 Fast (Reasoning)0.847474747474747Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
MiMo-V2-Flash (Reasoning)0.846464646464647Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
GPT-5.5 Instant (May 2026)0.846464646464646Not recordedNot recorded2026-05-05 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Reasoning)0.845454545454545Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.8 27B (medium)0.845454545454545Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Qwen3.8 27B (low)0.845454545454545Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
JT-4.1 Flash 236B A21B0.845454545454545Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
o3-pro0.845454545454545Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Gemini 2.5 Pro0.844444444444444Not recordedNot recorded2025-06-05 · model_announcementArtificial Analysis
GPT-5.6 Terra (low)0.843434343434343Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Grok 4.3 (low)0.843434343434343Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Qwen3.5 27B (Non-reasoning)0.842424242424242Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Kimi K3 (low)0.842424242424242Not recordedNot recorded2026-07-16 · model_announcementArtificial Analysis
Qwen3.6 27B (Reasoning)0.842424242424242Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
GPT-5 (medium)0.841750841750842Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Reasoning)0.841414141414142Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
Claude Opus 4.6 (Non-reasoning, High Effort)0.84040404040404Not recordedNot recorded2026-02-05 · model_announcementArtificial Analysis
DeepSeek V3.2 (Reasoning)0.84040404040404Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
GLM-5.1 (Non-reasoning)0.839393939393939Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Gemini 3.5 Flash-Lite0.838383838383838Not recordedNot recorded2026-07-21 · model_announcementArtificial Analysis
Kimi K2 Thinking0.838383838383838Not recordedNot recorded2025-11-06 · model_announcementArtificial Analysis
GPT-5 Codex (high)0.837373737373737Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (Mar' 25)0.836363636363636Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
GPT-5.6 Luna (low)0.835353535353535Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
MiMo-V2-Flash (Feb 2026)0.835353535353535Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Muse Glimmer (high)0.835353535353535Not recordedNot recorded2026-08-10 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Reasoning)0.834343434343434Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Motif 30.834343434343434Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Step 3.5 Flash0.831313131313131Not recordedNot recorded2026-02-02 · model_announcementArtificial Analysis
MiniMax-M2.10.83030303030303Not recordedNot recorded2025-12-23 · model_announcementArtificial Analysis
JT-35B-Flash0.829292929292929Not recordedNot recorded2026-05-14 · model_announcementArtificial Analysis
K-EXAONE 2.0 08030.829292929292929Not recordedNot recorded2026-08-12 · model_announcementArtificial Analysis
Qwen3.6 27B (Non-reasoning)0.829292929292929Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Gemini 3.5 Flash (minimal)0.828282828282828Not recordedNot recorded2026-05-19 · model_announcementArtificial Analysis
GPT-5 mini (high)0.828282828282828Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
MiMo-V2-Omni0.828282828282828Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
Qwen3.5 122B A10B (Non-reasoning)0.827272727272727Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
o30.827272727272727Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Qwen3.5 Omni Plus0.826262626262626Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
Step 3.5 Flash 26030.826262626262626Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
GPT-5.4 mini (medium)0.823232323232323Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
GPT-5.5 Instant (June 2026)0.823232323232323Not recordedNot recorded2026-06-25 · model_announcementArtificial Analysis
Gemini 2.5 Pro Preview (May' 25)0.822222222222222Not recordedNot recorded2025-05-06 · model_announcementArtificial Analysis
Gemini 3.1 Flash-Lite0.822222222222222Not recordedNot recorded2026-03-03 · model_announcementArtificial Analysis
GLM-5 (Reasoning)0.82020202020202Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
Qwen3.5 35B A3B (Non-reasoning)0.819191919191919Not recordedNot recorded2026-02-24 · model_announcementArtificial Analysis
Qwen3.8 27B (Non-reasoning)0.818181818181818Not recordedNot recorded2026-08-14 · model_announcementArtificial Analysis
Qwen3.6 35B A3B (Non-reasoning)0.817171717171717Not recordedNot recorded2026-04-16 · model_announcementArtificial Analysis
GPT-5.4 nano (xhigh)0.817171717171717Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
DeepSeek R1 0528 (May '25)0.813131313131313Not recordedNot recorded2025-05-28 · model_announcementArtificial Analysis
GPT-5.1 Codex mini (high)0.813131313131313Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Gemini 3 Flash Preview (Non-reasoning)0.812121212121212Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Nova 2.0 Lite (high)0.811111111111111Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
ERNIE 4.5 300B A47B0.811111111111111Not recordedNot recorded2025-06-30 · model_announcementArtificial Analysis
Claude Opus 4.5 (Non-reasoning)0.81010101010101Not recordedNot recorded2025-11-24 · model_announcementArtificial Analysis
GLM 5V Turbo (Reasoning)0.809090909090909Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
Step 3.7 Flash0.809090909090909Not recordedNot recorded2026-05-29 · model_announcementArtificial Analysis
Claude 4.1 Opus (Reasoning)0.809Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5 (low)0.808080808080808Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Qwen3.5 9B (Reasoning)0.806060606060606Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
G9v3-39A5B0.805050505050505Not recordedNot recorded2026-08-20 · model_announcementArtificial Analysis
GPT-5 mini (medium)0.803030303030303Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Nemotron 3 Super 120B A12B (Reasoning)0.8Not recordedNot recorded2026-03-11 · model_announcementArtificial Analysis
Claude Sonnet 5 (Non-reasoning, High Effort)0.8Not recordedNot recorded2026-06-30 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, High Effort)0.798989898989899Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Reasoning)0.796969696969697Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Claude Sonnet 4.6 (Non-reasoning, Low Effort)0.796969696969697Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
Claude 4 Opus (Reasoning)0.795959595959596Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
EXAONE 4.5 33B0.793939393939394Not recordedNot recorded2026-04-09 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Reasoning)0.792929292929293Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Reasoning)0.791919191919192Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Reasoning)0.791919191919192Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Grok 3 mini Reasoning (high)0.790909090909091Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Reasoning)0.78989898989899Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-5.6 Sol (Non-reasoning)0.78989898989899Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 (Reasoning)0.78989898989899Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Kimi K2.5 (Non-reasoning)0.788888888888889Not recordedNot recorded2026-01-27 · model_announcementArtificial Analysis
Kimi K2.6 (Non-reasoning)0.787878787878788Not recordedNot recorded2026-04-20 · model_announcementArtificial Analysis
Qwen3.5 9B (Non-reasoning)0.785858585858586Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (medium)0.784848484848485Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Grok 4.20 0309 (Non-reasoning)0.784848484848485Not recordedNot recorded2026-03-10 · model_announcementArtificial Analysis
o4-mini (high)0.783838383838384Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
K-EXAONE (Reasoning)0.782828282828283Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
GLM-4.5 (Reasoning)0.781818181818182Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
gpt-oss-120b (high)0.781818181818182Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
LongCat 2.00.77979797979798Not recordedNot recorded2026-06-29 · model_announcementArtificial Analysis
GLM-4.6 (Reasoning)0.77979797979798Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
DeepSeek V3.1 (Reasoning)0.778787878787879Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
ERNIE 5.0 Thinking Preview0.776767676767677Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Claude 4 Sonnet (Reasoning)0.776767676767677Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
MiniMax-M20.776767676767677Not recordedNot recorded2025-10-26 · model_announcementArtificial Analysis
Grok 4.20 0309 v2 (Non-reasoning)0.775757575757576Not recordedNot recorded2026-04-07 · model_announcementArtificial Analysis
Qwen3 Max Thinking (Preview)0.775757575757576Not recordedNot recorded2025-11-03 · model_announcementArtificial Analysis
Ring-1T0.773737373737374Not recordedNot recorded2025-10-13 · model_announcementArtificial Analysis
o3-mini (high)0.772727272727273Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Reasoning)0.771717171717172Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B (Reasoning)0.771717171717172Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Qwen3.5 4B (Reasoning)0.770707070707071Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Mercury 20.76969696969697Not recordedNot recorded2026-02-20 · model_announcementArtificial Analysis
Mistral Small 4 (Reasoning)0.768686868686869Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
GPT-5.5 (Non-reasoning)0.767676767676768Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Cogito v2.1 (Reasoning)0.767676767676768Not recordedNot recorded2025-11-18 · model_announcementArtificial Analysis
Nova 2.0 Lite (medium)0.767676767676768Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
Kimi K2 09050.766666666666667Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Kimi K20.765656565656566Not recordedNot recorded2025-07-11 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Sep '25) (Non-reasoning)0.765656565656566Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
o1-preview0.764646464646465Not recordedNot recorded2024-09-12 · model_announcementArtificial Analysis
Doubao Seed Code0.763636363636364Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Qwen3 Max (Preview)0.763636363636364Not recordedNot recorded2025-09-05 · model_announcementArtificial Analysis
Qwen3 Max0.763636363636364Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
KAT-Coder-Pro V10.763636363636364Not recordedNot recorded2025-11-11 · model_announcementArtificial Analysis
Gemma 4 31B (Non-reasoning)0.762626262626263Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
MiMo-V2.5-Pro (Non-reasoning)0.761616161616162Not recordedNot recorded2026-04-22 · model_announcementArtificial Analysis
Command A+0.760606060606061Not recordedNot recorded2026-05-20 · model_announcementArtificial Analysis
INTELLECT-30.760606060606061Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
GPT-5.4 nano (medium)0.760606060606061Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Nova 2.0 Omni (medium)0.759595959595959Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B (Reasoning)0.758585858585858Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Nemotron Cascade 2 30B A3B0.757575757575758Not recordedNot recorded2026-03-19 · model_announcementArtificial Analysis
North Mini Code0.756565656565657Not recordedNot recorded2026-06-09 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Reasoning)0.756565656565657Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3 235B A22B 2507 Instruct0.752525252525253Not recordedNot recorded2025-07-21 · model_announcementArtificial Analysis
Gemma 4 12B (Reasoning)0.752525252525252Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Ling-2.6-1T0.751515151515151Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Trinity Large Thinking0.751515151515151Not recordedNot recorded2026-04-01 · model_announcementArtificial Analysis
DeepSeek V3.2 (Non-reasoning)0.750505050505051Not recordedNot recorded2025-12-01 · model_announcementArtificial Analysis
DeepSeek V3.1 Terminus (Non-reasoning)0.750505050505051Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (low)0.750505050505051Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Mistral Medium 3.50.748484848484849Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Reasoning)0.748484848484849Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
o3-mini0.748484848484848Not recordedNot recorded2025-01-31 · model_announcementArtificial Analysis
GPT-5.4 (Non-reasoning)0.748484848484848Not recordedNot recorded2026-03-05 · model_announcementArtificial Analysis
o10.747474747474747Not recordedNot recorded2024-12-05 · model_announcementArtificial Analysis
GPT-5.6 Terra (Non-reasoning)0.746464646464646Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Nemotron 3.5 Lightning0.743434343434343Not recordedNot recorded2026-08-11 · model_announcementArtificial Analysis
Qwen3.5 Omni Flash0.742424242424242Not recordedNot recorded2026-03-30 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Reasoning)0.739393939393939Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Magistral Medium 1.20.739393939393939Not recordedNot recorded2025-09-18 · model_announcementArtificial Analysis
DeepSeek V3.2 Exp (Non-reasoning)0.738383838383838Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Qwen3 Next 80B A3B Instruct0.738383838383838Not recordedNot recorded2025-09-11 · model_announcementArtificial Analysis
Sarvam 105B (high)0.738383838383838Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
Qwen3 Coder Next0.737373737373737Not recordedNot recorded2026-02-03 · model_announcementArtificial Analysis
DeepSeek V3.1 (Non-reasoning)0.735353535353535Not recordedNot recorded2025-08-21 · model_announcementArtificial Analysis
Ling 3.0 Tiny0.734343434343434Not recordedNot recorded2026-08-06 · model_announcementArtificial Analysis
HyperNova 60B 26050.733333333333333Not recordedNot recorded2026-05-26 · model_announcementArtificial Analysis
GLM-4.5-Air0.733333333333333Not recordedNot recorded2025-07-28 · model_announcementArtificial Analysis
Apriel-v1.6-15B-Thinker0.733333333333333Not recordedNot recorded2025-11-25 · model_announcementArtificial Analysis
Qwen3 VL 32B (Reasoning)0.733333333333333Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Hy3-preview (Non-reasoning)0.732323232323232Not recordedNot recorded2026-04-23 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)0.728282828282828Not recordedNot recorded2025-04-07 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Reasoning)0.727272727272727Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Claude 4.5 Sonnet (Non-reasoning)0.727272727272727Not recordedNot recorded2025-09-29 · model_announcementArtificial Analysis
Grok Code Fast 10.727272727272727Not recordedNot recorded2025-08-28 · model_announcementArtificial Analysis
Seed-OSS-36B-Instruct0.726262626262626Not recordedNot recorded2025-08-20 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B (Reasoning)0.726262626262626Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Ring-flash-2.00.725252525252525Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
Solar Pro 30.724242424242424Not recordedNot recorded2026-04-06 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro Preview0.722222222222222Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B (Reasoning)0.72020202020202Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Ling-1T0.719191919191919Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
GLM-4.6V (Reasoning)0.719191919191919Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
DeepSeek V4 Pro (Non-reasoning)0.717171717171717Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
DeepSeek V4 Flash (Non-reasoning)0.716161616161616Not recordedNot recorded2026-04-24 · model_announcementArtificial Analysis
Gemma 4 26B A4B (Non-reasoning)0.714141414141414Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
K2 Think V20.713131313131313Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Apriel-v1.5-15B-Thinker0.713131313131313Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Qwen3.5 4B (Non-reasoning)0.712121212121212Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
GPT-5.2 (Non-reasoning)0.712121212121212Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3 VL 235B A22B Instruct0.712121212121212Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Reasoning)0.709090909090909Not recordedNot recorded2025-09-08 · model_announcementArtificial Analysis
DeepSeek R1 (Jan '25)0.708080808080808Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 (Reasoning)0.707070707070707Not recordedNot recorded2025-07-30 · model_announcementArtificial Analysis
Gemini 2.0 Flash Thinking Experimental (Jan '25)0.701010101010101Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Claude 4 Opus (Non-reasoning)0.701010101010101Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
Mi:dm K 2.5 Pro0.701010101010101Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Qwen3 235B A22B (Reasoning)0.7Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Reasoning)0.698989898989899Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Nova 2.0 Omni (low)0.698989898989899Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Reasoning)0.697979797979798Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Nova 2.0 Lite (low)0.697979797979798Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
MiniMax M1 80k0.696969696969697Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Qwen3 VL 30B A3B Instruct0.694949494949495Not recordedNot recorded2025-10-03 · model_announcementArtificial Analysis
Motif-2-12.7B-Reasoning0.694949494949495Not recordedNot recorded2025-12-04 · model_announcementArtificial Analysis
K-EXAONE (Non-reasoning)0.694949494949495Not recordedNot recorded2025-12-31 · model_announcementArtificial Analysis
Grok 30.692929292929293Not recordedNot recorded2025-02-19 · model_announcementArtificial Analysis
Step3 VL 10B0.68989898989899Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
gpt-oss-20b (high)0.687878787878788Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
GPT-5 mini (minimal)0.686868686868687Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Solar Pro 2 (Reasoning)0.686868686868687Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
GLM-5.2 (Non-reasoning)0.685858585858586Not recordedNot recorded2026-06-16 · model_announcementArtificial Analysis
GPT-5 (ChatGPT)0.685858585858586Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GLM-4.5V (Reasoning)0.683838383838384Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
Gemini 2.5 Flash (Non-reasoning)0.682828282828283Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Claude 4 Sonnet (Non-reasoning)0.682828282828283Not recordedNot recorded2025-05-22 · model_announcementArtificial Analysis
MiniMax M1 40k0.681818181818182Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
K2-V2 (high)0.680808080808081Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Mistral Large 30.67979797979798Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Magistral Medium 10.678787878787879Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
JT-MINI0.675757575757576Not recordedNot recorded2026-04-15 · model_announcementArtificial Analysis
GPT-5 nano (high)0.675757575757576Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
GPT-5 (minimal)0.672727272727273Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Reasoning)0.671717171717172Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
gpt-oss-120b (low)0.671717171717172Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Qwen3 VL 32B Instruct0.670707070707071Not recordedNot recorded2025-10-21 · model_announcementArtificial Analysis
Llama 4 Maverick0.670707070707071Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
GPT-5 nano (medium)0.66969696969697Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
DiffusionGemma 26B A4B0.668686868686869Not recordedNot recorded2026-06-10 · model_announcementArtificial Analysis
Qwen3 32B (Reasoning)0.667676767676768Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Qwen3 4B 2507 (Reasoning)0.666666666666667Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
GPT-4.10.665656565656566Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
GLM-5 (Non-reasoning)0.665656565656566Not recordedNot recorded2026-02-11 · model_announcementArtificial Analysis
GLM-4.7 (Non-reasoning)0.663636363636364Not recordedNot recorded2025-12-22 · model_announcementArtificial Analysis
GPT-4.1 mini0.663636363636364Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
Magistral Small 1.20.662626262626263Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
Gemma 4 12B (Non-reasoning)0.660606060606061Not recordedNot recorded2026-06-03 · model_announcementArtificial Analysis
Falcon-H1R-7B0.660606060606061Not recordedNot recorded2026-01-04 · model_announcementArtificial Analysis
Qwen3 30B A3B 2507 Instruct0.658585858585859Not recordedNot recorded2025-07-29 · model_announcementArtificial Analysis
Grok 4.3 (Non-reasoning)0.657575757575758Not recordedNot recorded2026-04-30 · model_announcementArtificial Analysis
Solar Open 100B (Reasoning)0.656565656565657Not recordedNot recorded2025-12-17 · model_announcementArtificial Analysis
Ling-flash-2.00.656565656565657Not recordedNot recorded2025-09-17 · model_announcementArtificial Analysis
MiMo-V2-Flash (Non-reasoning)0.655555555555556Not recordedNot recorded2025-12-16 · model_announcementArtificial Analysis
Claude 3.7 Sonnet (Non-reasoning)0.655555555555556Not recordedNot recorded2025-02-24 · model_announcementArtificial Analysis
GPT-4o (March 2025, chatgpt-4o-latest)0.654545454545455Not recordedNot recorded2025-03-27 · model_announcementArtificial Analysis
DeepSeek V3 03240.654545454545455Not recordedNot recorded2025-03-25 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)0.65050505050505Not recordedNot recorded2025-09-25 · model_announcementArtificial Analysis
Claude 4.5 Haiku (Non-reasoning)0.646464646464646Not recordedNot recorded2025-10-15 · model_announcementArtificial Analysis
GPT-5.6 Luna (Non-reasoning)0.645454545454546Not recordedNot recorded2026-07-09 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Reasoning)0.643434343434343Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
GPT-5.1 (Non-reasoning)0.643434343434343Not recordedNot recorded2025-11-13 · model_announcementArtificial Analysis
Magistral Small 10.641414141414141Not recordedNot recorded2025-06-10 · model_announcementArtificial Analysis
Grok 4.1 Fast (Non-reasoning)0.637373737373737Not recordedNot recorded2025-11-19 · model_announcementArtificial Analysis
LongCat Flash Lite0.636363636363636Not recordedNot recorded2026-01-28 · model_announcementArtificial Analysis
Nova 2.0 Pro Preview (Non-reasoning)0.636363636363636Not recordedNot recorded2025-11-27 · model_announcementArtificial Analysis
Gemini 2.0 Flash (experimental)0.636363636363636Not recordedNot recorded2024-12-11 · model_announcementArtificial Analysis
Sarvam 30B (high)0.633333333333333Not recordedNot recorded2026-03-06 · model_announcementArtificial Analysis
GLM-4.6 (Non-reasoning)0.632323232323232Not recordedNot recorded2025-09-30 · model_announcementArtificial Analysis
Celeris-10.631313131313131Not recordedNot recorded2026-07-24 · model_announcementArtificial Analysis
EXAONE 4.0 32B (Non-reasoning)0.628282828282828Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Reasoning)0.625252525252525Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
Sonar Reasoning0.623232323232323Not recordedNot recorded2025-01-28 · model_announcementArtificial Analysis
Gemini 2.0 Flash (Feb '25)0.623232323232323Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Gemini 2.0 Pro Experimental (Feb '25)0.622222222222222Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
Qwen3 Omni 30B A3B Instruct0.62020202020202Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Qwen3 Coder 480B A35B Instruct0.618181818181818Not recordedNot recorded2025-07-22 · model_announcementArtificial Analysis
Qwen3 30B A3B (Reasoning)0.616161616161616Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
HyperCLOVA X SEED Think (32B)0.615151515151515Not recordedNot recorded2025-12-26 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 32B0.615151515151515Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Qwen3 235B A22B (Non-reasoning)0.613131313131313Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
DeepSeek R1 0528 Qwen3 8B0.612121212121212Not recordedNot recorded2025-05-29 · model_announcementArtificial Analysis
gpt-oss-20b (low)0.611111111111111Not recordedNot recorded2025-08-05 · model_announcementArtificial Analysis
Olmo 3 32B Think0.61010101010101Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Grok 4 Fast (Non-reasoning)0.606060606060606Not recordedNot recorded2025-09-19 · model_announcementArtificial Analysis
GPT-5.4 mini (Non-Reasoning)0.606060606060606Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
Qwen3 14B (Reasoning)0.604040404040404Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nova 2.0 Lite (Non-reasoning)0.603030303030303Not recordedNot recorded2025-10-29 · model_announcementArtificial Analysis
o1-mini0.603030303030303Not recordedNot recorded2024-09-12 · model_announcementArtificial Analysis
Tri-21B-Think0.601010101010101Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Claude 3.5 Sonnet (Oct '24)0.598989898989899Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
K2-V2 (medium)0.597979797979798Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Devstral 20.593939393939394Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Gemini 2.5 Flash Preview (Non-reasoning)0.593939393939394Not recordedNot recorded2025-04-17 · model_announcementArtificial Analysis
Ling 2.6 Flash0.592929292929293Not recordedNot recorded2026-04-21 · model_announcementArtificial Analysis
QwQ 32B0.592929292929293Not recordedNot recorded2025-03-05 · model_announcementArtificial Analysis
Olmo 3.1 32B Think0.590909090909091Not recordedNot recorded2025-12-12 · model_announcementArtificial Analysis
Gemini 1.5 Pro (Sep '24)0.588888888888889Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
Qwen3 8B (Reasoning)0.588888888888889Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Medium 3.10.587878787878788Not recordedNot recorded2025-08-12 · model_announcementArtificial Analysis
Llama 4 Scout0.586868686868687Not recordedNot recorded2025-04-05 · model_announcementArtificial Analysis
Qwen2.5 Max0.586868686868687Not recordedNot recorded2025-01-28 · model_announcementArtificial Analysis
GLM-4.7-Flash (Reasoning)0.580808080808081Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
Qwen3 VL 8B (Reasoning)0.578787878787879Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Sonar Pro0.577777777777778Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Mistral Medium 30.577777777777778Not recordedNot recorded2025-05-07 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Reasoning)0.577777777777778Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Gemma 4 E4B (Reasoning)0.575757575757576Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Phi-40.574747474747475Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
GLM-4.5V (Non-reasoning)0.572727272727273Not recordedNot recorded2025-08-11 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Reasoning)0.571717171717172Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Ministral 3 14B0.571717171717172Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Mistral Small 4 (Non-reasoning)0.570707070707071Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Reasoning)0.56969696969697Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
Nova Premier0.568686868686869Not recordedNot recorded2025-04-30 · model_announcementArtificial Analysis
GLM-4.6V (Non-reasoning)0.565656565656566Not recordedNot recorded2025-12-08 · model_announcementArtificial Analysis
Ling-mini-2.00.561616161616162Not recordedNot recorded2025-09-09 · model_announcementArtificial Analysis
Solar Pro 2 (Non-reasoning)0.560606060606061Not recordedNot recorded2025-07-09 · model_announcementArtificial Analysis
Claude 3.5 Sonnet (June '24)0.55959595959596Not recordedNot recorded2024-06-21 · model_announcementArtificial Analysis
GPT-5.4 nano (Non-Reasoning)0.557575757575758Not recordedNot recorded2026-03-17 · model_announcementArtificial Analysis
LFM2.5-2.6B0.557575757575758Not recordedNot recorded2026-08-04 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 9B V2 (Non-reasoning)0.556565656565657Not recordedNot recorded2025-08-18 · model_announcementArtificial Analysis
DeepSeek V3 (Dec '24)0.556565656565657Not recordedNot recorded2024-12-26 · model_announcementArtificial Analysis
QwQ 32B-Preview0.556565656565656Not recordedNot recorded2024-11-27 · model_announcementArtificial Analysis
Nova 2.0 Omni (Non-reasoning)0.554545454545454Not recordedNot recorded2025-11-26 · model_announcementArtificial Analysis
Gemma 4 E4B (Non-reasoning)0.549494949494949Not recordedNot recorded2026-04-03 · model_announcementArtificial Analysis
Solar Pro 2 (Preview) (Non-reasoning)0.544444444444445Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
GPT-4o (Nov '24)0.543434343434343Not recordedNot recorded2024-11-20 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Preview)0.542424242424242Not recordedNot recorded2025-02-05 · model_announcementArtificial Analysis
K2-V2 (low)0.541414141414141Not recordedNot recorded2025-12-05 · model_announcementArtificial Analysis
Olmo 3.1 32B Instruct0.539393939393939Not recordedNot recorded2026-01-13 · model_announcementArtificial Analysis
Tri-21B-think Preview0.538383838383838Not recordedNot recorded2026-02-10 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 405B (Non-reasoning)0.536363636363636Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Gemini 2.0 Flash-Lite (Feb '25)0.535353535353535Not recordedNot recorded2025-02-25 · model_announcementArtificial Analysis
Qwen3 32B (Non-reasoning)0.535353535353535Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Devstral Small 20.532323232323232Not recordedNot recorded2025-12-09 · model_announcementArtificial Analysis
Reka Flash 30.529292929292929Not recordedNot recorded2025-03-10 · model_announcementArtificial Analysis
Command A0.527272727272727Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
GPT-4o (May '24)0.526262626262626Not recordedNot recorded2024-05-13 · model_announcementArtificial Analysis
Qwen3 4B (Reasoning)0.522222222222222Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GPT-4o (Aug '24)0.521212121212121Not recordedNot recorded2024-08-06 · model_announcementArtificial Analysis
Qwen3 4B 2507 Instruct0.517171717171717Not recordedNot recorded2025-08-06 · model_announcementArtificial Analysis
Llama 3.3 Nemotron Super 49B v1 (Non-reasoning)0.517171717171717Not recordedNot recorded2025-03-18 · model_announcementArtificial Analysis
Olmo 3 7B Think0.516161616161616Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Qwen3 Coder 30B A3B Instruct0.516161616161616Not recordedNot recorded2025-07-31 · model_announcementArtificial Analysis
Llama 3.1 Tulu3 405B0.516161616161616Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Llama 3.1 Instruct 405B0.515151515151515Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Reasoning)0.515151515151515Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
Qwen3 30B A3B (Non-reasoning)0.515151515151515Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 4B0.513131313131313Not recordedNot recorded2026-03-16 · model_announcementArtificial Analysis
LFM2.5-8B-A1B0.513131313131313Not recordedNot recorded2026-05-28 · model_announcementArtificial Analysis
GPT-4.1 nano0.512121212121212Not recordedNot recorded2025-04-14 · model_announcementArtificial Analysis
GPT-4o (ChatGPT)0.511111111111111Not recordedNot recorded2025-02-15 · model_announcementArtificial Analysis
Grok 2 (Dec '24)0.51010101010101Not recordedNot recorded2024-12-12 · model_announcementArtificial Analysis
Mistral Small 3.20.505050505050505Not recordedNot recorded2025-06-20 · model_announcementArtificial Analysis
Pixtral Large0.505050505050505Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Nova Pro0.498989898989899Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Llama 3.3 Instruct 70B0.497979797979798Not recordedNot recorded2024-12-06 · model_announcementArtificial Analysis
Qwen3 VL 4B (Reasoning)0.493939393939394Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Devstral Medium0.491919191919192Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Hermes 4 - Llama-3.1 70B (Non-reasoning)0.490909090909091Not recordedNot recorded2025-08-27 · model_announcementArtificial Analysis
Qwen2.5 Instruct 72B0.490909090909091Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Claude 3 Opus0.488888888888889Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Mistral Large 2 (Nov '24)0.485858585858586Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 14B0.483838383838384Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Llama Nemotron Super 49B v1.5 (Non-reasoning)0.480808080808081Not recordedNot recorded2025-07-25 · model_announcementArtificial Analysis
Granite 4.1 30B0.480808080808081Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Gemini 2.5 Flash-Lite (Non-reasoning)0.473737373737374Not recordedNot recorded2025-06-17 · model_announcementArtificial Analysis
LFM2 24B A2B0.473737373737374Not recordedNot recorded2026-02-25 · model_announcementArtificial Analysis
Mistral Large 2 (Jul '24)0.471717171717172Not recordedNot recorded2024-07-24 · model_announcementArtificial Analysis
Sonar0.470707070707071Not recordedNot recorded2025-01-21 · model_announcementArtificial Analysis
Ministral 3 8B0.470707070707071Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Grok Beta0.470707070707071Not recordedNot recorded2024-08-13 · model_announcementArtificial Analysis
Qwen3 14B (Non-reasoning)0.46969696969697Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Nemotron 3 Nano Omni 30B A3B Reasoning0.468686868686869Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Qwen2.5 Instruct 32B0.465656565656566Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Instruct 70B0.464646464646465Not recordedNot recorded2024-10-15 · model_announcementArtificial Analysis
Gemini 1.5 Flash (Sep '24)0.462626262626263Not recordedNot recorded2024-09-24 · model_announcementArtificial Analysis
Mistral Small 30.461616161616162Not recordedNot recorded2025-01-30 · model_announcementArtificial Analysis
Qwen3.5 2B (Reasoning)0.455555555555556Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Mistral Small 3.10.453535353535354Not recordedNot recorded2025-03-17 · model_announcementArtificial Analysis
Qwen3 8B (Non-reasoning)0.451515151515152Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
GLM-4.7-Flash (Non-reasoning)0.451515151515151Not recordedNot recorded2026-01-19 · model_announcementArtificial Analysis
NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning)0.439393939393939Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Qwen3.5 2B (Non-reasoning)0.438383838383838Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
G9v3-3B0.438383838383838Not recordedNot recorded2026-07-23 · model_announcementArtificial Analysis
Devstral Small (May '25)0.434343434343434Not recordedNot recorded2025-05-21 · model_announcementArtificial Analysis
Nova Lite0.433333333333333Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Granite 4.1 8B0.433333333333333Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
Gemma 4 E2B (Reasoning)0.433333333333333Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
Llama 3.2 Instruct 90B (Vision)0.432323232323232Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
GPT-5 nano (minimal)0.428282828282828Not recordedNot recorded2025-08-07 · model_announcementArtificial Analysis
Gemma 3 27B Instruct0.428282828282828Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
Qwen3 VL 8B Instruct0.427272727272727Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Jamba 1.5 Large0.427272727272727Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
GPT-4o mini0.426262626262626Not recordedNot recorded2024-07-18 · model_announcementArtificial Analysis
Molmo2-8B0.425252525252525Not recordedNot recorded2025-12-11 · model_announcementArtificial Analysis
Mistral Saba0.424242424242424Not recordedNot recorded2025-02-17 · model_announcementArtificial Analysis
Exaone 4.0 1.2B (Non-reasoning)0.424242424242424Not recordedNot recorded2025-07-15 · model_announcementArtificial Analysis
DeepSeek-V2.5 (Dec '24)0.423232323232323Not recordedNot recorded2024-12-10 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 32B0.417171717171717Not recordedNot recorded2024-11-11 · model_announcementArtificial Analysis
Sarvam M (Reasoning)0.416161616161616Not recordedNot recorded2025-05-23 · model_announcementArtificial Analysis
Granite 4.0 H Small0.416161616161616Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Devstral Small (Jul '25)0.414141414141414Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Kimi Linear 48B A3B Instruct0.412121212121212Not recordedNot recorded2025-10-30 · model_announcementArtificial Analysis
Qwen2.5 Turbo0.41010101010101Not recordedNot recorded2024-11-18 · model_announcementArtificial Analysis
Llama 3.1 Instruct 70B0.409090909090909Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Claude 3.5 Haiku0.408080808080808Not recordedNot recorded2024-10-22 · model_announcementArtificial Analysis
Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)0.408080808080808Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Gemma 4 E2B (Non-reasoning)0.405050505050505Not recordedNot recorded2026-04-02 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 70B0.402020202020202Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Hermes 3 - Llama-3.1 70B0.401010101010101Not recordedNot recorded2024-08-15 · model_announcementArtificial Analysis
Olmo 3 7B Instruct0.4Not recordedNot recorded2025-11-20 · model_announcementArtificial Analysis
Claude 3 Sonnet0.4Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
NVIDIA Nemotron 3 Nano 30B A3B (Non-reasoning)0.398989898989899Not recordedNot recorded2025-12-15 · model_announcementArtificial Analysis
Qwen3 4B (Non-reasoning)0.397979797979798Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Jamba 1.7 Large0.38989898989899Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Jamba 1.6 Large0.386868686868687Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
DeepHermes 3 - Mistral 24B Preview (Non-reasoning)0.381818181818182Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Mistral Small (Sep '24)0.380808080808081Not recordedNot recorded2024-09-17 · model_announcementArtificial Analysis
Llama 3 Instruct 70B0.378787878787879Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Claude 3 Haiku0.373737373737374Not recordedNot recorded2024-03-04 · model_announcementArtificial Analysis
Gemini 1.5 Pro (May '24)0.370707070707071Not recordedNot recorded2024-05-15 · model_announcementArtificial Analysis
Qwen2 Instruct 72B0.370707070707071Not recordedNot recorded2024-06-07 · model_announcementArtificial Analysis
Qwen3 VL 4B Instruct0.370707070707071Not recordedNot recorded2025-10-14 · model_announcementArtificial Analysis
Gemini 1.5 Flash-8B0.358585858585859Not recordedNot recorded2024-10-03 · model_announcementArtificial Analysis
Nova Micro0.357575757575758Not recordedNot recorded2024-12-03 · model_announcementArtificial Analysis
Ministral 3 3B0.357575757575758Not recordedNot recorded2025-12-02 · model_announcementArtificial Analysis
Qwen3 1.7B (Reasoning)0.355555555555556Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Mistral Large (Feb '24)0.350505050505051Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Mistral Medium0.349494949494949Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Gemma 3 12B Instruct0.349494949494949Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
GPT-40.349494949494949Not recordedNot recorded2023-03-14 · model_announcementArtificial Analysis
LFM2 8B A1B0.344444444444444Not recordedNot recorded2025-10-07 · model_announcementArtificial Analysis
Claude 2.00.344444444444444Not recordedNot recorded2023-07-11 · model_announcementArtificial Analysis
LFM2.5-1.2B-Thinking0.339393939393939Not recordedNot recorded2026-01-20 · model_announcementArtificial Analysis
Qwen2.5 Coder Instruct 7B0.339393939393939Not recordedNot recorded2024-09-19 · model_announcementArtificial Analysis
Granite 3.3 8B (Non-reasoning)0.338383838383838Not recordedNot recorded2025-04-16 · model_announcementArtificial Analysis
Granite 4.0 Micro0.336363636363636Not recordedNot recorded2025-09-22 · model_announcementArtificial Analysis
Jamba Reasoning 3B0.333333333333333Not recordedNot recorded2025-10-08 · model_announcementArtificial Analysis
Mixtral 8x22B Instruct0.332323232323232Not recordedNot recorded2024-04-17 · model_announcementArtificial Analysis
DBRX Instruct0.331313131313131Not recordedNot recorded2024-03-27 · model_announcementArtificial Analysis
Phi-4 Mini Instruct0.331313131313131Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Claude Instant0.33030303030303Not recordedNot recorded2023-03-14 · model_announcementArtificial Analysis
OLMo 2 32B0.328282828282828Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
LFM 40B0.327272727272727Not recordedNot recorded2024-09-30 · model_announcementArtificial Analysis
Llama 2 Chat 70B0.327272727272727Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
LFM2.5-1.2B-Instruct0.326262626262626Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Gemini 1.5 Flash (May '24)0.324242424242424Not recordedNot recorded2024-05-14 · model_announcementArtificial Analysis
Command-R+ (Apr '24)0.323232323232323Not recordedNot recorded2024-04-04 · model_announcementArtificial Analysis
Jamba 1.7 Mini0.322222222222222Not recordedNot recorded2025-07-07 · model_announcementArtificial Analysis
Llama 2 Chat 13B0.321212121212121Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
Claude 2.10.319191919191919Not recordedNot recorded2023-11-21 · model_announcementArtificial Analysis
DeepSeek Coder V2 Lite Instruct0.319191919191919Not recordedNot recorded2024-06-17 · model_announcementArtificial Analysis
Phi-3 Mini Instruct 3.8B0.319191919191919Not recordedNot recorded2024-04-23 · model_announcementArtificial Analysis
Phi-4 Multimodal Instruct0.315151515151515Not recordedNot recorded2025-02-26 · model_announcementArtificial Analysis
Granite 4.1 3B0.314141414141414Not recordedNot recorded2026-04-29 · model_announcementArtificial Analysis
LFM2 2.6B0.306060606060606Not recordedNot recorded2025-09-23 · model_announcementArtificial Analysis
MiniCPM-V 4.6 1.3B0.305050505050505Not recordedNot recorded2026-05-11 · model_announcementArtificial Analysis
Tiny Aya Global0.305050505050505Not recordedNot recorded2026-02-17 · model_announcementArtificial Analysis
DeepSeek R1 Distill Llama 8B0.302020202020202Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis
Mistral Small (Feb '24)0.302020202020202Not recordedNot recorded2024-02-26 · model_announcementArtificial Analysis
Jamba 1.5 Mini0.302020202020202Not recordedNot recorded2024-08-22 · model_announcementArtificial Analysis
Jamba 1.6 Mini0.3Not recordedNot recorded2025-03-06 · model_announcementArtificial Analysis
GPT-3.5 Turbo0.296969696969697Not recordedNot recorded2022-11-30 · model_announcementArtificial Analysis
Llama 3 Instruct 8B0.295959595959596Not recordedNot recorded2024-04-18 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct0.295959595959596Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
Mixtral 8x7B Instruct0.291919191919192Not recordedNot recorded2023-12-11 · model_announcementArtificial Analysis
Gemma 3 4B Instruct0.290909090909091Not recordedNot recorded2025-03-12 · model_announcementArtificial Analysis
LFM2.5-VL-1.6B0.288888888888889Not recordedNot recorded2026-01-05 · model_announcementArtificial Analysis
Qwen1.5 Chat 110B0.288888888888889Not recordedNot recorded2024-04-25 · model_announcementArtificial Analysis
OLMo 2 7B0.287878787878788Not recordedNot recorded2024-11-26 · model_announcementArtificial Analysis
Command-R (Mar '24)0.283838383838384Not recordedNot recorded2024-03-12 · model_announcementArtificial Analysis
Qwen3 1.7B (Non-reasoning)0.282828282828283Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Granite 4.0 1B0.280808080808081Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
MiniCPM5-1B (Reasoning)0.277777777777778Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Gemma 3n E4B Instruct Preview (May '25)0.277777777777778Not recordedNot recorded2025-05-20 · model_announcementArtificial Analysis
Gemini 1.0 Pro0.276767676767677Not recordedNot recorded2023-12-06 · model_announcementArtificial Analysis
Apertus 70B Instruct0.271717171717172Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
DeepHermes 3 - Llama-3.1 8B Preview (Non-reasoning)0.26969696969697Not recordedNot recorded2025-02-13 · model_announcementArtificial Analysis
MiniCPM5-1B (Non-reasoning)0.268686868686869Not recordedNot recorded2026-05-25 · model_announcementArtificial Analysis
Granite 4.0 H 1B0.262626262626263Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Granite 4.0 350M0.260606060606061Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Llama 3.1 Instruct 8B0.258585858585859Not recordedNot recorded2024-07-23 · model_announcementArtificial Analysis
Granite 4.0 H 350M0.256565656565657Not recordedNot recorded2025-10-28 · model_announcementArtificial Analysis
Apertus 8B Instruct0.255555555555556Not recordedNot recorded2025-09-02 · model_announcementArtificial Analysis
Llama 3.2 Instruct 3B0.254545454545455Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Molmo 7B-D0.24040404040404Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Qwen3 0.6B (Reasoning)0.239393939393939Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
Gemma 3 1B Instruct0.237373737373737Not recordedNot recorded2025-03-13 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Non-reasoning)0.236363636363636Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
Qwen3 0.6B (Non-reasoning)0.231313131313131Not recordedNot recorded2025-04-28 · model_announcementArtificial Analysis
OpenChat 3.5 (1210)0.23030303030303Not recordedNot recorded2023-12-18 · model_announcementArtificial Analysis
Gemma 3n E2B Instruct0.229292929292929Not recordedNot recorded2025-06-26 · model_announcementArtificial Analysis
LFM2 1.2B0.228282828282828Not recordedNot recorded2025-07-10 · model_announcementArtificial Analysis
Llama 2 Chat 7B0.227272727272727Not recordedNot recorded2023-07-18 · model_announcementArtificial Analysis
Gemma 3 270M0.224242424242424Not recordedNot recorded2025-08-14 · model_announcementArtificial Analysis
Llama 3.2 Instruct 11B (Vision)0.221212121212121Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Llama 3.2 Instruct 1B0.195959595959596Not recordedNot recorded2024-09-25 · model_announcementArtificial Analysis
Mistral 7B Instruct0.176767676767677Not recordedNot recorded2023-09-27 · model_announcementArtificial Analysis
Qwen3.5 0.8B (Reasoning)0.111111111111111Not recordedNot recorded2026-03-02 · model_announcementArtificial Analysis
DeepSeek R1 Distill Qwen 1.5B0.097979797979798Not recordedNot recorded2025-01-20 · model_announcementArtificial Analysis

Put this benchmark in context

Reasoning and math benchmarksScience benchmarks