AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

LiveCodeBench v6

LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 56

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.7 Max0.916Not recordedNot recorded2026-05-19 · model_announcementLLM Stats
Sakana Namazu0.9033Not recordedNot recorded2026-08-03 · model_announcementLLM Stats
Qwen3.8-27B0.903Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
Qwen3.7-Plus0.896Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Kimi K2.60.896Not recordedNot recorded2026-04-20 · model_announcementLLM Stats
Nemotron 3 Ultra (550B A55B)0.89Not recordedNot recorded2026-06-04 · model_announcementLLM Stats
Seed 2.0 Pro0.878Not recordedNot recorded2026-02-14 · model_announcementLLM Stats
MAI-Thinking-10.877Not recordedNot recorded2026-06-02 · model_announcementLLM Stats
Qwen3.6 Plus0.871Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Step-3.5-Flash0.864Not recordedNot recorded2026-02-02 · model_announcementLLM Stats
Kimi K2.50.85Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
GLM-4.70.849Not recordedNot recorded2025-12-22 · model_announcementLLM Stats
Qwen3.6-27B0.839Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-397B-A17B0.836Not recordedNot recorded2026-02-16 · model_announcementLLM Stats
Kimi K2-Thinking-09050.831Not recordedNot recorded2025-09-05 · model_announcementLLM Stats
GLM-4.60.828Not recordedNot recorded2025-09-30 · model_announcementLLM Stats
GPT OSS 120B High0.819Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
Seed 2.0 Lite0.817Not recordedNot recorded2026-02-14 · model_announcementLLM Stats
Qwen3.5-27B0.807Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
K-EXAONE-236B-A23B0.807Not recordedNot recorded2025-12-31 · model_announcementLLM Stats
MiMo-V2-Flash0.806Not recordedNot recorded2025-12-16 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.804Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Gemma 4 31B0.8Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.789Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Gemma 4 26B-A4B0.771Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.746Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3-235B-A22B-Thinking-25070.741Not recordedNot recorded2025-07-25 · model_announcementLLM Stats
Gemma 4 12B0.72Not recordedNot recorded2026-05-23 · model_announcementLLM Stats
Sarvam-105B0.717Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
North Mini Code 1.00.703Not recordedNot recorded2026-06-09 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.701Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Sarvam-30B0.7Not recordedNot recorded2026-03-06 · model_announcementLLM Stats
DiffusionGemma 26B-A4B0.691Not recordedNot recorded2026-06-10 · model_announcementLLM Stats
Qwen3 Max0.69Not recordedNot recorded2025-12-15 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Thinking0.687Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Nemotron 3 Nano (30B A3B)0.683Not recordedNot recorded2025-12-15 · model_announcementLLM Stats
Qwen3.5-9B0.656Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.656Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.642Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
LFM2.5-2.6B0.5941Not recordedNot recorded2026-08-04 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.586Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3-Next-80B-A3B-Instruct0.566Not recordedNot recorded2025-09-10 · model_announcementLLM Stats
Qwen3.5-4B0.558Not recordedNot recorded2026-03-02 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.543Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Kimi K2 Instruct0.537Not recordedNot recorded2025-07-11 · model_announcementLLM Stats
Gemma 4 E4B0.52Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
MiniCPM-SALA0.52Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
Qwen3-235B-A22B-Instruct-25070.518Not recordedNot recorded2025-07-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.513Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Gemma 4 E2B0.44Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.438Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.426Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
MiMo-V2.5-Pro0.396Not recordedNot recorded2026-04-27 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.393Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.379Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Kimi K2 Base0.263Not recordedNot recorded2025-07-11 · model_announcementLLM Stats

Related records in other sources