AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

LiveCodeBench v5

LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
text

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 9

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemini 2.5 Pro0.756Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemini 2.5 Flash0.639Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.614Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
MiniCPM-SALA0.6048Not recordedNot recorded2026-02-11 · model_announcementLLM Stats
Gemini 2.0 Flash-Lite0.289Not recordedNot recorded2025-02-05 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.257Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.257Not recordedNot recorded2025-05-20 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.186Not recordedNot recorded2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.186Not recordedNot recorded2025-05-20 · model_announcementLLM Stats