AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

LiveCodeBench

LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.

评测信息与证据

来源
LLM Stats
发布者
University of California, Berkeley
评测发布日期
2024-03-12
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 75

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
DeepSeek-V4-Pro-Max0.935未收录未收录2026-04-23 · model_announcementLLM Stats
DeepSeek-V4-Flash-Max0.916未收录未收录2026-04-23 · model_announcementLLM Stats
DeepSeek-V4-Flash-04230.884未收录未收录2026-04-23 · model_announcementLLM Stats
Solar Pro 40.878未收录未收录2026-08-06 · model_announcementLLM Stats
DeepSeek-V3.2 (Thinking)0.833未收录未收录2025-12-01 · model_announcementLLM Stats
DeepSeek-V3.20.833未收录未收录2025-12-01 · model_announcementLLM Stats
MiniMax M20.83未收录未收录2025-10-27 · model_announcementLLM Stats
LongCat-Flash-Thinking-26010.828未收录未收录2026-01-14 · model_announcementLLM Stats
Nemotron 3 Super (120B A12B)0.8119未收录未收录2026-03-11 · model_announcementLLM Stats
Grok-3 Mini0.804未收录未收录2025-02-17 · model_announcementLLM Stats
Grok 4 Fast0.8未收录未收录2025-08-28 · model_announcementLLM Stats
LongCat-Flash-Thinking0.794未收录未收录2025-09-22 · model_announcementLLM Stats
Grok-4 Heavy0.794未收录未收录2025-07-09 · model_announcementLLM Stats
Grok-30.794未收录未收录2025-02-17 · model_announcementLLM Stats
Grok-40.79未收录未收录2025-07-09 · model_announcementLLM Stats
MiniMax M2.10.78未收录未收录2025-12-23 · model_announcementLLM Stats
Nova 2 Pro0.746未收录未收录2025-12-02 · model_announcementLLM Stats
DeepSeek-V3.2-Exp0.741未收录未收录2025-09-29 · model_announcementLLM Stats
DeepSeek-R1-05280.733未收录未收录2025-05-28 · model_announcementLLM Stats
GLM-4.50.729未收录未收录2025-07-28 · model_announcementLLM Stats
Nemotron Nano 9B v20.711未收录未收录2025-08-18 · model_announcementLLM Stats
Nova 2 Lite0.71未收录未收录2025-12-02 · model_announcementLLM Stats
GLM-4.5-Air0.707未收录未收录2025-07-28 · model_announcementLLM Stats
Qwen3 235B A22B0.707未收录未收录2025-04-29 · model_announcementLLM Stats
Gemini 2.5 Pro Preview 06-050.69未收录未收录2025-06-05 · model_announcementLLM Stats
Mercury 20.67未收录未收录2026-02-24 · model_announcementLLM Stats
Llama 3.1 Nemotron Ultra 253B v10.6631未收录未收录2025-04-07 · model_announcementLLM Stats
Qwen3 32B0.657未收录未收录2025-04-29 · model_announcementLLM Stats
MiniMax M1 80K0.65未收录未收录2025-06-16 · model_announcementLLM Stats
Ministral 3 (14B Reasoning 2512)0.646未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Small 40.636未收录未收录2026-03-16 · model_announcementLLM Stats
QwQ-32B0.634未收录未收录2025-03-05 · model_announcementLLM Stats
Qwen3 30B A3B0.626未收录未收录2025-04-29 · model_announcementLLM Stats
MiniMax M1 40K0.623未收录未收录2025-06-16 · model_announcementLLM Stats
Ministral 3 (8B Reasoning 2512)0.616未收录未收录2025-12-04 · model_announcementLLM Stats
DeepSeek R1 Distill Llama 70B0.575未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 32B0.572未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek-V3.10.564未收录未收录2025-01-10 · model_announcementLLM Stats
Qwen2.5 72B Instruct0.555未收录未收录2024-09-19 · model_announcementLLM Stats
Min istral 3 (3B Reasoning 2512)0.548未收录未收录2025-12-04 · model_announcementLLM Stats
Phi 4 Reasoning0.538未收录未收录2025-04-30 · model_announcementLLM Stats
Kimi K2-Instruct-09050.537未收录未收录2025-09-05 · model_announcementLLM Stats
Phi 4 Reasoning Plus0.531未收录未收录2025-04-30 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 14B0.531未收录未收录2025-01-20 · model_announcementLLM Stats
Magistral Small 25060.513未收录未收录2025-06-10 · model_announcementLLM Stats
Magistral Medium0.503未收录未收录2025-06-10 · model_announcementLLM Stats
DeepSeek R1 Zero0.5未收录未收录2025-01-20 · model_announcementLLM Stats
QwQ-32B-Preview0.5未收录未收录2024-11-28 · model_announcementLLM Stats
DeepSeek-V3 03240.492未收录未收录2025-03-25 · model_announcementLLM Stats
LongCat-Flash-Chat0.4802未收录未收录2025-08-29 · model_announcementLLM Stats
Llama 4 Maverick0.434未收录未收录2025-04-05 · model_announcementLLM Stats
DeepSeek R1 Distill Llama 8B0.396未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 7B0.376未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek-V30.376未收录未收录2024-12-25 · model_announcementLLM Stats
Gemini 2.0 Flash0.351未收录未收录2024-12-01 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512 Eagle)0.344未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512)0.344未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Instruct 2512 NVFP4)0.344未收录未收录2025-12-04 · model_announcementLLM Stats
Mistral Large 3 (675B Base)0.344未收录未收录2025-12-04 · model_announcementLLM Stats
Gemini 2.5 Flash-Lite0.337未收录未收录2025-06-17 · model_announcementLLM Stats
Llama 4 Scout0.328未收录未收录2025-04-05 · model_announcementLLM Stats
Qwen2.5-Coder 32B Instruct0.314未收录未收录2024-09-19 · model_announcementLLM Stats
Gemini Diffusion0.309未收录未收录2025-05-20 · model_announcementLLM Stats
Gemma 3 27B0.297未收录未收录2025-03-12 · model_announcementLLM Stats
Qwen2.5 7B Instruct0.287未收录未收录2024-09-19 · model_announcementLLM Stats
Qwen2 7B Instruct0.266未收录未收录2024-07-23 · model_announcementLLM Stats
Gemma 3 12B0.246未收录未收录2025-03-12 · model_announcementLLM Stats
Qwen2.5-Coder 7B Instruct0.182未收录未收录2024-09-19 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 1.5B0.169未收录未收录2025-01-20 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.132未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.132未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.132未收录未收录2025-05-20 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.132未收录未收录2025-05-20 · model_announcementLLM Stats
Gemma 3 4B0.126未收录未收录2025-03-12 · model_announcementLLM Stats
Gemma 3 1B0.019未收录未收录2025-03-12 · model_announcementLLM Stats

其他来源中的相关记录