AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MBPP

MBPP (Mostly Basic Python Problems) is a benchmark of 974 crowd-sourced Python programming problems designed to be solvable by entry-level programmers. Each problem consists of a task description, code solution, and 3 automated test cases covering programming fundamentals and standard library functionality.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
2021-08-16
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 33

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Sarvam-30B0.927未收录未收录2026-03-06 · model_announcementLLM Stats
Llama-3.3 Nemotron Super 49B v10.913未收录未收录2025-03-18 · model_announcementLLM Stats
Qwen2.5-Coder 32B Instruct0.902未收录未收录2024-09-19 · model_announcementLLM Stats
MiniCPM-SALA0.8911未收录未收录2026-02-11 · model_announcementLLM Stats
Qwen2.5 72B Instruct0.882未收录未收录2024-09-19 · model_announcementLLM Stats
Llama 3.1 Nemotron Nano 8B V10.846未收录未收录2025-03-18 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.84未收录未收录2025-02-28 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.84未收录未收录2024-09-19 · model_announcementLLM Stats
Qwen2.5-Coder 7B Instruct0.835未收录未收录2024-09-19 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.82未收录未收录2024-09-19 · model_announcementLLM Stats
Qwen3 235B A22B0.814未收录未收录2025-04-29 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.808未收录未收录2024-08-23 · model_announcementLLM Stats
Qwen2 72B Instruct0.802未收录未收录2024-07-23 · model_announcementLLM Stats
Qwen2.5 7B Instruct0.792未收录未收录2024-09-19 · model_announcementLLM Stats
Codestral-22B0.782未收录未收录2024-05-29 · model_announcementLLM Stats
Llama 4 Maverick0.776未收录未收录2025-04-05 · model_announcementLLM Stats
Gemini Diffusion0.76未收录未收录2025-05-20 · model_announcementLLM Stats
Mistral Small 3.1 24B Instruct0.7471未收录未收录2025-03-17 · model_announcementLLM Stats
Gemma 3 27B0.744未收录未收录2025-03-12 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.732未收录未收录2025-03-27 · model_announcementLLM Stats
Gemma 3 12B0.73未收录未收录2025-03-12 · model_announcementLLM Stats
Mistral Small 3 24B Base0.6964未收录未收录2025-01-30 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.696未收录未收录2024-08-23 · model_announcementLLM Stats
Llama 4 Scout0.678未收录未收录2025-04-05 · model_announcementLLM Stats
Qwen2 7B Instruct0.672未收录未收录2024-07-23 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.636未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.636未收录未收录2025-05-20 · model_announcementLLM Stats
Gemma 3 4B0.632未收录未收录2025-03-12 · model_announcementLLM Stats
Gemma 2 27B0.626未收录未收录2024-06-27 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.566未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.566未收录未收录2025-05-20 · model_announcementLLM Stats
Gemma 2 9B0.524未收录未收录2024-06-27 · model_announcementLLM Stats
Gemma 3 1B0.352未收录未收录2025-03-12 · model_announcementLLM Stats

其他来源中的相关记录