AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MGSM

MGSM (Multilingual Grade School Math) is a benchmark of grade-school math problems. Contains 250 grade-school math problems manually translated from the GSM8K dataset into ten typologically diverse languages: Spanish, French, German, Russian, Chinese, Japanese, Thai, Swahili, Bengali, and Telugu. Evaluates multilingual mathematical reasoning capabilities.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
2022-10-06
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 31

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Llama 4 Maverick0.923未收录未收录2025-04-05 · model_announcementLLM Stats
o3-mini0.92未收录未收录2025-01-30 · model_announcementLLM Stats
Claude 3.5 Sonnet0.916未收录未收录2024-10-22 · model_announcementLLM Stats
Claude 3.5 Sonnet0.916未收录未收录2024-06-21 · model_announcementLLM Stats
Llama 3.3 70B Instruct0.911未收录未收录2024-12-06 · model_announcementLLM Stats
o1-preview0.908未收录未收录2024-09-12 · model_announcementLLM Stats
Claude 3 Opus0.907未收录未收录2024-02-29 · model_announcementLLM Stats
Llama 4 Scout0.906未收录未收录2025-04-05 · model_announcementLLM Stats
GPT-4o0.905未收录未收录2024-05-13 · model_announcementLLM Stats
o10.893未收录未收录2024-12-17 · model_announcementLLM Stats
GPT-4 Turbo0.885未收录未收录2024-04-09 · model_announcementLLM Stats
Gemini 1.5 Pro0.875未收录未收录2024-05-01 · model_announcementLLM Stats
GPT-4o mini0.87未收录未收录2024-07-18 · model_announcementLLM Stats
Llama 3.2 90B Instruct0.869未收录未收录2024-09-25 · model_announcementLLM Stats
Claude 3.5 Haiku0.856未收录未收录2024-10-22 · model_announcementLLM Stats
Qwen3 235B A22B0.8353未收录未收录2025-04-29 · model_announcementLLM Stats
Claude 3 Sonnet0.835未收录未收录2024-02-29 · model_announcementLLM Stats
Gemini 1.5 Flash0.826未收录未收录2024-05-01 · model_announcementLLM Stats
Phi 40.806未收录未收录2024-12-12 · model_announcementLLM Stats
Claude 3 Haiku0.751未收录未收录2024-03-13 · model_announcementLLM Stats
GPT-40.745未收录未收录2023-06-13 · model_announcementLLM Stats
Llama 3.2 11B Instruct0.689未收录未收录2024-09-25 · model_announcementLLM Stats
Gemma 3n E4B Instructed0.67未收录未收录2025-06-26 · model_announcementLLM Stats
Phi 4 Mini0.639未收录未收录2025-02-01 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.607未收录未收录2025-05-20 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.587未收录未收录2024-08-23 · model_announcementLLM Stats
Llama 3.2 3B Instruct0.582未收录未收录2024-09-25 · model_announcementLLM Stats
GPT-3.5 Turbo0.563未收录未收录2023-03-21 · model_announcementLLM Stats
Gemma 3n E2B Instructed0.531未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.531未收录未收录2025-05-20 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.479未收录未收录2024-08-23 · model_announcementLLM Stats