AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

AIME 2024

American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 53

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Grok-3 Mini0.958未收录未收录2025-02-17 · model_announcementLLM Stats
o4-mini0.934未收录未收录2025-04-16 · model_announcementLLM Stats
LongCat-Flash-Thinking0.933未收录未收录2025-09-22 · model_announcementLLM Stats
Grok-30.933未收录未收录2025-02-17 · model_announcementLLM Stats
Gemini 2.5 Pro0.92未收录未收录2025-05-20 · model_announcementLLM Stats
o30.916未收录未收录2025-04-16 · model_announcementLLM Stats
DeepSeek-R1-05280.914未收录未收录2025-05-28 · model_announcementLLM Stats
GLM-4.50.91未收录未收录2025-07-28 · model_announcementLLM Stats
Ministral 3 (14B Reasoning 2512)0.898未收录未收录2025-12-04 · model_announcementLLM Stats
GLM-4.5-Air0.894未收录未收录2025-07-28 · model_announcementLLM Stats
Gemini 2.5 Flash0.88未收录未收录2025-05-20 · model_announcementLLM Stats
o3-mini0.873未收录未收录2025-01-30 · model_announcementLLM Stats
DeepSeek R1 Distill Llama 70B0.867未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek R1 Zero0.867未收录未收录2025-01-20 · model_announcementLLM Stats
Ministral 3 (8B Reasoning 2512)0.86未收录未收录2025-12-04 · model_announcementLLM Stats
MiniMax M1 80K0.86未收录未收录2025-06-16 · model_announcementLLM Stats
o1-pro0.86未收录未收录2024-12-17 · model_announcementLLM Stats
Qwen3 235B A22B0.857未收录未收录2025-04-29 · model_announcementLLM Stats
MiniCPM-SALA0.8375未收录未收录2026-02-11 · model_announcementLLM Stats
MiniMax M1 40K0.833未收录未收录2025-06-16 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 7B0.833未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 32B0.833未收录未收录2025-01-20 · model_announcementLLM Stats
Qwen3 32B0.814未收录未收录2025-04-29 · model_announcementLLM Stats
Phi 4 Reasoning Plus0.813未收录未收录2025-04-30 · model_announcementLLM Stats
Granite 3.3 8B Base0.812未收录未收录2025-04-16 · model_announcementLLM Stats
Granite 3.3 8B Instruct0.812未收录未收录2025-04-16 · model_announcementLLM Stats
Qwen3 30B A3B0.804未收录未收录2025-04-29 · model_announcementLLM Stats
Claude 3.7 Sonnet0.8未收录未收录2025-02-24 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 14B0.8未收录未收录2025-01-20 · model_announcementLLM Stats
DeepSeek R1 Distill Llama 8B0.8未收录未收录2025-01-20 · model_announcementLLM Stats
QwQ-32B0.795未收录未收录2025-03-05 · model_announcementLLM Stats
Min istral 3 (3B Reasoning 2512)0.775未收录未收录2025-12-04 · model_announcementLLM Stats
Kimi-k1.50.775未收录未收录2025-01-20 · model_announcementLLM Stats
Phi 4 Reasoning0.753未收录未收录2025-04-30 · model_announcementLLM Stats
o10.743未收录未收录2024-12-17 · model_announcementLLM Stats
Magistral Medium0.736未收录未收录2025-06-10 · model_announcementLLM Stats
Gemini 2.0 Flash Thinking0.733未收录未收录2025-01-21 · model_announcementLLM Stats
LongCat-Flash-Lite0.7219未收录未收录2026-02-05 · model_announcementLLM Stats
Kimi K2 09050.72未收录未收录2025-09-05 · model_announcementLLM Stats
Magistral Small 25060.7068未收录未收录2025-06-10 · model_announcementLLM Stats
Kimi K2-Instruct-09050.696未收录未收录2025-09-05 · model_announcementLLM Stats
Kimi K2 Instruct0.696未收录未收录2025-07-11 · model_announcementLLM Stats
DeepSeek-V3.10.663未收录未收录2025-01-10 · model_announcementLLM Stats
DeepSeek-V3 03240.594未收录未收录2025-03-25 · model_announcementLLM Stats
DeepSeek R1 Distill Qwen 1.5B0.527未收录未收录2025-01-20 · model_announcementLLM Stats
QwQ-32B-Preview0.5未收录未收录2024-11-28 · model_announcementLLM Stats
GPT-4.1 mini0.496未收录未收录2025-04-14 · model_announcementLLM Stats
GPT-4.10.481未收录未收录2025-04-14 · model_announcementLLM Stats
o1-preview0.42未收录未收录2024-09-12 · model_announcementLLM Stats
DeepSeek-V30.392未收录未收录2024-12-25 · model_announcementLLM Stats
GPT-4.50.367未收录未收录2025-02-27 · model_announcementLLM Stats
GPT-4.1 nano0.294未收录未收录2025-04-14 · model_announcementLLM Stats
GPT-4o0.131未收录未收录2024-08-06 · model_announcementLLM Stats