AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MathVista

MathVista evaluates mathematical reasoning of foundation models in visual contexts. It consists of 6,141 examples derived from 28 existing multimodal datasets and 3 newly created datasets (IQTest, FunctionQA, and PaperQA), combining challenges from diverse mathematical and visual tasks to assess models' ability to understand complex figures and perform rigorous reasoning.

评测信息与证据

来源
LLM Stats
发布者
University of California, Los Angeles
评测发布日期
2023-10-03
采集日期
2026-08-17
模态
multimodal

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 39

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Seed 2.1 Pro0.907未收录未收录2026-06-24 · model_announcementLLM Stats
Seed 2.1 Turbo0.905未收录未收录2026-06-24 · model_announcementLLM Stats
o30.868未收录未收录2025-04-16 · model_announcementLLM Stats
o4-mini0.843未收录未收录2025-04-16 · model_announcementLLM Stats
Step3-VL-10B0.84未收录未收录2026-01-15 · model_announcementLLM Stats
Command A+0.806未收录未收录2026-05-20 · model_announcementLLM Stats
Kimi-k1.50.749未收录未收录2025-01-20 · model_announcementLLM Stats
Llama 4 Maverick0.737未收录未收录2025-04-05 · model_announcementLLM Stats
GPT-4.1 mini0.731未收录未收录2025-04-14 · model_announcementLLM Stats
GPT-4.50.723未收录未收录2025-02-27 · model_announcementLLM Stats
GPT-4.10.722未收录未收录2025-04-14 · model_announcementLLM Stats
o10.718未收录未收录2024-12-17 · model_announcementLLM Stats
QvQ-72B-Preview0.714未收录未收录2024-12-25 · model_announcementLLM Stats
Llama 4 Scout0.707未收录未收录2025-04-05 · model_announcementLLM Stats
Pixtral Large0.694未收录未收录2024-11-18 · model_announcementLLM Stats
Grok-20.69未收录未收录2024-08-13 · model_announcementLLM Stats
Grok-2 mini0.681未收录未收录2024-08-13 · model_announcementLLM Stats
Gemini 1.5 Pro0.681未收录未收录2024-05-01 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.679未收录未收录2025-03-27 · model_announcementLLM Stats
Claude 3.5 Sonnet0.677未收录未收录2024-10-22 · model_announcementLLM Stats
Mistral Small 3.2 24B Instruct0.6709未收录未收录2025-06-20 · model_announcementLLM Stats
Gemini 1.5 Flash0.658未收录未收录2024-05-01 · model_announcementLLM Stats
GPT-4o0.638未收录未收录2024-05-13 · model_announcementLLM Stats
DeepSeek VL20.628未收录未收录2024-12-13 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.624未收录未收录2025-02-01 · model_announcementLLM Stats
GPT-4o0.614未收录未收录2024-08-06 · model_announcementLLM Stats
DeepSeek VL2 Small0.607未收录未收录2024-12-13 · model_announcementLLM Stats
Pixtral-12B0.58未收录未收录2024-09-17 · model_announcementLLM Stats
Llama 3.2 90B Instruct0.573未收录未收录2024-09-25 · model_announcementLLM Stats
GPT-4o mini0.567未收录未收录2024-07-18 · model_announcementLLM Stats
GPT-4.1 nano0.562未收录未收录2025-04-14 · model_announcementLLM Stats
Gemini 1.5 Flash 8B0.547未收录未收录2024-03-15 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.536未收录未收录2024-12-13 · model_announcementLLM Stats
Grok-1.5V0.528未收录未收录2024-04-12 · model_announcementLLM Stats
Grok-1.50.528未收录未收录2024-03-28 · model_announcementLLM Stats
Llama 3.2 11B Instruct0.515未收录未收录2024-09-25 · model_announcementLLM Stats
Gemini 1.0 Pro0.466未收录未收录2024-02-15 · model_announcementLLM Stats
Phi-3.5-vision-instruct0.439未收录未收录2024-08-23 · model_announcementLLM Stats
GPT-3.5 Turbo0.0未收录未收录2023-03-21 · model_announcementLLM Stats

其他来源中的相关记录