AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
MathVista
MathVista evaluates mathematical reasoning of foundation models in visual contexts. It consists of 6,141 examples derived from 28 existing multimodal datasets and 3 newly created datasets (IQTest, FunctionQA, and PaperQA), combining challenges from diverse mathematical and visual tasks to assess models' ability to understand complex figures and perform rigorous reasoning.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- University of California, Los Angeles
- Benchmark release
- 2023-10-03
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 39
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Seed 2.1 Pro | 0.907 | Not recorded | Not recorded | 2026-06-24 · model_announcement | LLM Stats |
| Seed 2.1 Turbo | 0.905 | Not recorded | Not recorded | 2026-06-24 · model_announcement | LLM Stats |
| o3 | 0.868 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| o4-mini | 0.843 | Not recorded | Not recorded | 2025-04-16 · model_announcement | LLM Stats |
| Step3-VL-10B | 0.84 | Not recorded | Not recorded | 2026-01-15 · model_announcement | LLM Stats |
| Command A+ | 0.806 | Not recorded | Not recorded | 2026-05-20 · model_announcement | LLM Stats |
| Kimi-k1.5 | 0.749 | Not recorded | Not recorded | 2025-01-20 · model_announcement | LLM Stats |
| Llama 4 Maverick | 0.737 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| GPT-4.1 mini | 0.731 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| GPT-4.5 | 0.723 | Not recorded | Not recorded | 2025-02-27 · model_announcement | LLM Stats |
| GPT-4.1 | 0.722 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| o1 | 0.718 | Not recorded | Not recorded | 2024-12-17 · model_announcement | LLM Stats |
| QvQ-72B-Preview | 0.714 | Not recorded | Not recorded | 2024-12-25 · model_announcement | LLM Stats |
| Llama 4 Scout | 0.707 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Pixtral Large | 0.694 | Not recorded | Not recorded | 2024-11-18 · model_announcement | LLM Stats |
| Grok-2 | 0.69 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Grok-2 mini | 0.681 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Gemini 1.5 Pro | 0.681 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| Qwen2.5-Omni-7B | 0.679 | Not recorded | Not recorded | 2025-03-27 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.677 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Mistral Small 3.2 24B Instruct | 0.6709 | Not recorded | Not recorded | 2025-06-20 · model_announcement | LLM Stats |
| Gemini 1.5 Flash | 0.658 | Not recorded | Not recorded | 2024-05-01 · model_announcement | LLM Stats |
| GPT-4o | 0.638 | Not recorded | Not recorded | 2024-05-13 · model_announcement | LLM Stats |
| DeepSeek VL2 | 0.628 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Phi-4-multimodal-instruct | 0.624 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| GPT-4o | 0.614 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| DeepSeek VL2 Small | 0.607 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Pixtral-12B | 0.58 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| Llama 3.2 90B Instruct | 0.573 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| GPT-4o mini | 0.567 | Not recorded | Not recorded | 2024-07-18 · model_announcement | LLM Stats |
| GPT-4.1 nano | 0.562 | Not recorded | Not recorded | 2025-04-14 · model_announcement | LLM Stats |
| Gemini 1.5 Flash 8B | 0.547 | Not recorded | Not recorded | 2024-03-15 · model_announcement | LLM Stats |
| DeepSeek VL2 Tiny | 0.536 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Grok-1.5V | 0.528 | Not recorded | Not recorded | 2024-04-12 · model_announcement | LLM Stats |
| Grok-1.5 | 0.528 | Not recorded | Not recorded | 2024-03-28 · model_announcement | LLM Stats |
| Llama 3.2 11B Instruct | 0.515 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Gemini 1.0 Pro | 0.466 | Not recorded | Not recorded | 2024-02-15 · model_announcement | LLM Stats |
| Phi-3.5-vision-instruct | 0.439 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| GPT-3.5 Turbo | 0.0 | Not recorded | Not recorded | 2023-03-21 · model_announcement | LLM Stats |