AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MathVista-Mini

MathVista-Mini is a smaller version of the MathVista benchmark that evaluates mathematical reasoning in visual contexts. It consists of examples derived from multimodal datasets involving mathematics, combining challenges from diverse mathematical and visual tasks to assess foundation models' ability to solve problems requiring both visual understanding and mathematical reasoning.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 24

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2.50.901Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
Qwen3.5-27B0.878Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.6-27B0.874Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.874Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.864Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.862Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.859Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.858Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.849Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.838Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.819Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.814Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.801Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.795Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.772Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 72B Instruct0.748Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.747Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.737Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2-VL-72B-Instruct0.705Not recordedNot recorded2024-08-29 · model_announcementLLM Stats
LFM2.5-VL-3B0.685Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.682Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Gemma 3 27B0.676Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 12B0.629Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 4B0.5Not recordedNot recorded2025-03-12 · model_announcementLLM Stats

Related records in other sources