AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE
Benchmark Radar.Benchmarks. Model results. Original sources.
/

LLM Stats

MMMU (validation)

Validation set of the Massive Multi-discipline Multimodal Understanding and Reasoning benchmark. Features college-level multimodal questions across 6 core disciplines (Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, Tech & Engineering) spanning 30 subjects and 183 subfields with diverse image types including charts, diagrams, maps, and tables.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Claude Opus 4.50.807Not recordedNot recorded2025-11-24 · model_announcementLLM Stats
Claude Opus 4.10.771Not recordedNot recorded2025-08-05 · model_announcementLLM Stats
Claude Opus 40.765Not recordedNot recorded2025-05-22 · model_announcementLLM Stats
Claude Haiku 4.50.732Not recordedNot recorded2025-10-15 · model_announcementLLM Stats

Put this benchmark in context

Multimodal benchmarksReasoning and math benchmarksMedical benchmarks