AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMBench

A bilingual benchmark for assessing multi-modal capabilities of vision-language models through multiple-choice questions in both English and Chinese, providing systematic evaluation across diverse vision-language tasks with robust metrics.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 9

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Step3-VL-10B0.918Not recordedNot recorded2026-01-15 · model_announcementLLM Stats
Qwen2.5 VL 72B Instruct0.88Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.867Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Qwen2-VL-72B-Instruct0.865Not recordedNot recorded2024-08-29 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.843Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Phi-3.5-vision-instruct0.819Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
DeepSeek VL2 Small0.803Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL20.796Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.692Not recordedNot recorded2024-12-13 · model_announcementLLM Stats