AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMBench-V1.1

Version 1.1 of MMBench, an improved bilingual benchmark for assessing multi-modal capabilities of vision-language models through multiple-choice questions in both English and Chinese, providing systematic evaluation across diverse vision-language tasks.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 20

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.6-35B-A3B0.928Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.928Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-27B0.926Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.6-27B0.923Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.915Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.908Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.906Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.899Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.889Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.875Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.87Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.867Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.851Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.85Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.818Not recordedNot recorded2025-03-27 · model_announcementLLM Stats
LFM2.5-VL-3B0.81Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
DeepSeek VL2 Small0.793Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL20.792Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
North Micro Vision Instruct0.687Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.683Not recordedNot recorded2024-12-13 · model_announcementLLM Stats

Related records in other sources