AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MMVet

MM-Vet is an evaluation benchmark that examines large multimodal models on complicated multimodal tasks requiring integrated capabilities. It assesses six core vision-language capabilities: recognition, knowledge, spatial awareness, language generation, OCR, and math through questions that require one or more of these capabilities.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 2

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen2.5 VL 72B Instruct0.7619Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.671Not recordedNot recorded2025-01-26 · model_announcementLLM Stats