AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

VQAv2 (val)

VQAv2 is a balanced Visual Question Answering dataset containing open-ended questions about images that require understanding of vision, language, and commonsense knowledge to answer. VQAv2 addresses bias issues from the original VQA dataset by collecting complementary images such that every question is associated with similar images that result in different answers, forcing models to actually understand visual content rather than relying on language priors.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 3

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Gemma 3 12B0.716Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 27B0.71Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 4B0.624Not recordedNot recorded2025-03-12 · model_announcementLLM Stats