AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

InfoVQA

InfoVQA dataset with 30,000 questions and 5,000 infographic images requiring joint reasoning over document layout, textual content, graphical elements, and data visualizations with elementary reasoning and arithmetic skills

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 10

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen2.5 VL 32B Instruct0.834Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.826Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
DeepSeek VL20.781Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Small0.758Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.727Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Gemma 3 27B0.706Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.661Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
North Micro Vision Instruct0.652Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Gemma 3 12B0.649Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 4B0.5Not recordedNot recorded2025-03-12 · model_announcementLLM Stats