AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

InfoVQAtest

InfoVQA test set with infographic images requiring joint reasoning over document layout, textual content, graphical elements, and data visualizations with elementary reasoning and arithmetic skills

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 12

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2.50.926Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.895Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.892Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.892Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.87Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.86Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.86Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2-VL-72B-Instruct0.845Not recordedNot recorded2024-08-29 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.831Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.83Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.82Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.803Not recordedNot recorded2025-09-22 · model_announcementLLM Stats