AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

DocVQA

A dataset for Visual Question Answering on document images containing 50,000 questions defined on 12,000+ document images. The benchmark tests AI's ability to understand document structure and content, requiring models to comprehend document layout and perform information retrieval to answer questions about document images.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 28

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen2.5 VL 72B Instruct0.964Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.957Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.952Not recordedNot recorded2025-03-27 · model_announcementLLM Stats
Claude 3.5 Sonnet0.952Not recordedNot recorded2024-10-22 · model_announcementLLM Stats
Mistral Small 3.2 24B Instruct0.9486Not recordedNot recorded2025-06-20 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.948Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Llama 4 Scout0.944Not recordedNot recorded2025-04-05 · model_announcementLLM Stats
Llama 4 Maverick0.944Not recordedNot recorded2025-04-05 · model_announcementLLM Stats
Grok-20.936Not recordedNot recorded2024-08-13 · model_announcementLLM Stats
Nova Pro0.935Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
DeepSeek VL20.933Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Pixtral Large0.933Not recordedNot recorded2024-11-18 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.932Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Grok-2 mini0.932Not recordedNot recorded2024-08-13 · model_announcementLLM Stats
GPT-4o0.928Not recordedNot recorded2024-08-06 · model_announcementLLM Stats
Nova Lite0.924Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
DeepSeek VL2 Small0.923Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
North Micro Vision Instruct0.921Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
LFM2.5-VL-3B0.911Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Pixtral-12B0.907Not recordedNot recorded2024-09-17 · model_announcementLLM Stats
Llama 3.2 90B Instruct0.901Not recordedNot recorded2024-09-25 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.889Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Llama 3.2 11B Instruct0.884Not recordedNot recorded2024-09-25 · model_announcementLLM Stats
Gemma 3 12B0.871Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 27B0.866Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Grok-1.5V0.856Not recordedNot recorded2024-04-12 · model_announcementLLM Stats
Grok-1.50.856Not recordedNot recorded2024-03-28 · model_announcementLLM Stats
Gemma 3 4B0.758Not recordedNot recorded2025-03-12 · model_announcementLLM Stats