AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
A dataset for Visual Question Answering on document images containing 50,000 questions defined on 12,000+ document images. The benchmark tests AI's ability to understand document structure and content, requiring models to comprehend document layout and perform information retrieval to answer questions about document images.
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Qwen2.5 VL 72B Instruct | 0.964 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Qwen2.5 VL 7B Instruct | 0.957 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Qwen2.5-Omni-7B | 0.952 | Not recorded | Not recorded | 2025-03-27 · model_announcement | LLM Stats |
| Claude 3.5 Sonnet | 0.952 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Mistral Small 3.2 24B Instruct | 0.9486 | Not recorded | Not recorded | 2025-06-20 · model_announcement | LLM Stats |
| Qwen2.5 VL 32B Instruct | 0.948 | Not recorded | Not recorded | 2025-02-28 · model_announcement | LLM Stats |
| Llama 4 Scout | 0.944 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Llama 4 Maverick | 0.944 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Grok-2 | 0.936 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| Nova Pro | 0.935 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| DeepSeek VL2 | 0.933 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Pixtral Large | 0.933 | Not recorded | Not recorded | 2024-11-18 · model_announcement | LLM Stats |
| Phi-4-multimodal-instruct | 0.932 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| Grok-2 mini | 0.932 | Not recorded | Not recorded | 2024-08-13 · model_announcement | LLM Stats |
| GPT-4o | 0.928 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| Nova Lite | 0.924 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| DeepSeek VL2 Small | 0.923 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| North Micro Vision Instruct | 0.921 | Not recorded | Not recorded | 2026-08-12 · model_announcement | LLM Stats |
| LFM2.5-VL-3B | 0.911 | Not recorded | Not recorded | 2026-08-12 · model_announcement | LLM Stats |
| Pixtral-12B | 0.907 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| Llama 3.2 90B Instruct | 0.901 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| DeepSeek VL2 Tiny | 0.889 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Llama 3.2 11B Instruct | 0.884 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Gemma 3 12B | 0.871 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Gemma 3 27B | 0.866 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Grok-1.5V | 0.856 | Not recorded | Not recorded | 2024-04-12 · model_announcement | LLM Stats |
| Grok-1.5 | 0.856 | Not recorded | Not recorded | 2024-03-28 · model_announcement | LLM Stats |
| Gemma 3 4B | 0.758 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |