AI benchmarks and leaderboards are different things
Learn the difference between a benchmark, an evaluation run and a leaderboard, and use each to answer the right question.
LLM Stats
ChartQA
ChartQA is a large-scale benchmark comprising 9.6K human-written questions and 23.1K questions generated from human-written chart summaries, designed to evaluate models' abilities in visual and logical reasoning over charts.
Evaluation context and evidence
- Source
- LLM Stats
- Publisher
- Not recorded
- Benchmark release
- Not recorded
- Collected
- 2026-08-17
- Modality
- multimodal
These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.
Original sources
Reported results 26
Shown in source observation order, not ranked. Dates retain the precision provided by the source.
| Model | Value | Unit | Protocol | Reported date and basis | Source |
|---|---|---|---|---|---|
| Claude 3.5 Sonnet | 0.908 | Not recorded | Not recorded | 2024-10-22 · model_announcement | LLM Stats |
| Llama 4 Maverick | 0.9 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Qwen2.5 VL 72B Instruct | 0.895 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Nova Pro | 0.892 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| Llama 4 Scout | 0.888 | Not recorded | Not recorded | 2025-04-05 · model_announcement | LLM Stats |
| Qwen2-VL-72B-Instruct | 0.883 | Not recorded | Not recorded | 2024-08-29 · model_announcement | LLM Stats |
| Pixtral Large | 0.881 | Not recorded | Not recorded | 2024-11-18 · model_announcement | LLM Stats |
| Mistral Small 3.2 24B Instruct | 0.874 | Not recorded | Not recorded | 2025-06-20 · model_announcement | LLM Stats |
| Qwen2.5 VL 7B Instruct | 0.873 | Not recorded | Not recorded | 2025-01-26 · model_announcement | LLM Stats |
| Nova Lite | 0.868 | Not recorded | Not recorded | 2024-11-20 · model_announcement | LLM Stats |
| DeepSeek VL2 | 0.86 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| GPT-4o | 0.857 | Not recorded | Not recorded | 2024-08-06 · model_announcement | LLM Stats |
| Llama 3.2 90B Instruct | 0.855 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Qwen2.5-Omni-7B | 0.853 | Not recorded | Not recorded | 2025-03-27 · model_announcement | LLM Stats |
| DeepSeek VL2 Small | 0.845 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| Llama 3.2 11B Instruct | 0.834 | Not recorded | Not recorded | 2024-09-25 · model_announcement | LLM Stats |
| Pixtral-12B | 0.818 | Not recorded | Not recorded | 2024-09-17 · model_announcement | LLM Stats |
| Phi-3.5-vision-instruct | 0.818 | Not recorded | Not recorded | 2024-08-23 · model_announcement | LLM Stats |
| Phi-4-multimodal-instruct | 0.814 | Not recorded | Not recorded | 2025-02-01 · model_announcement | LLM Stats |
| LFM2.5-VL-3B | 0.813 | Not recorded | Not recorded | 2026-08-12 · model_announcement | LLM Stats |
| DeepSeek VL2 Tiny | 0.81 | Not recorded | Not recorded | 2024-12-13 · model_announcement | LLM Stats |
| North Micro Vision Instruct | 0.808 | Not recorded | Not recorded | 2026-08-12 · model_announcement | LLM Stats |
| Gemma 3 27B | 0.78 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Grok-1.5V | 0.761 | Not recorded | Not recorded | 2024-04-12 · model_announcement | LLM Stats |
| Gemma 3 12B | 0.757 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |
| Gemma 3 4B | 0.688 | Not recorded | Not recorded | 2025-03-12 · model_announcement | LLM Stats |