AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

TextVQA

TextVQA contains 45,336 questions on 28,408 images that require reasoning about text to answer. Introduced to benchmark VQA models' ability to read and reason about text within images, particularly for assistive technologies for visually impaired users. The dataset addresses the gap where existing VQA datasets had few text-based questions or were too small.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 16

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen2-VL-72B-Instruct0.855Not recordedNot recorded2024-08-29 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.849Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.844Not recordedNot recorded2025-03-27 · model_announcementLLM Stats
LFM2.5-VL-3B0.843Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
DeepSeek VL20.842Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Small0.834Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Nova Pro0.815Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.807Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Nova Lite0.802Not recordedNot recorded2024-11-20 · model_announcementLLM Stats
Grok-1.5V0.781Not recordedNot recorded2024-04-12 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.756Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
Llama 3.2 90B Instruct0.735Not recordedNot recorded2024-09-25 · model_announcementLLM Stats
Phi-3.5-vision-instruct0.72Not recordedNot recorded2024-08-23 · model_announcementLLM Stats
Gemma 3 12B0.677Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 27B0.651Not recordedNot recorded2025-03-12 · model_announcementLLM Stats
Gemma 3 4B0.578Not recordedNot recorded2025-03-12 · model_announcementLLM Stats