AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

OCRBench

OCRBench: Comprehensive evaluation benchmark for assessing Optical Character Recognition (OCR) capabilities in Large Multimodal Models across text recognition, scene text VQA, and document understanding tasks

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
2024-01-17
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 24

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Kimi K2.50.923Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.921Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.92Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.91Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.903Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.896Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.895Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.6-27B0.894Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-27B0.894Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen2.5 VL 72B Instruct0.885Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.881Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2-VL-72B-Instruct0.877Not recordedNot recorded2024-08-29 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.875Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.864Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.855Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.844Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
LFM2.5-VL-3B0.842Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.839Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
DeepSeek VL2 Small0.834Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.819Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
DeepSeek VL20.811Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.809Not recordedNot recorded2024-12-13 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.808Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
North Micro Vision Instruct0.792Not recordedNot recorded2026-08-12 · model_announcementLLM Stats

Related records in other sources