AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

CC-OCR

A comprehensive OCR benchmark for evaluating Large Multimodal Models (LMMs) in literacy. Comprises four OCR-centric tracks: multi-scene text reading, multilingual text reading, document parsing, and key information extraction. Contains 39 subsets with 7,058 fully annotated images, 41% sourced from real applications. Tests capabilities including text grounding, multi-orientation text recognition, and detecting hallucination/repetition across diverse visual challenges.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 18

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.6 Plus0.834Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.822Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.819Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.818Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.815Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3.6-27B0.812Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-27B0.81Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.807Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.807Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.803Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.799Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 72B Instruct0.798Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.778Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 7B Instruct0.778Not recordedNot recorded2025-01-26 · model_announcementLLM Stats
Qwen2.5 VL 32B Instruct0.771Not recordedNot recorded2025-02-28 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.763Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.762Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.738Not recordedNot recorded2025-09-22 · model_announcementLLM Stats