AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

OmniDocBench 1.5

OmniDocBench 1.5 is a comprehensive benchmark for evaluating multimodal large language models on document understanding tasks, including OCR, document parsing, information extraction, and visual question answering across diverse document types. Lower Overall Edit Distance scores are better.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 18

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
MiniMax M30.916Not recordedNot recorded2026-06-01 · model_announcementLLM Stats
Qwen3.7-Plus0.914Not recordedNot recorded2026-05-31 · model_announcementLLM Stats
Qwen3.6 Plus0.912Not recordedNot recorded2026-04-02 · model_announcementLLM Stats
Qwen3.8-27B0.911Not recordedNot recorded2026-08-14 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.899Not recordedNot recorded2026-04-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.898Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.893Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
GPT-5.40.891Not recordedNot recorded2026-03-05 · model_announcementLLM Stats
Qwen3.5-27B0.889Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Kimi K2.50.888Not recordedNot recorded2026-01-27 · model_announcementLLM Stats
GPT-5.5 Instant0.875Not recordedNot recorded2026-05-05 · model_announcementLLM Stats
GPT-5.4 mini0.8737Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
GPT-5.4 nano0.7581Not recordedNot recorded2026-03-17 · model_announcementLLM Stats
Muse Glimmer-30B0.758Not recordedNot recorded2026-08-10 · model_announcementLLM Stats
DiffusionGemma 26B-A4B0.319Not recordedNot recorded2026-06-10 · model_announcementLLM Stats
Gemma 4 12B0.164Not recordedNot recorded2026-05-23 · model_announcementLLM Stats
Gemini 3 Flash0.121Not recordedNot recorded2025-12-17 · model_announcementLLM Stats
Gemini 3 Pro0.115Not recordedNot recorded2025-11-18 · model_announcementLLM Stats