AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

BLINK

BLINK: Multimodal Large Language Models Can See but Not Perceive. A benchmark for multimodal language models focusing on core visual perception abilities. Reformats 14 classic computer vision tasks into 3,807 multiple-choice questions paired with single or multiple images and visual prompting. Tasks include relative depth estimation, visual correspondence, forensics detection, multi-view reasoning, counting, object localization, and spatial reasoning that humans can solve 'within a blink'.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 15

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Seed 2.1 Pro0.814Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
Seed 2.1 Turbo0.794Not recordedNot recorded2026-06-24 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.707Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.691Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.687Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.685Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.677Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.673Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.671Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.658Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.654Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.634Not recordedNot recorded2025-09-22 · model_announcementLLM Stats
LFM2.5-VL-3B0.615Not recordedNot recorded2026-08-12 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.613Not recordedNot recorded2025-02-01 · model_announcementLLM Stats
North Micro Vision Instruct0.527Not recordedNot recorded2026-08-12 · model_announcementLLM Stats