AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

VLMsAreBlind

A vision-language benchmark that probes blind spots and brittle reasoning in multimodal models.

Evaluation context and evidence

Source
LLM Stats
Publisher
Not recorded
Benchmark release
Not recorded
Collected
2026-08-17
Modality
multimodal

These are source-reported observations, not independent reruns by this site. Check the task version, evaluation protocol, unit and reporting date before comparing models. Results from different setups are not a universal ranking.

Original sources

Reported results 4

Shown in source observation order, not ranked. Dates retain the precision provided by the source.

ModelValueUnitProtocolReported date and basisSource
Qwen3.6-27B0.97Not recordedNot recorded2026-04-21 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.97Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-27B0.969Not recordedNot recorded2026-02-24 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.967Not recordedNot recorded2026-02-24 · model_announcementLLM Stats