AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

MuirBench

A comprehensive benchmark for robust multi-image understanding capabilities of multimodal LLMs. Consists of 12 diverse multi-image tasks involving 10 categories of multi-image relations (e.g., multiview, temporal relations, narrative, complementary). Comprises 11,264 images and 2,600 multiple-choice questions created in a pairwise manner, where each standard instance is paired with an unanswerable variant for reliable assessment.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
multimodal

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 12

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Qwen3 VL 32B Thinking0.803未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.801未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.776未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.768未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.75未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.728未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.728未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.644未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.638未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.629未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.592未收录未收录2025-03-27 · model_announcementLLM Stats
LFM2.5-VL-3B0.583未收录未收录2026-08-12 · model_announcementLLM Stats