AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

AI2D

AI2D is a dataset of 4,903 illustrative diagrams from grade school natural sciences (such as food webs, human physiology, and life cycles) with over 15,000 multiple choice questions and answers. The benchmark evaluates diagram understanding and visual reasoning capabilities, requiring models to interpret diagrammatic elements, relationships, and structure to answer questions about scientific concepts represented in visual form.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
multimodal

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 33

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude 3.5 Sonnet0.947未收录未收录2024-10-22 · model_announcementLLM Stats
Qwen3.6 Plus0.944未收录未收录2026-04-02 · model_announcementLLM Stats
GPT-4o0.942未收录未收录2024-08-06 · model_announcementLLM Stats
Pixtral Large0.938未收录未收录2024-11-18 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.933未收录未收录2026-02-24 · model_announcementLLM Stats
Mistral Small 3.2 24B Instruct0.9291未收录未收录2025-06-20 · model_announcementLLM Stats
Qwen3.5-27B0.929未收录未收录2026-02-24 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.927未收录未收录2026-04-16 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.926未收录未收录2026-02-24 · model_announcementLLM Stats
Llama 3.2 90B Instruct0.923未收录未收录2024-09-25 · model_announcementLLM Stats
Llama 3.2 11B Instruct0.911未收录未收录2024-09-25 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.897未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.895未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.892未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.889未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen2.5 VL 72B Instruct0.884未收录未收录2025-01-26 · model_announcementLLM Stats
Grok-1.5V0.883未收录未收录2024-04-12 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.869未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.857未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.85未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.849未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.849未收录未收录2025-09-22 · model_announcementLLM Stats
Gemma 3 27B0.845未收录未收录2025-03-12 · model_announcementLLM Stats
Gemma 3 12B0.842未收录未收录2025-03-12 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.841未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.832未收录未收录2025-03-27 · model_announcementLLM Stats
Phi-4-multimodal-instruct0.823未收录未收录2025-02-01 · model_announcementLLM Stats
DeepSeek VL20.814未收录未收录2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Small0.8未收录未收录2024-12-13 · model_announcementLLM Stats
Phi-3.5-vision-instruct0.781未收录未收录2024-08-23 · model_announcementLLM Stats
North Micro Vision Instruct0.775未收录未收录2026-08-12 · model_announcementLLM Stats
Gemma 3 4B0.748未收录未收录2025-03-12 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.716未收录未收录2024-12-13 · model_announcementLLM Stats