AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

RealWorldQA

RealWorldQA is a benchmark designed to evaluate basic real-world spatial understanding capabilities of multimodal models. The initial release consists of over 700 anonymized images taken from vehicles and other real-world scenarios, each accompanied by a question and easily verifiable answer. Released by xAI as part of their Grok-1.5 Vision preview to test models' ability to understand natural scenes and spatial relationships in everyday visual contexts.

评测信息与证据

来源
LLM Stats
发布者
XAI
评测发布日期
2024-04-12
采集日期
2026-08-17
模态
multimodal

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 29

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Qwen3.8 Max0.88未收录未收录2026-08-02 · model_announcementLLM Stats
Qwen3.7-Plus0.869未收录未收录2026-05-31 · model_announcementLLM Stats
Seed 2.1 Pro0.867未收录未收录2026-06-24 · model_announcementLLM Stats
Seed 2.1 Turbo0.863未收录未收录2026-06-24 · model_announcementLLM Stats
Qwen3.8-27B0.859未收录未收录2026-08-14 · model_announcementLLM Stats
Qwen3.6 Plus0.854未收录未收录2026-04-02 · model_announcementLLM Stats
Qwen3.6-35B-A3B0.853未收录未收录2026-04-16 · model_announcementLLM Stats
Qwen3.5-122B-A10B0.851未收录未收录2026-02-24 · model_announcementLLM Stats
Qwen3.6-27B0.841未收录未收录2026-04-21 · model_announcementLLM Stats
Qwen3.5-35B-A3B0.841未收录未收录2026-02-24 · model_announcementLLM Stats
Qwen3.5-27B0.837未收录未收录2026-02-24 · model_announcementLLM Stats
Qwen3 VL 235B A22B Thinking0.813未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 235B A22B Instruct0.793未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Instruct0.79未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 32B Thinking0.784未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen2-VL-72B-Instruct0.778未收录未收录2024-08-29 · model_announcementLLM Stats
Qwen3 VL 30B A3B Thinking0.774未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 30B A3B Instruct0.737未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 8B Thinking0.735未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Thinking0.732未收录未收录2025-09-22 · model_announcementLLM Stats
LFM2.5-VL-3B0.731未收录未收录2026-08-12 · model_announcementLLM Stats
Qwen3 VL 8B Instruct0.715未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen3 VL 4B Instruct0.709未收录未收录2025-09-22 · model_announcementLLM Stats
Qwen2.5-Omni-7B0.703未收录未收录2025-03-27 · model_announcementLLM Stats
Grok-1.5V0.687未收录未收录2024-04-12 · model_announcementLLM Stats
DeepSeek VL20.684未收录未收录2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Small0.654未收录未收录2024-12-13 · model_announcementLLM Stats
DeepSeek VL2 Tiny0.642未收录未收录2024-12-13 · model_announcementLLM Stats
North Micro Vision Instruct0.622未收录未收录2026-08-12 · model_announcementLLM Stats

其他来源中的相关记录