AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

ARC-C

The AI2 Reasoning Challenge (ARC) Challenge Set is a multiple-choice question-answering benchmark containing grade-school level science questions that require advanced reasoning capabilities. ARC-C specifically contains questions that were answered incorrectly by both retrieval-based and word co-occurrence algorithms, making it a particularly challenging subset designed to test commonsense reasoning abilities in AI systems.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
2018-03-14
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 34

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
MiMo-V2.5-Pro0.972未收录未收录2026-04-27 · model_announcementLLM Stats
Llama 3.1 405B Instruct0.969未收录未收录2024-07-23 · model_announcementLLM Stats
Claude 3 Opus0.964未收录未收录2024-02-29 · model_announcementLLM Stats
Nova Pro0.948未收录未收录2024-11-20 · model_announcementLLM Stats
Llama 3.1 70B Instruct0.948未收录未收录2024-07-23 · model_announcementLLM Stats
Claude 3 Sonnet0.932未收录未收录2024-02-29 · model_announcementLLM Stats
Jamba 1.5 Large0.93未收录未收录2024-08-22 · model_announcementLLM Stats
Nova Lite0.924未收录未收录2024-11-20 · model_announcementLLM Stats
Mistral Small 3 24B Base0.9129未收录未收录2025-01-30 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.91未收录未收录2024-08-23 · model_announcementLLM Stats
Nova Micro0.902未收录未收录2024-11-20 · model_announcementLLM Stats
Claude 3 Haiku0.892未收录未收录2024-03-13 · model_announcementLLM Stats
Jamba 1.5 Mini0.857未收录未收录2024-08-22 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.846未收录未收录2024-08-23 · model_announcementLLM Stats
Phi 4 Mini0.837未收录未收录2025-02-01 · model_announcementLLM Stats
Llama 3.1 8B Instruct0.834未收录未收录2024-07-23 · model_announcementLLM Stats
Llama 3.2 3B Instruct0.786未收录未收录2024-09-25 · model_announcementLLM Stats
Ministral 8B Instruct0.719未收录未收录2024-10-16 · model_announcementLLM Stats
Gemma 2 27B0.714未收录未收录2024-06-27 · model_announcementLLM Stats
Command R+0.7099未收录未收录2024-08-30 · model_announcementLLM Stats
Qwen2.5-Coder 32B Instruct0.705未收录未收录2024-09-19 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.704未收录未收录2024-09-19 · model_announcementLLM Stats
Llama 3.1 Nemotron 70B Instruct0.692未收录未收录2024-10-01 · model_announcementLLM Stats
Qwen2 72B Instruct0.689未收录未收录2024-07-23 · model_announcementLLM Stats
Gemma 2 9B0.684未收录未收录2024-06-27 · model_announcementLLM Stats
Qwen2.5 14B Instruct0.673未收录未收录2024-09-19 · model_announcementLLM Stats
Hermes 3 70B0.6553未收录未收录2024-08-15 · model_announcementLLM Stats
Gemma 3n E4B0.616未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.616未收录未收录2025-05-20 · model_announcementLLM Stats
Qwen2.5-Coder 7B Instruct0.609未收录未收录2024-09-19 · model_announcementLLM Stats
Gemma 3n E2B0.517未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.517未收录未收录2025-05-20 · model_announcementLLM Stats
Granite 3.3 8B Base0.5084未收录未收录2025-04-16 · model_announcementLLM Stats
ERNIE 4.50.406未收录未收录2025-06-25 · model_announcementLLM Stats

其他来源中的相关记录