AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

HellaSwag

A challenging commonsense natural language inference dataset that uses Adversarial Filtering to create questions trivial for humans (>95% accuracy) but difficult for state-of-the-art models, requiring completion of sentence endings based on physical situations and everyday activities

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
2019-05-19
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 27

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Claude 3 Opus0.954未收录未收录2024-02-29 · model_announcementLLM Stats
GPT-40.953未收录未收录2023-06-13 · model_announcementLLM Stats
Gemini 1.5 Pro0.933未收录未收录2024-05-01 · model_announcementLLM Stats
MiMo-V2.5-Pro0.898未收录未收录2026-04-27 · model_announcementLLM Stats
Claude 3 Sonnet0.89未收录未收录2024-02-29 · model_announcementLLM Stats
Command R+0.886未收录未收录2024-08-30 · model_announcementLLM Stats
Hermes 3 70B0.8819未收录未收录2024-08-15 · model_announcementLLM Stats
Qwen2 72B Instruct0.876未收录未收录2024-07-23 · model_announcementLLM Stats
Gemini 1.5 Flash0.865未收录未收录2024-05-01 · model_announcementLLM Stats
Gemma 2 27B0.864未收录未收录2024-06-27 · model_announcementLLM Stats
Claude 3 Haiku0.859未收录未收录2024-03-13 · model_announcementLLM Stats
Llama 3.1 Nemotron 70B Instruct0.8558未收录未收录2024-10-01 · model_announcementLLM Stats
Qwen2.5 32B Instruct0.852未收录未收录2024-09-19 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.838未收录未收录2024-08-23 · model_announcementLLM Stats
Mistral NeMo Instruct0.835未收录未收录2024-07-18 · model_announcementLLM Stats
Qwen2.5-Coder 32B Instruct0.83未收录未收录2024-09-19 · model_announcementLLM Stats
Gemma 2 9B0.819未收录未收录2024-06-27 · model_announcementLLM Stats
Granite 3.3 8B Base0.801未收录未收录2025-04-16 · model_announcementLLM Stats
Gemma 3n E4B0.786未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.786未收录未收录2025-05-20 · model_announcementLLM Stats
Qwen2.5-Coder 7B Instruct0.768未收录未收录2024-09-19 · model_announcementLLM Stats
Gemma 3n E2B0.722未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.722未收录未收录2025-05-20 · model_announcementLLM Stats
Llama 3.2 3B Instruct0.698未收录未收录2024-09-25 · model_announcementLLM Stats
Phi-3.5-mini-instruct0.694未收录未收录2024-08-23 · model_announcementLLM Stats
Phi 4 Mini0.691未收录未收录2025-02-01 · model_announcementLLM Stats
ERNIE 4.50.33未收录未收录2025-06-25 · model_announcementLLM Stats

其他来源中的相关记录