AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

DROP

DROP (Discrete Reasoning Over Paragraphs) is a reading comprehension benchmark requiring discrete reasoning over paragraph content. It contains crowdsourced, adversarially-created questions that require resolving references and performing discrete operations like addition, counting, or sorting, demanding comprehensive paragraph understanding beyond paraphrase-and-entity-typing shortcuts.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
2019-03-01
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 30

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
DeepSeek-V30.916未收录未收录2024-12-25 · model_announcementLLM Stats
Claude 3.5 Sonnet0.871未收录未收录2024-10-22 · model_announcementLLM Stats
Claude 3.5 Sonnet0.871未收录未收录2024-06-21 · model_announcementLLM Stats
MiMo-V2.5-Pro0.863未收录未收录2026-04-27 · model_announcementLLM Stats
GPT-4 Turbo0.86未收录未收录2024-04-09 · model_announcementLLM Stats
Nova Pro0.854未收录未收录2024-11-20 · model_announcementLLM Stats
Llama 3.1 405B Instruct0.848未收录未收录2024-07-23 · model_announcementLLM Stats
GPT-4o0.834未收录未收录2024-05-13 · model_announcementLLM Stats
Claude 3.5 Haiku0.831未收录未收录2024-10-22 · model_announcementLLM Stats
Claude 3 Opus0.831未收录未收录2024-02-29 · model_announcementLLM Stats
GPT-40.809未收录未收录2023-06-13 · model_announcementLLM Stats
Nova Lite0.802未收录未收录2024-11-20 · model_announcementLLM Stats
GPT-4o mini0.797未收录未收录2024-07-18 · model_announcementLLM Stats
Llama 3.1 70B Instruct0.796未收录未收录2024-07-23 · model_announcementLLM Stats
Nova Micro0.793未收录未收录2024-11-20 · model_announcementLLM Stats
LongCat-Flash-Chat0.7906未收录未收录2025-08-29 · model_announcementLLM Stats
Claude 3 Sonnet0.789未收录未收录2024-02-29 · model_announcementLLM Stats
Claude 3 Haiku0.784未收录未收录2024-03-13 · model_announcementLLM Stats
Phi 40.755未收录未收录2024-12-12 · model_announcementLLM Stats
Gemini 1.5 Pro0.749未收录未收录2024-05-01 · model_announcementLLM Stats
GPT-3.5 Turbo0.702未收录未收录2023-03-21 · model_announcementLLM Stats
Gemma 3n E4B0.608未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E4B Instructed LiteRT Preview0.608未收录未收录2025-05-20 · model_announcementLLM Stats
Llama 3.1 8B Instruct0.595未收录未收录2024-07-23 · model_announcementLLM Stats
Granite 3.3 8B Instruct0.5936未收录未收录2025-04-16 · model_announcementLLM Stats
Gemma 3n E2B0.539未收录未收录2025-06-26 · model_announcementLLM Stats
Gemma 3n E2B Instructed LiteRT (Preview)0.539未收录未收录2025-05-20 · model_announcementLLM Stats
IBM Granite 4.0 Tiny Preview0.462未收录未收录2025-05-02 · model_announcementLLM Stats
Granite 3.3 8B Base0.3614未收录未收录2025-04-16 · model_announcementLLM Stats
ERNIE 4.50.286未收录未收录2025-06-25 · model_announcementLLM Stats

其他来源中的相关记录