AI EVALUATION, IN CONTEXT.BY EQUALITY MACHINE

LLM Stats

SQuALITY

SQuALITY (Summarization-format QUestion Answering with Long Input Texts, Yes!) is a long-document summarization dataset built by hiring highly-qualified contractors to read public-domain short stories (3000-6000 words) and write original summaries from scratch. Each document has five summaries: one overview and four question-focused summaries. Designed to address limitations in existing summarization datasets by providing high-quality, faithful summaries.

评测信息与证据

来源
LLM Stats
发布者
未收录
评测发布日期
未收录
采集日期
2026-08-17
模态
text

本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。

原始资料

报告成绩 5

按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。

模型数值单位协议报告日期与口径来源
Phi-3.5-mini-instruct0.243未收录未收录2024-08-23 · model_announcementLLM Stats
Phi-3.5-MoE-instruct0.241未收录未收录2024-08-23 · model_announcementLLM Stats
Nova Pro0.198未收录未收录2024-11-20 · model_announcementLLM Stats
Nova Lite0.192未收录未收录2024-11-20 · model_announcementLLM Stats
Nova Micro0.188未收录未收录2024-11-20 · model_announcementLLM Stats