AI 评测与排行榜,分别告诉你什么
分清评测基准、一次评测运行与排行榜,用它们回答各自适合的问题。
LLM Stats
QMSum is a benchmark for query-based multi-domain meeting summarization consisting of 1,808 query-summary pairs over 232 meetings across academic, product, and committee domains. The dataset enables models to select and summarize relevant spans of meetings in response to specific queries. Published at NAACL 2021, QMSum presents significant challenges in long meeting summarization where models must identify and summarize relevant content based on user queries.
本站保留来源报告的结果,不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期;不同运行条件不能直接合并为统一排名。
按来源中的观察顺序展示,顺序不代表排名。日期保留原始精度。