Model reports

ProSearch

找出在同一套实验配置中满足全部条件的方法。段落即使提到所有相关材料，也可能描述的是不同实验。

原论文官方仓库官方数据集收录来源

AI Benchmark Radar / Equality Machine · 核对于 2026-11-02

2026 年 10 月 30 日提交的论文 v1；覆盖方法段落检索及明确标注的其他设置。

究竟要找什么？

按是否共同满足条件来排列实验方法段落。每条查询含 3–5 项要求；把不同实验变体中的条件拼在一起不算相关。

ProSearch paper v1 · Official ProSearch code and reproduction instructions

查询、领域与证据

评测含六个实验领域的 1,515 条查询，各领域提供段落候选库、查询与相关性标注。36 条没有相关性判断的生成查询被排除。

ProSearch paper v1 · Official ProSearch dataset and files

怎样复现评测

作者脚本先编码查询与段落、保存检索排序，再依据 qrels 计分。主设置使用原始查询和方法段落库；全文段落检索使用不同候选库。

Official ProSearch code and reproduction instructions · Official ProSearch dataset and files

分数要连同设置阅读

nDCG@10 衡量前十名的排序质量。主成绩采用来源所列六领域算术平均并保留小数；查询和重排序配置单独标明，诊断及候选库变更结果另表展示。

ProSearch paper v1 · Official ProSearch code and reproduction instructions

全部 19 个首阶段检索器

完整原始查询结果保留全部六个领域；主成绩序列采用平均值列。

表 6 · 原始查询 nDCG@10
检索器	细胞培养	免疫技术	电化学	有机合成	无机材料	聚合物材料	平均
BM25	0.136	0.011	0.079	0.132	0.217	0.297	0.145
Sentence-BERT	0.082	0.012	0.064	0.122	0.263	0.065	0.101
GTE-large	0.222	0.041	0.127	0.184	0.441	0.182	0.199
BGE-M3	0.254	0.025	0.106	0.216	0.369	0.326	0.216
Harrier-OSS-v1-0.6B	0.261	0.049	0.159	0.198	0.467	0.177	0.219
NV-Embed-v2	0.358	0.070	0.184	0.290	0.448	0.310	0.277
Qwen3-Embedding-8B	0.386	0.092	0.175	0.282	0.495	0.309	0.290
MatSciBERT	0.011	0.003	0.001	0.013	0.002	0.002	0.005
ChemicalBERT-uncased	0.043	0.001	0.027	0.026	0.040	0.055	0.032
SPECTER2	0.077	0.005	0.003	0.069	0.157	0.060	0.062
SciNCL	0.098	0.034	0.036	0.099	0.190	0.020	0.080
PubMedBERT-base-embeddings	0.069	0.001	0.039	0.104	0.213	0.059	0.081
BioClinical-ModernBERT	0.142	0.011	0.053	0.093	0.272	0.084	0.109
ChEmbed-prog	0.161	0.007	0.056	0.179	0.401	0.147	0.158
ReasonIR-8B	0.079	0.006	0.021	0.120	0.092	0.043	0.060
INF-X-Retriever	0.295	0.039	0.134	0.208	0.328	0.193	0.200
ReasonEmbed	0.268	0.066	0.150	0.201	0.425	0.164	0.212
BGE-Reasoner-Embed	0.285	0.069	0.152	0.240	0.435	0.215	0.233
DIVER-Retriever	0.284	0.072	0.170	0.262	0.476	0.267	0.255

各领域列是独立子集；只有六领域平均值进入成绩序列，数值保留小数形式。

ProSearch Table 6

固定检索器下的查询策略

所有行均使用 Qwen3-Embedding-8B 和方法段落候选库；查询扩展改变输入，不代表更换模型检查点。

表 7 · 查询策略 nDCG@10
查询策略	细胞培养	免疫技术	电化学	有机合成	无机材料	聚合物材料	平均
Original	0.386	0.092	0.175	0.282	0.495	0.309	0.290
Query Decomposition	0.317	0.068	0.091	0.205	0.454	0.254	0.232
Structured Query	0.324	0.080	0.138	0.250	0.494	0.189	0.246
INF-Query-Aligner	0.382	0.075	0.141	0.233	0.487	0.196	0.252
HyDE	0.359	0.098	0.154	0.262	0.501	0.255	0.272
TongSearch-QR	0.385	0.092	0.172	0.265	0.505	0.288	0.285
Reasoning-augmented	0.408	0.111	0.179	0.309	0.494	0.359	0.310
DIVER-QExpand	0.374	0.117	0.205	0.327	0.558	0.318	0.317

Original 行用于对照，在主成绩中不重复收录。

ProSearch Table 7

重排序带来什么变化？

重排序器重新排列 Qwen3-Embedding-8B 提供的前 100 个候选；成绩包含这个检索阶段，不能视为独立检索器成绩。

表 8 · 前 100 候选重排序 nDCG@10
检索器	细胞培养	免疫技术	电化学	有机合成	无机材料	聚合物材料	平均
Qwen3-Embedding-8B	0.386	0.092	0.175	0.282	0.495	0.309	0.290
BGE-Reranker-v2-m3	0.481	0.192	0.247	0.336	0.705	0.416	0.396
Rank-R1	0.521	0.227	0.269	0.408	0.622	0.478	0.421
Rank1	0.592	0.266	0.241	0.416	0.598	0.457	0.428
DIVER-GroupRank-7B	0.586	0.255	0.262	0.468	0.705	0.531	0.468
ReasonRank-8B	0.577	0.276	0.314	0.483	0.637	0.547	0.472
Qwen3-Reranker	0.579	0.301	0.294	0.485	0.692	0.490	0.474

各领域列是独立子集；只有六领域平均值进入成绩序列，数值保留小数形式。

ProSearch Table 8

候选库改变后的结果

全文段落检索还包含方法章节之外的段落；这是不同候选库设置，单独展示，不进入方法段落主成绩序列。

表 9 · 不同候选库的六领域均值
检索器	方法段落 nDCG@10	全文段落 nDCG@10
BM25	0.145	0.089
BGE-Reasoner-Embed	0.233	0.164
NV-Embed-v2	0.277	0.197
Qwen3-Embedding-8B	0.290	0.206

保留来源直接报告的四组平均值。

ProSearch Table 9

30 条查询的开放网络检索

这个小型实验从每个领域抽取五条查询。成功率、精确率和倒数排名与 nDCG@10 含义不同。

表 10 · 开放网络证据检索
方法	Success@10	P@10	MRR
Tavily Search	0.300	0.077	0.209
Tavily Agent	0.800	0.353	0.694

这些结果不进入 nDCG@10 成绩序列。

ProSearch Table 10

结构化信息诊断

Structured 在单个抽取的协议记录中匹配条件，对随机处理并列的 20 次排序求平均；Hybrid 用 Qwen3-Embedding-8B 打破并列。两者使用抽取出的协议信息，不能当作纯文本检索器基线。

表 11 · 诊断性 nDCG@10
方法	细胞培养	电化学	免疫技术	无机材料	有机合成	聚合物材料	平均
Qwen3-Embedding-8B	0.386	0.175	0.092	0.495	0.282	0.309	0.290
Structured Diagnostic	0.789	0.698	0.682	0.875	0.773	0.829	0.774
Hybrid Diagnostic	0.858	0.741	0.723	0.910	0.795	0.859	0.814

诊断值单独展示，不进入主成绩序列；本表领域顺序与其他表不同。

ProSearch Table 11

按条件角色划分的子集

查询按是否包含 Condition 或 Method 角色的条件拆分；每个值是该子集的六领域平均，并非完整查询集平均。

表 39 · 角色子集
检索器	无条件角色	有条件角色	无方法角色	有方法角色
BM25	0.181	0.136	0.132	0.159
Qwen3-Embedding-8B	0.356	0.285	0.288	0.293

Qwen3 按原表说明展开为对应检查点；这些子集不进入主成绩序列。

ProSearch Table 39

哪些结论不能直接推出？

模板查询和模型辅助的候选池标注可能遗漏真实需求或相关段落。专家与标签的一致率为 89.1%。范围限于所选实验流程和单段证据，不等于完整实验可复现性。

ProSearch paper v1

版本与模型身份

发布日期采用 v1 提交日期。模型检查点依照附录 C.1/C.3，来源未提供逐次运行日期；没有替换为后续榜单数值。

ProSearch paper v1 · arXiv submission and version history

原始发布

原始 v1 发布资料；论文成绩保留其所述配置。

核对于 2026-11-02

已收录的评测资料

这条来源记录收录了 32 条数值成绩。来源区分了 25 个模型身份或配置。同一模型可能有多条记录；比较前请核对具体版本、工具和运行预算。查看成绩及逐条证据 →

报告指标: Average nDCG@10 (six domains)
原始单位: ratio
指标方向: 数值越高越好

从这些资料开始

收录来源 · arxiv.org

引用文档及日期（1）

ProSearch paper v1 · retrieval, query formulation and reranking results · 2026-10-30

评测信息与证据

来源: Model reports
发布者: 未收录
评测发布日期: 2026-10-30
采集日期: 未收录
模态: 未收录

本站保留来源报告的结果，不代表独立复测。请先核对任务版本、评测协议、分数单位和报告日期；不同运行条件不能直接合并为统一排名。

报告成绩 32

按来源中的观察顺序展示，顺序不代表排名。日期保留原始精度。

模型	数值	单位	协议	报告日期与口径	来源
DIVER-Retriever	0.255	ratio	Original query; first-stage retrieval; checkpoint or implementation AQ-MedAI/Diver-Retriever-4B; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
GTE-large	0.199	ratio	Original query; first-stage retrieval; checkpoint or implementation Alibaba-NLP/gte-large-en-v1.5; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
BGE-M3	0.216	ratio	Original query; first-stage retrieval; checkpoint or implementation BAAI/bge-m3; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
BGE-Reasoner-Embed	0.233	ratio	Original query; first-stage retrieval; checkpoint or implementation BAAI/bge-reasoner-embed-qwen3-8b-0923; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
ChEmbed-prog	0.158	ratio	Original query; first-stage retrieval; checkpoint or implementation BASF-AI/ChEmbed-prog; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
PubMedBERT-base-embeddings	0.081	ratio	Original query; first-stage retrieval; checkpoint or implementation NeuML/pubmedbert-base-embeddings; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.29	ratio	Original query; first-stage retrieval; checkpoint or implementation Qwen/Qwen3-Embedding-8B; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
SPECTER2	0.062	ratio	Original query; first-stage retrieval; checkpoint or implementation allenai/specter2_base; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
ReasonEmbed	0.212	ratio	Original query; first-stage retrieval; checkpoint or implementation hanhainebula/reason-embed-qwen3-8b-0928; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
INF-X-Retriever	0.2	ratio	Original query; first-stage retrieval; checkpoint or implementation infly/inf-retriever-v1-pro; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
MatSciBERT	0.005	ratio	Original query; first-stage retrieval; checkpoint or implementation m3rg-iitd/matscibert; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
SciNCL	0.08	ratio	Original query; first-stage retrieval; checkpoint or implementation malteos/scincl; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Harrier-OSS-v1-0.6B	0.219	ratio	Original query; first-stage retrieval; checkpoint or implementation microsoft/harrier-oss-v1-0.6b; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
NV-Embed-v2	0.277	ratio	Original query; first-stage retrieval; checkpoint or implementation nvidia/NV-Embed-v2; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
BM25	0.145	ratio	Original query; first-stage retrieval; checkpoint or implementation rank_bm25.BM25Okapi; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
ReasonIR-8B	0.06	ratio	Original query; first-stage retrieval; checkpoint or implementation reasonir/ReasonIR-8B; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
ChemicalBERT-uncased	0.032	ratio	Original query; first-stage retrieval; checkpoint or implementation recobo/chemical-bert-uncased; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Sentence-BERT	0.101	ratio	Original query; first-stage retrieval; checkpoint or implementation sentence-transformers/all-mpnet-base-v2; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
BioClinical-ModernBERT	0.109	ratio	Original query; first-stage retrieval; checkpoint or implementation thomas-sounack/BioClinical-ModernBERT-base; model-specific query handling in Appendix C.1; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 6	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.317	ratio	Query formulation DIVER-QExpand; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.272	ratio	Query formulation HyDE; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.252	ratio	Query formulation INF-Query-Aligner; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.232	ratio	Query formulation Query Decomposition; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.31	ratio	Query formulation Reasoning-augmented; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.246	ratio	Query formulation Structured Query; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Embedding-8B	0.285	ratio	Query formulation TongSearch-QR; Qwen/Qwen3-Embedding-8B; original method-paragraph corpus; Appendix C.2 transformation and retrieval procedure; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 7	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
DIVER-GroupRank-7B	0.468	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint AQ-MedAI/Diver-GroupRank-7B; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
BGE-Reranker-v2-m3	0.396	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint BAAI/bge-reranker-v2-m3; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Qwen3-Reranker	0.474	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint Qwen/Qwen3-Reranker-8B; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Rank-R1	0.421	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint ielabgroup/Rank-R1-7B-v0.1; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
Rank1	0.428	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint jhu-clsp/rank1-7b; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results
ReasonRank-8B	0.472	ratio	Rerank the same top-100 candidates from Qwen3-Embedding-8B; checkpoint lwhlwh/reasonrank-8B; ranking format and prompts in Appendix C.3; evaluated group: six-domain arithmetic mean; raw nDCG@10; original GPT-5.4 pooled relevance judgments; source: Table 8	2026-10-30 · document_publication	ProSearch paper v1 · retrieval, query formulation and reranking results

究竟要找什么？

查询、领域与证据

怎样复现评测

分数要连同设置阅读

全部 19 个首阶段检索器

固定检索器下的查询策略

重排序带来什么变化？

候选库改变后的结果

30 条查询的开放网络检索

结构化信息诊断

按条件角色划分的子集

哪些结论不能直接推出？

版本与模型身份

原始发布

已收录的评测资料

从这些资料开始

评测信息与证据

报告成绩 32

相关评测探索

继续阅读

六个新评测详情：上下文、Agent 与可执行任务

Navers Lab / Einsia：六个评测分别测什么

AI 评测与排行榜，分别告诉你什么

怎样比较 AI 评测成绩，避免混用评测口径

四个新 Agent 评测：适应变化、安全执行与视频交付

继续探索