Chain of Retrieval: Multi-Aspect Iterative Search Expansion and Post-Order Search Aggregation for Full Paper Retrieval
Organizations: KAIST
Abstract
Scientific paper retrieval, particularly framed as document-to-document retrieval, aims to identify relevant papers in response to a long-form query paper, rather than a short query string. Previous approaches to this task have largely focused on abstracts, embedding them into dense vectors as surrogates for full documents and calculating similarity between them. Yet, abstracts offer only sparse and high-level summaries, and such methods primarily optimize one-to-one similarity, overlooking the dynamic relations that emerge across relevant papers during the retrieval process. To address this, we propose Chain of Retrieval (CoR), a novel iterative framework for full-paper retrieval. Specifically, CoR decomposes each query paper into multiple aspect-specific views, matches them against segmented candidate papers, and iteratively expands the search by promoting top-ranked results as new queries, thereby forming a tree-structured retrieval process. The resulting retrieval tree is then aggregated in a post-order manner: descendants are first combined at the query level, then recursively merged with their parent nodes, to capture hierarchical relations across iterations. To validate this, we present SciFullBench, a large-scale benchmark providing both complete and segmented contexts of full papers for queries and candidates, and results show that CoR significantly outperforms existing retrieval baselines. Our code and dataset is available at https://github.com/psw0021/Chain-of-Retrieval-Official.
Figures & tables
| ICLR-NeurIPS | ACL-EMNLP | ||||||||
| References | Citations | References | Citations | ||||||
| Methods | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | |
| Lexical-Based Retrievers | |||||||||
| BM-25 (A2A) | 28.29 | 38.21 | 27.52 | 37.41 | 21.02 | 30.79 | 20.86 | 29.37 | |
| BM-25 (F2F) | 26.34 | 37.02 | 36.48 | 47.47 | 23.38 | 35.10 | 28.08 | 38.58 | |
| Domain-Specific Retrievers (A2A) | |||||||||
| ICLR-References | ICLR-Citations | ||
| {Optimizer} + {Retriever} | Recall@300 | Recall@200 | |
| Llama-3.2-3B-Inst + JEmb-v2 | |||
| w/o Aspect-Aware Cache | 53.63 0.11 | 46.80 0.03 | |
| w/ Aspect-Aware Cache | 54.15 0.39 | 47.08 0.04 | |
| Llama-3.2-3B-Inst + BGE-M3 | |||
| w/o Aspect-Aware Cache | 46.88 0.16 | 40.82 0.18 | |
| ICLR-References | NeurIPS-Citations | ||||
| {Optimizer} + {Retriever} | Recall@100 | Recall@300 | Recall@100 | Recall@300 | |
| Llama-3.2-3B-Inst + JEmb-v2 | |||||
| w/o DPO | 36.20 0.00 | 52.14 0.00 | 41.70 0.00 | 57.36 0.00 | |
| w/ DPO | 37.10 0.12 | 52.60 0.05 | 41.33 0.06 | 57.95 0.10 | |
| Llama-3.2-3B-Inst + BGE-M3 | |||||
| w/o DPO | 31.32 0.00 | 45.61 0.00 | 36.24 0.00 | 50.85 0.00 | |
| ACL (Citations) | NeurIPS (Citations) | ||
| {Type} w/ {Retriever} | CHV Ratio ( ) | CHV Ratio ( ) | |
| Relative Coverage over A2A | |||
| F2F w/ JEmb-v2 | 1.126 (+12.6%) | 1.135 (+13.5%) | |
| F2F w/ BGE-M3 | 1.088 (+8.8%) | 1.069 (+6.9%) | |
| F2F w/ Inf-Ret-v1 | 1.128 (+12.8%) | 1.097 (+9.7%) | |
| Relative Coverage over A2A | |||
| References | Citations | ||
| Methods | Recall@100 | Recall@100 | |
| Baseline | |||
| PAT-SPECTER (A2A) ( Ghosh et al., 2024 ) | 47.36 | 52.16 | |
| PaECTER (A2A) ( Ghosh et al., 2024 ) | 52.77 | 56.25 | |
| BGE-M3 (A2A) | 46.42 | 49.57 | |
| BGE-M3 (F2F) | 52.30 | 55.81 | |
| Retrieval Methods | Precision@5 |
| Abstract-to-Abstract (A2A) | 60.83 |
| Full-to-Full (F2F) | 53.33 |
| Chain-of-Retrieval ( CoR ; Ours) | 64.17 |
Appendix figures & tables27 assets
Supplementary material from the paper’s appendix.
Appendix
| ICLR | NeurIPS | EMNLP | ACL | |||||
| References | Citations | References | Citations | References | Citations | References | Citations | |
| domain | ML | ML | ML/CL | ML/CL | ||||
| years included | 2024,2025 | 2023,2024 | 2023,2024 | 2023,2024 | ||||
| Maximum # of Ground Truth Candidates | 62 | 750 | 133 | 763 | 160 | 583 | 60 | 320 |
| # of papers per year | (141,259) | (324,76) | (170, 230) | (353,47) | (226, 174) | (334, 66) | (184,216) | (256,144) |
| # of tokens per paper | 9402.35 | 8183.37 | 11184.39 | 9035.43 | 5908.36 | 6226.45 | 6190.06 | 6614.6 |
| SciFullBench | |
| Total # of papers | 40,782 |
| Avg. # of tokens per abstract | 200.39 |
| Avg. # of tokens per paper | 6987.67 |
| Total # of segmented corpus | 115,044 |
| Avg. # of tokens per segment | 2479.90 |
| References | Citations | |
| Nation | United States | |
| # of documents per split | 400 | 400 |
| # of tokens per abstract | 119.50 | 120.31 |
| # of tokens per document | 190335.46 | 186504.29 |
| average # of candidates per sample | 37.9 | 53.93 |
| PatentFullBench | |
| Total # of documents | 5150 |
| Avg. # of tokens per abstract | 120.97 |
| Avg. # of tokens per document | 29141.85 |
| Total # of segmented corpus | 52584 |
| Avg. # of tokens per segment | 2865.06 |
| ICLR-Citations | NeurIPS-Citations | ||
| Model + Retriever | Recall@300 | Recall@100 | |
| Baseline | |||
| Granite-Emb-Eng-R2 (A2A) | 50.19 | 41.39 | |
| Granite-Emb-Eng-R2 (F2F) | 54.00 | 44.37 | |
| QWEN3-0.6B-Emb (A2A) | 51.47 | 41.76 | |
| QWEN3-0.6B-Emb (F2F) | 54.03 | 44.81 | |
| ACL-Citations | ICLR-Citations | ||
| Retrieval Method | Recall@200 | Recall@200 | |
| Baseline | |||
| JEmb-v2 (A2A) | 35.33 | 39.19 | |
| JEmb-v2 (F2F) | 35.88 | 42.44 | |
| BGE-M3 (A2A) | 33.76 | 35.16 | |
| BGE-M3 (F2F) | 32.64 | 36.06 | |
| ICLR-References | ICLR-Citations | ||
| Model + Retriever | Recall@100 | Recall@200 | |
| Baseline | |||
| JEmb-v2 (A2A) | 33.04 | 39.10 | |
| JEmb-v2 (F2F) | 33.19 | 41.54 | |
| BGE-M3 (A2A) | 28.71 | 34.72 | |
| BGE-M3 (F2F) | 31.00 | 36.12 | |
| Retrieval Method | Recall@100 | MRR@50 | |
| Ours w/o RRF & w/o A2A | |||
| Naive Aggregation | |||
| GPT-4o-Mini-2024-0718 + BGE-M3 | 21.61 | 32.61 | |
| Late Interaction (MaxSim) | |||
| GPT-4o-Mini-2024-0718 + BGE-M3 | 26.00 | 31.53 | |
| Ours w/o A2A | |||
| Methods | Wall Clock Latency (s) | Recall@200 | |
| Retrieval Depth 1 | |||
| A2A | 0.05 | 35.16 | |
| F2F | 1.02 | 36.06 | |
| CoR w/ GPT-4o-Mini | 9.74 | 41.17 | |
| Retrieval Depth 2 | |||
| A2A | 0.09 | 35.25 | |
| Methods | Wall Clock Latency (s) | Recall@200 | |
| Retrieval budget 4 | |||
| A2A | 0.17 | 34.14 | |
| F2F | 4.02 | 35.63 | |
| CoR w/ GPT-4o-Mini | 9.74 | 41.17 | |
| Retrieval budget 16 | |||
| A2A | 0.66 | 24.92 | |
| ACL-References | ACL-Citations | ||||
| Retrieval Method | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | |
| JEmb-v2-Base-EN | |||||
| Intro-to-Intro | 23.06 | 34.97 | 24.32 | 34.41 | |
| CoR w/ Llama-3.2-3B-Instruct | 28.52 | 44.92 | 32.76 | 48.05 | |
| CoR w/ QWEN-2.5-3B-Instruct | 28.62 | 45.67 | 33.40 | 49.00 | |
| BGE-M3 | |||||
| ICLR-References | ICLR-Citations | ||
| Retrieval Method | Recall@300 | Recall@300 | |
| Baseline | |||
| JEmb-v2 (A2A) | 48.38 | 44.49 | |
| BGE-M3 (A2A) | 41.95 | 39.61 | |
| Inf-Ret-v1 (A2A) | 59.66 | 51.56 | |
| Ours (CoR) | |||
| ACL-References | ACL-Citations | ||
| Retrieval Method | Recall@200 | Recall@200 | |
| Baseline w/ Author Information | |||
| JEmb-v2 (A2A) | 34.25 | 34.84 | |
| JEmb-v2 (F2F) | 36.54 | 36.04 | |
| BGE-M3 (A2A) | 32.16 | 33.73 | |
| BGE-M3 (F2F) | 31.62 | 32.66 | |
| Methods | nDCG@200 (Ref) | Recall@200 (Ref) | nDCG@200 (Cite) | Recall@200 (Cite) | |
| Jina-Embeddings-v2-BASE-EN | |||||
| A2A w/ reranking | 28.95 | 42.98 | 26.25 | 38.69 | |
| F2F w/ reranking | 19.80 | 36.96 | 22.04 | 37.24 | |
| CoR w/ Llama-3.2-3B-Instruct | 35.05 | 48.71 | 33.94 | 47.12 | |
| CoR w/ Qwen-2.5-3B-Instruct | 34.64 | 48.33 | 34.16 | 47.43 | |
| BGE-M3 | |||||
| ACL-Citations | ICLR-Citations | ||
| Retrieval Method | Recall@200 | Recall@200 | |
| Single Comprehensive Query w/o A2A | |||
| QWEN-2.5-3B-Inst + JEmb-v2 | 38.66 | 41.68 | |
| Llama-3.2-3B-Inst + BGE-M3 | 32.45 | 34.03 | |
| Llama-3.2-3B-Inst + Inf-Ret-v1 | 45.36 | 48.55 | |
| Ours (CoR) w/o A2A | |||
| Methods | Recall@300 | |
| BFS Aggregation | ||
| CoR w/ Llama-3.2-3B-Inst w/ Depth 2 | 43.17 | |
| CoR w/ Llama-3.2-3B-Inst w/ Depth 3 | 38.97 | |
| Post-Order Aggregation | ||
| CoR w/ Llama-3.2-3B-Inst w/ Depth 2 | 46.16 | |
| CoR w/ Llama-3.2-3B-Inst w/ Depth 3 | 46.53 | |
| Retrieval Method | Recall@10 | mAP@10 | nDCG@10 | |
| A2A Retrieval | ||||
| JEmb-v2 (A2A) | 92.46 0.00 | 85.53 0.00 | 91.66 0.00 | |
| BGE-M3 (A2A) | 90.36 0.00 | 80.88 0.00 | 88.70 0.00 | |
| Inf-Ret-v1 (A2A) | 95.69 0.00 | 90.02 0.00 | 94.44 0.00 | |
| Ours ( CoR ) w/ A2A | ||||
| GPT-4.1 + JEmb-v2 | 93.20 0.09 | 86.20 0.08 | 92.18 0.06 | |
| Retrieval Method | Recall@5 | Recall@10 | Average | |
| A2A Retrieval | ||||
| JEmb-v2 (A2A) | 63.61 0.00 | 69.86 0.00 | 66.74 | |
| BGE-M3 (A2A) | 55.56 0.00 | 65.97 0.00 | 60.77 | |
| Inf-Ret-v1 (A2A) | 65.28 0.00 | 76.11 0.00 | 70.70 | |
| F2F Retrieval | ||||
| JEmb-v2 (F2F) | 65.97 0.00 | 71.94 0.00 | 68.96 | |
| Retrieval Method | nDCG@20 | mAP@20 | Recall@20 | |
| JEmb-v2-Base-EN | ||||
| A2A | 60.26 0.00 | 30.67 0.00 | 39.48 0.00 | |
| CoR w/ A2A | 60.73 0.14 | 31.89 0.22 | 40.31 0.21 | |
| BGE-M3 | ||||
| A2A | 57.83 0.00 | 28.78 0.00 | 37.45 0.00 | |
| CoR w/ A2A | 59.07 0.07 | 30.37 0.23 | 38.96 0.23 | |
| ICLR | NeurIPS | ||||||||
| References | Citations | References | Citations | ||||||
| IR Method | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | nDCG@300 | Recall@300 | |
| Lexical-Based Retrievers | |||||||||
| BM-25 (A2A) | 24.78 | 34.69 | 23.35 | 32.59 | 31.79 | 41.73 | 31.68 | 42.22 | |
| BM-25 (F2F) | 31.09 | 44.54 | 34.57 | 46.28 | 21.59 | 29.49 | 38.38 | 48.65 | |
| Domain-Specific Retriever | |||||||||
| Retrieval Method | nDCG@20 | Recall@20 | nDCG@30 | Recall@30 | |
| JEmb-v2-Base-EN | |||||
| A2A | 16.82 | 13.05 | 17.38 | 15.85 | |
| F2F | 18.52 | 14.20 | 19.27 | 17.41 | |
| CoR w/ Llama-3.2-3B-Instruct | 18.86 | 14.84 | 19.91 | 18.64 | |
| CoR w/ QWEN-2.5-3B-Instruct | 18.77 | 14.82 | 19.87 | 18.66 | |
| BGE-M3 | |||||
| ICLR | NeurIPS | ||||||||
| References | Citations | References | Citations | ||||||
| IR Method | Recall@100 | Recall@200 | nDCG@200 | Recall@100 | Recall@100 | Recall@200 | nDCG@200 | Recall@100 | |
| Lexical-Based Retrievers | |||||||||
| BM-25 (A2A) | 24.51 | 30.77 | 21.83 | 22.57 | 30.86 | 37.60 | 30.08 | 31.17 | |
| BM-25 (F2F) | 31.66 | 39.59 | 32.72 | 33.01 | 20.19 | 25.07 | 36.84 | 37.57 | |
| Domain-Specific Retriever | |||||||||