Retrieval as Exploration: Retriever-Free Retrieval via Corpus-Traversing MCTS
Organizations: LBOX · Carnegie Mellon University
Abstract
Large Reasoning Models (LRMs) have demonstrated remarkable capabilities in multi-step reasoning and calling search tools at appropriate steps. However, existing retrieval-augmented reasoning approaches still rely on separate retrieval models, limiting LRMs to deciding when to retrieve and how to formulate queries rather than leveraging their pretrained knowledge and reasoning capabilities for retrieval itself. This structural separation introduces a representation bottleneck, as retrieval relies on separately learned representations that may obscure fine-grained distinctions needed for reasoning. Moreover, these approaches commonly employ fixed top-k retrieval, which can introduce superfluous documents and increase retrieval noise and context overhead. To address this, we reformulate retrieval from query-document relevance matching into the exploration of answer-containing paths within the corpus, and propose FREESON (Retriever-FREE Retrieval-Augmented ReaSONing), a framework that enables LRMs to directly navigate the original corpus text to locate information that satisfies their specific needs, serving as both the reasoner and the retriever. Specifically, we introduce CT-MCTS (Corpus-Traversing Monte Carlo Tree Search), a retrieval-specialized variant of Monte Carlo Tree Search (MCTS). CT-MCTS iteratively expands and evaluates exploration paths, starting from multiple promising entry points across the corpus. This allows LRMs to selectively reference specific segments identified during traversal, instead of fetching a fixed top-k set. Across nine benchmarks, FREESON improves average EM and F1 by 15 points over four retriever-based baselines on five general-domain QA tasks, matching the strongest baseline. It also gains 12 points on fact-checking and 13 points on medical QA under zero-shot transfer, performing on par with the much larger MedGemma-27B.
Figures & tables
| Fact-checking | Multi-hop QA | Single-hop QA | |||||||||
| Method | FEVER | 2WikiMultihopQA | MuSiQue | HotpotQA | PopQA | TriviaQA | |||||
| ACC | EM | F1 | EM | F1 | EM | F1 | EM | F1 | EM | F1 | |
| Reasoning without retrieval | |||||||||||
| GLM-4.7-Flash-30B-A3B | 0.66 | 0.29 | 0.35 | 0.09 | 0.18 | 0.27 | 0.37 | 0.30 | 0.35 | 0.64 | 0.73 |
| Qwen3.8-27B | 0.69 | 0.30 | 0.35 | 0.10 | 0.18 | 0.26 | 0.37 | 0.23 | 0.27 | 0.55 | 0.64 |
| Gemma-4-12B | 0.61 | 0.24 | 0.28 | 0.06 | 0.14 | 0.23 | 0.33 | 0.19 | 0.22 | 0.53 | 0.62 |
| Method | MedQA-US | PubMedQA | BioASQ |
|---|---|---|---|
| ACC | ACC | ACC | |
| Medical LMs | |||
| MedGemma-27B | 0.88 | 0.43 | 0.81 |
| BioMistral-7B | 0.39 | 0.19 | 0.73 |
| MedGemma-1.5-4B | 0.67 | 0.51 | 0.67 |
| Retrieve-then-reason | |||
| Method | Top-k | # Docs | Coverage | Prec. |
|---|---|---|---|---|
| Search-R1 + E5 | 3 | 2.99 | 0.87 | 0.34 |
| FREESON | 3 | 1.24 | 0.83 | 0.81 |
| Model | Value estimation | MedQA-US | PubMedQA | BioASQ | Avg. |
|---|---|---|---|---|---|
| ACC | ACC | ACC | ACC | ||
| GPT-OSS-20B | Self-eval | 85.3 | 56.7 | 84.7 | 75.57 |
| vh_medical | 85.0 | 59.3 | 84.7 | 76.33 | |
| vh_general | 85.0 | 58.7 | 85.3 | 76.33 | |
| Gemma-4-12B | Self-eval | 85.3 | 54.7 | 79.3 | 73.10 |
| vh_medical | 84.3 | 55.3 | 79.3 | 72.97 |
| PopQA | 2WikiMultihopQA | |||
|---|---|---|---|---|
| Decoding | EM | F1 | EM | F1 |
| Greedy Search | 0.17 | 0.21 | 0.21 | 0.23 |
| Beam Search | 0.18 | 0.21 | 0.23 | 0.25 |
| CT-MCTS | 0.44 | 0.45 | 0.54 | 0.60 |
| PopQA | TriviaQA | 2WikiMultiHop | Avg. | |||||
|---|---|---|---|---|---|---|---|---|
| Value estimation | EM | F1 | EM | F1 | EM | F1 | EM | F1 |
| LLM Synthetic Trajectory | 0.41 | 0.41 | 0.48 | 0.61 | 0.53 | 0.59 | 0.47 | 0.54 |
| CT-MCTS Rollout | 0.44 | 0.45 | 0.51 | 0.63 | 0.54 | 0.60 | 0.50 | 0.56 |
| Performance | Efficiency | ||
|---|---|---|---|
| Multiple Expansion | EM | F1 | Latency |
| M=1 | 0.41 | 0.46 | 21s |
| M=2 | 0.54 | 0.60 | 31s |
| M=3 | 0.54 | 0.60 | 36s |
| M=4 | 0.54 | 0.60 | 44s |
| Efficiency | ||
| Metric | FREESON | Dual-encoder |
| Indexing time ( ) | 64 mins (cpu) | 177 mins (gpu) |
| Index memory ( ) | 11GB | 61GB |
| Inference latency ( ) | 17.21s | 9.36s |
| Inference FLOPs ( ) | ||
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Settings | FEVER | PopQA | TriviaQA | HotPotQA | 2WikiMultihopQA | MuSiQue | TriviaQA |
|---|---|---|---|---|---|---|---|
| [ 56 ] | [ 54 ] | [ 59 ] | [ 58 ] | [ 55 ] | [ 57 ] | [ 59 ] | |
| Dataset statistics | |||||||
| # Examples | 100 | 500 | 500 | 500 | 500 | 500 | 500 |
| Gold answer count | Single | Many | Single | Single | Single | Single | Single |
| Retrieval settings | |||||||
| Corpus | Wikipedia-dpr | Wikipedia-dpr | Wikipedia-dpr | Wikipedia-dpr | Wikipedia-2wiki | Wikipedia-dpr | Wikipedia-dpr |
| Method | Subset ( ) | Full Set ( ) |
|---|---|---|
| EM / F1 | EM / F1 | |
| Search-R1 + BM25 | – | 0.5394 / 0.6085 |
| Search-R1 + E5 | 0.54 / 0.61 | 0.5558 / 0.6360 |
| FREESON (Ours) | 0.55 / 0.63 | 0.5742 / 0.6440 |
| Efficiency | Performance | Exploration | ||||
|---|---|---|---|---|---|---|
| Node Granularity | Latency ( ) | Avg Rollout Count | Avg Path Length. | EM ( ) | F1 ( ) | Exploration |
| G=1 | 67s | 39.14 | 11 | 0.30 | 0.33 | 32 |
| G=2 | 60s | 63.13 | 42 | 0.48 | 0.54 | 16 |
| G=3 | 36s | 60.19 | 60 | 0.54 | 0.60 | 12 |
| G=4 | 34s | 60.60 | 84 | 0.52 | 0.58 | 10 |
| G=5 | 30s | 60.60 | 99 | 0.52 | 0.59 | 9 |