PatchScout: Thematic Web Data Collection via Information Foraging
Organizations: Department of Computer and Information Science Temple University Philadelphia, PA
Abstract
Researchers often need web corpora that are not answers to a single query, but reusable collections of documents spanning many decentralized sources. We refer to this problem as thematic web data collection: assembling semantically relevant documents that share a common theme but are scattered across heterogeneous and structurally disconnected regions of the web. Existing approaches, including traversal-based methods and LLM-driven web agents, are limited by local exploration or short-horizon stopping, preventing comprehensive collection. We formulate this task as a long-horizon information foraging problem over query-induced semantic patches, where the central challenge is deciding when to continue local exploitation and when to switch to new regions. We propose PatchScout, a multi-agent framework that instantiates a class of patch-switching policies to balance local exploitation and adaptive patch switching under a fixed budget. Experiments on four live-web topics show that PatchScout substantially improves yield and domain coverage over traversal-based and search-augmented reasoning agent baselines. In an applied social science setting with an incomplete prior collection, PatchScout discovers 102 previously unidentified entities, illustrating its ability to expand existing thematic datasets.
Figures & tables
| Name | Condition | Description |
|---|---|---|
| Threshold | Realized productivity below a fixed topic-dependent threshold. | |
| Realized-Mean | Realized productivity below the mean productivity of prior patches. | |
| Realized-EMA | Realized productivity below the EMA of prior patches. | |
| Scent-Mean | Information scent below the mean productivity of prior patches. | |
| Scent-EMA | Information scent below the EMA of prior patches. |
| Universities | Fortune 500 | Law Schools | ASPs | |||||
| System | HR | Cov | HR | Cov | HR | Cov | HR | Cov |
| ACHE | 18.3 | 3.6 | 4.0 | 2.6 | 6.0 | 6.6 | 0.0 | 0.0 |
| DeepResearcher | – | 0.3 | – | 0.8 | – | 1.0 | – | 17.3 |
| Claude Deep Research | – | 1.1 | – | 15.0 | – | 91.9 | – | 17.3 |
| Gemini Deep Research | – | 1.8 | – | 3.0 | – | 93.4 | – | 9.8 |
| No-Reseed | 18.7 | 1.7 | 0.8 | 3.0 | 0.1 | 1.0 | 0.1 | 1.5 |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Role | Default Value |
|---|---|---|
| Number of search results retained per query. | ||
| Maximum branching factor (number of links to enque in frontier from a single page). | ||
| Fixed productivity threshold for re-seeding. | Topic dependent. | |
| Initial patch productivity estimate. | Topic dependent. | |
| Number of frontier links used to estimate information scent. | ||
| Update rate for patch productivity. |
| University | ASP | Balanced | |||||
|---|---|---|---|---|---|---|---|
| Relevant | Domain | Relevant | Domain | Relevant | Domain | ||
| 5 | 0.1 | 743 | 190 | 72 | 36 | 0.884 | 0.764 |
| 5 | 0.3 | 813 | 172 | 73 | 50 | 0.930 | 0.866 |
| 5 | 0.5 | 868 | 159 | 49 | 30 | 0.807 | 0.638 |
| 10 | 0.1 | 777 | 204 | 78 | 43 | 0.941 | 0.864 |
| 10 | 0.3 | 880 | 235 | 74 | 42 | 0.974 | 0.920 |
| Component | Total Tokens | Tokens per Page | Total Calls | Latency per Call |
|---|---|---|---|---|
| Forager | 198,415,172 | 707.71 | 49,015 | 6.44 |
| Critic | 44,390,930 | 158.33 | 38,834 | 4.68 |
| Scout | 3,798,127 | 13.54 | 1,666 | 4.02 |
| Fetch | 0 | 0.0000 | 344,588 | 0.75 |
| Search | 0 | 0.0000 | 7,571 | 2.01 |
| Approach | Forager Tokens | Critic Tokens | Scout Tokens | Total Tokens |
|---|---|---|---|---|
| DeepResearcher | - | - | - | 2,258,943 |
| No-Reseed | 39,005,430 | 5,442,936 | 2,472 | 44,450,838 |
| Fixed-Reseed | 23,891,382 | 6,762,778 | 563,082 | 31,217,242 |
| Threshold | 21,800,783 | 6,173,678 | 822,458 | 28,796,919 |
| Realized-Mean | 29,978,153 | 6,195,291 | 341,875 | 36,515,319 |
| Realized-EMA | 30,342,823 | 6,054,647 | 259,603 | 36,657,073 |
| Universities | Fortune 500 | Law Schools | ASPs | |||||||||
| System | Tok | Pg/1K | Cov/1M | Tok | Pg/1K | Cov/1M | Tok | Pg/1K | Cov/1M | Tok | Pg/1K | Cov/1M |
| DeepResearcher | 477K | 0.16 | 10.5 | 340K | 0.01 | 11.7 | 680K | 0.00 | 2.9 | 761K | 0.08 | 30.2 |
| Claude Deep Research | – | – | – | – | – | – | – | – | – | – | – | – |
| Gemini Deep Research | 707K | 0.16 | 46.7 | 1.1M | 0.08 | 14.1 | 1.8M | 0.14 | 102.7 | 1.2M | 0.07 | 10.7 |
| No-Reseed | 9.9M | 0.19 | 3.1 | 11.6M | 0.01 | 1.3 | 11.6M | 0.00 | 0.2 | 11.4M | 0.00 | 0.2 |
| Fixed-Reseed | 6.7M | 0.93 | 44.4 | 7.6M | 0.20 | 12.0 | 9.1M | 0.30 | 15.7 | 7.8M | 0.05 | 5.3 |
| Universities | Fortune 500 | Law Schools | ASPs | |||||
| System | Pg | Cov | Pg | Cov | Pg | Cov | Pg | Cov |
| DeepResearcher | 78 | 0.3 | 56 | 0.8 | 28 | 1.0 | 64 | 17.3 |
| Claude Deep Research | - | 1.1 | - | 15.0 | - | 91.9 | - | 17.3 |
| Gemini Deep Research | 113 | 1.8 | 82 | 3.0 | 247 | 93.4 | 87 | 9.8 |
| No-Reseed | 716 | 1.4 | 893 | 2.6 | 1,556 | 0.5 | 1,063 | 1.5 |
| Fixed-Reseed | 1,072 | 5.7 | 1,405 | 6.0 | 1,995 | 34.0 | 1,568 | 8.3 |
| Universities | Fortune 500 | Law Schools | ASPs | |||||
|---|---|---|---|---|---|---|---|---|
| System | HR | Cov | HR | Cov | HR | Cov | HR | Cov |
| Random-Reseed | 72.1 | 4.6 | 7.6 | 2.2 | 27.8 | 25.4 | 4.9 | 9.0 |
| Random-Forager | 53.5 | 1.2 | 10.6 | 2.0 | 21.5 | 11.7 | 4.6 | 12.0 |
| Upfront-Scout | 64.3 | 8.3 | 16.9 | 6.6 | 28.6 | 28.9 | 3.7 | 10.5 |
| Realized-EMA | 86.2 | 4.4 | 23.2 | 19.8 | 25.3 | 70.6 | 3.7 | 26.3 |
| Scent-EMA | 68.3 | 15.5 | 20.1 | 24.6 | 37.2 | 86.8 | 5.6 | 35.3 |
| Reference model | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DeepSeek | Qwen 9B | Qwen 27B | Qwen 397B | |||||||||
| Prediction | Agr | Prec | Rec | Agr | Prec | Rec | Agr | Prec | Rec | Agr | Prec | Rec |
| DeepSeek | – | – | – | 86.1 | 81.1 | 86.9 | 87.4 | 79.9 | 90.8 | 86.9 | 77.6 | 91.9 |
| Qwen 9B | 86.1 | 86.9 | 81.1 | – | – | – | 88.7 | 83.6 | 88.6 | 88.0 | 80.9 | 89.4 |
| Qwen 27B | 87.4 | 90.8 | 79.9 | 88.7 | 88.6 | 83.6 | – | – | – | 92.0 | 87.8 | 91.5 |
| Qwen 397B | 86.9 | 91.9 | 77.6 | 88.0 | 89.4 | 80.9 | 92.0 | 91.5 | 87.8 | – | – | – |
| Topic | Orig. label | Not rel. | Topical, no ev. | Partial ev. | Direct ev. |
|---|---|---|---|---|---|
| Universities | Relevant | 5.8 | 37.9 | 9.3 | 47.1 |
| Universities | Not relevant | 72.9 | 19.5 | 2.0 | 5.6 |
| Fortune 500 | Relevant | 5.8 | 9.8 | 36.3 | 48.1 |
| Fortune 500 | Not relevant | 85.4 | 10.3 | 3.8 | 0.4 |
| Law Schools | Relevant | 2.8 | 22.4 | 41.8 | 32.9 |
| Law Schools | Not relevant | 66.6 | 28.0 | 5.2 | 0.2 |
Web Search Agents
Web search agents use language models to find, verify, and synthesize information from the web for multi-step tasks.
See all 43 papers