cs.AIOct 30, 2026

PatchScout: Thematic Web Data Collection via Information Foraging

Authors: Michael West, Eduard Dragut

Organizations: Department of Computer and Information Science Temple University Philadelphia, PA

Abstract

Researchers often need web corpora that are not answers to a single query, but reusable collections of documents spanning many decentralized sources. We refer to this problem as thematic web data collection: assembling semantically relevant documents that share a common theme but are scattered across heterogeneous and structurally disconnected regions of the web. Existing approaches, including traversal-based methods and LLM-driven web agents, are limited by local exploration or short-horizon stopping, preventing comprehensive collection. We formulate this task as a long-horizon information foraging problem over query-induced semantic patches, where the central challenge is deciding when to continue local exploitation and when to switch to new regions. We propose PatchScout, a multi-agent framework that instantiates a class of patch-switching policies to balance local exploitation and adaptive patch switching under a fixed budget. Experiments on four live-web topics show that PatchScout substantially improves yield and domain coverage over traversal-based and search-augmented reasoning agent baselines. In an applied social science setting with an incomplete prior collection, PatchScout discovers 102 previously unidentified entities, illustrating its ability to expand existing thematic datasets.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Data Scout: Targeted Web Crawling for Domain-Specific Pretraining Corpora

    Sep 4, 2026Chirag Garg, Eelaaf Zahid, Farhan Ahmed +3Domain-Adaptive Pretraining

  2. BaRA: Budget-constrained and Reliable Web Data Collection Agent

    May 2, 2026Soojeong Lee, Joseph Lee, Yongseong Cho +3Multimodal AgentsWeb Agents

  3. SODIUM: From Open Web Data to Queryable Databases

    Mar 19, 2026Chuxuan Hu, Philip Li, Maxwell Yang +1Web Search AgentsWeb Agents