cs.CVApr 15, 2026

POINTS-Seeker: An Open Recipe for Multimodal Search Agents with Visual Memory Management

Authors: Yikun Liu, Yuan Liu, Haicheng Wang, Zhongyin Zhao, Le Tian, Xiao Zhou, Jiangchao Yao, Yanfeng Wang, +1 more

Organizations: School of Artificial Intelligence, Shanghai Jiao Tong University · CMIC, Shanghai Jiao Tong University · WeChat AI, Tencent

Abstract

Large Multimodal Models (LMMs) excel at visual perception but struggle with real-time, knowledge-intensive queries due to their reliance on static parametric knowledge. While multimodal search agents offer a promising solution, developing them from vanilla LMMs presents two major challenges: the lack of open recipes to cultivate search agency from scratch, and the severe context explosion (attention dilution) that occurs during long-horizon multi-turn investigations. In this paper, we address both challenges by developing a native multimodal search agent. First, we introduce an open training recipe featuring Agentic Seeding, a formative training stage that bootstraps tool-use and planning abilities directly from a non-agentic foundation. Second, to overcome the context bottleneck, we propose V-Fold, an adaptive memory management mechanism. V-Fold retains recent interactions as high-fidelity text while folding stale historical context into the visual space via rendering, exploiting the model's cross-modal alignment to preserve raw evidence without text token redundancy. Combining these innovations, we present POINTS-Seeker-8B, which achieves state-of-the-art performance among models of comparable scale across six multimodal search benchmarks.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Towards Long-horizon Agentic Multimodal Search

    Apr 14, 2026Yifan Du, Zikang Liu, Jinbiao Peng +5Multimodal Search AgentsLong-Horizon LLM Agents

  2. Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

    Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal IRMultimodal Grounding

  3. MTA-Agent: An Open Recipe for Multimodal Deep Search Agents

    Apr 7, 2026Xiangyu Peng, Can Qin, An Yan +4Multimodal Search AgentsMultimodal QA