Overview

Visual search studies how an observer finds a target or useful evidence among competing visual information, from human eye movements to image retrieval and embodied agents. Current AI methods give multimodal models active tools such as cropping, zooming, parallel tile inspection, and Bayesian or uncertainty-guided region selection, while other approaches train search policies from trajectories, process rewards, or human annotations. Evaluation spans psychophysical tasks such as feature and conjunction search, GUI grounding on ScreenSpot-Pro, tool-using tasks such as VisualNeedle, and image-retrieval benchmarks. Models can improve accuracy and search efficiency, but reliable multi-hop evidence use remains difficult, and matching human outcomes does not necessarily mean matching human search processes.

Latest papers

CardsList

40 papers3 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. VisSearch-Bench: Evaluating Long Horizon Visual Search in Multimodal Agents

    Nov 3, 2026ZhengXian Wu, Qianhao Nie, Zhuohong Chen +10Multimodal Search AgentsVisual Search

  2. Toward Counterfactual Learning for Selective Re-Examination in Agentic Visual Search

    Oct 31, 2026Ao Chen, Shengchao Chen, Yan LuximonVisual SearchRL for VLMs

  3. EEGaze: Multimodal Attention Prediction in Visual Search via EEG-Based Saliency Refinement

    Oct 26, 2026Mansi Sharma, Dinar Orazgaliyev, Antonio Krüger +1Visual AttentionVisual Search

  4. Human-Like Attention? A Psychophysical Comparison of Visual Search in Humans and MLLMs

    Oct 4, 2026Renchi Zhang, Joost C. F. de Winter, Dimitra Dodou +2Multimodal Large Language ModelsVisual Search

  5. Recurrent Latent Visual Search for GUI Grounding

    Oct 4, 2026Kaiyu Wu, Beichen Zheng, Weiyao Huang +1GUI GroundingVision-Language Grounding

  6. HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agent

    Sep 29, 2026Zhangquan Chen, Yaoxin Niu, Xiang An +5Human-in-the-Loop AnnotationProcess Supervision

  7. Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoom

    Sep 29, 2026Xijia Tao, Yihua Teng, Xinyu Fu +5Visual Question AnsweringTool Use in VLMs

  8. From Visual Search to Movement Control: A Priority Field for Artificial Agents

    Sep 25, 2026Han Zhang, Zhong CaoVision-Based Robot ControlVisual Search

  9. Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale

    Sep 21, 2026Anubhav Gupta, Hrushikesh Mohapatra, Prijith Chandra +6Information RetrievalVisual Search

  10. RoboFind: Multi-Agent Personalized Object Search for People Who Are Blind or Have Low Vision

    Sep 17, 2026Ruiping Liu, Shaofang Quan, Qian Yin +10Assistive RoboticsMulti-Agent Systems

  11. Emergent Goal-Directed Attention in Large Vision-Language Models

    Aug 31, 2026Han ZhangVisual AttentionLarge Vision-Language Models

  12. Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

    Aug 17, 2026Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani +2Visual SearchMultimodal Large Language Models

  13. SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding

    Aug 5, 2026Yuqing Feng, Jiawei Ma, Kevin Qinghong Lin +6Surgical Video UnderstandingGenerative Retrieval

  14. StyleForge: Indoor Furniture Styling by Counterfactual Reasoning in a Hypergraph Field

    Aug 3, 2026Lingwei Dang, Shishuo Shang, Pan Liu +9Visual Search

  15. Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning

    Jul 10, 2026Anyi Zhang, Joy Mazumder, Kiril LomakinContrastive LearningVisual Search

  16. BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception

    Jul 3, 2026Geng Li, Yuxin PengLarge Vision-Language ModelsVisual Search

  17. PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking

    Jun 30, 2026Dengxian Gong, Yuanzheng Wu, Haobo Yuan +11Vision-Language GroundingTool-Using Vision-Language Agents

  18. ActiveScope: Actively Seeking and Correcting Perception for MLLMs

    Jun 23, 2026Yajing Wang, Chao Bi, Junshu Sun +4Multimodal Large Language ModelsVision-Language Grounding

  19. Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

    Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal IRMultimodal Grounding

  20. VistaHop: Benchmarking Multi-hop Visual Reasoning for Visual DeepSearch

    Jun 2, 2026Hang He, Chuhuai Yue, Chengqi Dong +6VLM EvaluationVisual Question Answering

  21. Self-Prophetic Decoding to Unlock Visual Search in LVLMs

    May 27, 2026Zhendong He, Qiyuan Dai, Guanbin Li +2Large Vision-Language ModelsVLM Reasoning

  22. VisualNeedle: Benchmarking Active Visual Search in Information-Dense Scenes

    May 25, 2026Jingru Chen, Yiming Liu, Mingtao Chen +5VLM EvaluationTool Use in VLMs

  23. Binding Visual Features Point by Point

    May 25, 2026Udith Haputhanthri, Declan Campbell, Rim Assouel +2Vision-Language ModelsVLM Interpretability

  24. CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception

    May 22, 2026Liupeng Li, Haoqian Kang, Zhenyu Lu +4Efficient VLM InferenceLarge Vision-Language Models

  25. PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

    May 22, 2026Chunze Yang, Qidong Liu, Wenjie Zhao +10HealthcareMedical Visual Question Answering