Overview

Visual search studies how an observer finds a target or useful evidence among competing visual information, from human eye movements to image retrieval and embodied agents. Current AI methods give multimodal models active tools such as cropping, zooming, parallel tile inspection, and Bayesian or uncertainty-guided region selection, while other approaches train search policies from trajectories, process rewards, or human annotations. Evaluation spans psychophysical tasks such as feature and conjunction search, GUI grounding on ScreenSpot-Pro, tool-using tasks such as VisualNeedle, and image-retrieval benchmarks. Models can improve accuracy and search efficiency, but reliable multi-hop evidence use remains difficult, and matching human outcomes does not necessarily mean matching human search processes.

Latest papers

CardsList

37 papers4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. EEGaze: Multimodal Attention Prediction in Visual Search via EEG-Based Saliency Refinement

    Oct 26, 2026Mansi Sharma, Dinar Orazgaliyev, Antonio Krüger +1Visual AttentionVisual Search

  2. Human-Like Attention? A Psychophysical Comparison of Visual Search in Humans and MLLMs

    Oct 4, 2026Renchi Zhang, Joost C. F. de Winter, Dimitra Dodou +2Multimodal Large Language ModelsVisual Search

  3. Recurrent Latent Visual Search for GUI Grounding

    Oct 4, 2026Kaiyu Wu, Beichen Zheng, Weiyao Huang +1GUI GroundingVision-Language Grounding

  4. HaPRL: Human-Anchored Process Reinforcement Learning for Visual Search Agent

    Sep 29, 2026Zhangquan Chen, Yaoxin Niu, Xiang An +5Human-in-the-Loop AnnotationProcess Supervision

  5. Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoom

    Sep 29, 2026Xijia Tao, Yihua Teng, Xinyu Fu +5Visual Question AnsweringTool Use in VLMs

  6. From Visual Search to Movement Control: A Priority Field for Artificial Agents

    Sep 25, 2026Han Zhang, Zhong CaoVision-Based Robot ControlVisual Search

  7. Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale

    Sep 21, 2026Anubhav Gupta, Hrushikesh Mohapatra, Prijith Chandra +6Information RetrievalVisual Search

  8. RoboFind: Multi-Agent Personalized Object Search for People Who Are Blind or Have Low Vision

    Sep 17, 2026Ruiping Liu, Shaofang Quan, Qian Yin +10Assistive RoboticsMulti-Agent Systems

  9. Emergent Goal-Directed Attention in Large Vision-Language Models

    Aug 31, 2026Han ZhangVisual AttentionLarge Vision-Language Models

  10. Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans

    Aug 17, 2026Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani +2Visual SearchMultimodal Large Language Models

  11. SurgNarrator: A Generative Retrieval Framework for Surgical Video Understanding

    Aug 5, 2026Yuqing Feng, Jiawei Ma, Kevin Qinghong Lin +6Surgical Video UnderstandingGenerative Retrieval

  12. StyleForge: Indoor Furniture Styling by Counterfactual Reasoning in a Hypergraph Field

    Aug 3, 2026Lingwei Dang, Shishuo Shang, Pan Liu +9Visual Search

  13. Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning

    Jul 10, 2026Anyi Zhang, Joy Mazumder, Kiril LomakinContrastive LearningVisual Search

  14. BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception

    Jul 3, 2026Geng Li, Yuxin PengLarge Vision-Language ModelsVisual Search

  15. PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seeking

    Jun 30, 2026Dengxian Gong, Yuanzheng Wu, Haobo Yuan +11Vision-Language GroundingTool-Using Vision-Language Agents

  16. ActiveScope: Actively Seeking and Correcting Perception for MLLMs

    Jun 23, 2026Yajing Wang, Chao Bi, Junshu Sun +4Multimodal Large Language ModelsVision-Language Grounding

  17. Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

    Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal IRMultimodal Grounding

  18. VistaHop: Benchmarking Multi-hop Visual Reasoning for Visual DeepSearch

    Jun 2, 2026Hang He, Chuhuai Yue, Chengqi Dong +6VLM EvaluationVisual Question Answering

  19. Self-Prophetic Decoding to Unlock Visual Search in LVLMs

    May 27, 2026Zhendong He, Qiyuan Dai, Guanbin Li +2Large Vision-Language ModelsVLM Reasoning

  20. VisualNeedle: Benchmarking Active Visual Search in Information-Dense Scenes

    May 25, 2026Jingru Chen, Yiming Liu, Mingtao Chen +5VLM EvaluationTool Use in VLMs

  21. Binding Visual Features Point by Point

    May 25, 2026Udith Haputhanthri, Declan Campbell, Rim Assouel +2Vision-Language ModelsVLM Interpretability

  22. CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception

    May 22, 2026Liupeng Li, Haoqian Kang, Zhenyu Lu +4Efficient VLM InferenceLarge Vision-Language Models

  23. PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA

    May 22, 2026Chunze Yang, Qidong Liu, Wenjie Zhao +10HealthcareMedical VQA

  24. Starve to Perceive: Taming Lazy Perception in VLMs with Constrained Visual Bandwidth

    May 18, 2026Yuhuan Wu, Cong Wei, Fangzhen Lin +2Vision-Language ModelsVLM Adaptation

  25. InterLV-Search: Benchmarking Interleaved Multimodal Agentic Search

    May 8, 2026Bohan Hou, Jiuning Gu, Jiayan Guo +5Multimodal IRMultimodal Search Agents