Overview

Visual search studies how an observer finds a target or useful evidence among competing visual information, from human eye movements to image retrieval and embodied agents. Current AI methods give multimodal models active tools such as cropping, zooming, parallel tile inspection, and Bayesian or uncertainty-guided region selection, while other approaches train search policies from trajectories, process rewards, or human annotations. Evaluation spans psychophysical tasks such as feature and conjunction search, GUI grounding on ScreenSpot-Pro, tool-using tasks such as VisualNeedle, and image-retrieval benchmarks. Models can improve accuracy and search efficiency, but reliable multi-hop evidence use remains difficult, and matching human outcomes does not necessarily mean matching human search processes.

Latest papers

CardsList

37 papers4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Zero-Shot Satellite Image Retrieval through Joint Embeddings: Application to Crisis Response

    May 6, 2026James Walsh, William Fawcett, Grace Colverd +1Geospatial Foundation ModelsDisaster Response

  2. AutoFocus: Uncertainty-Aware Active Visual Search for GUI Grounding

    May 4, 2026Ruilin Yao, Shegnwu Xiong, Tianyu Zou +2Uncertainty QuantificationGUI Grounding

  3. ProMMSearchAgent: A Generalizable Multimodal Search Agent Trained with Process-Oriented Rewards

    Apr 22, 2026Wentao Yan, Shengqin Wang, Huichi Zhou +4Multimodal IRProcess Reward Models

  4. Cost-Efficient Multi-Scale Fovea for Semantic-Based Visual Search Attention

    Apr 4, 2026João Luzio, Alexandre Bernardino, Plinio MorenoScanpath PredictionFoveated Vision

  5. Camouflage-aware Image-Text Retrieval via Expert Collaboration

    Apr 1, 2026Yao Jiang, Zhongkuan Mao, Xuan Wu +2Image-Text RetrievalCross-Modal Retrieval

  6. Visual Product Search Benchmark

    Mar 17, 2026Karthik Sulthanpete GovindappaVisual SearchImage Retrieval

  7. Training-free Uncertainty Guidance for Complex Visual Tasks with MLLMs

    Oct 1, 2025Sanghwan Kim, Rui Xiao, Stephan Alaniz +2Multimodal Large Language ModelsLong-Video Understanding