Overview

Visual grounding studies how systems identify the image regions or objects referred to by language, often producing boxes, points, or masks. Common approaches include aligning text and visual features, selecting among detected objects, using attention or high-resolution crops, and training with localization annotations or reinforcement-learning rewards. The field spans referring-expression benchmarks such as RefCOCO, fine-grained spatial reasoning, medical and remote-sensing images, video, and embodied tasks such as navigation and manipulation. A central challenge is that correct answers do not prove a model used visual evidence: systems still struggle with precise localization, changing scenes, and reliable visual dependence while balancing accuracy, efficiency, and robustness.

Latest papers

CardsList

153 papers23 papers in the last four weeks, up 28% on the four weeks before. 0.1% of all new papers.

  1. What MLLMs Learn about When they Learn about Multimodal Reasoning

    Oct 2, 2025Jiwan Chung, Neel Joshi, Pratyusha Sharma +2Multimodal ReasoningMultimodal Model Evaluation

  2. Gondola: Grounded Vision Language Planning for Robotic Manipulation

    Jun 12, 2025Shizhe Chen, Ricardo Garcia, Paul Pacaud +1Long-Horizon Robotic ManipulationRobot Task Planning

  3. VisionLogic: Discovering and Grounding Decision-Relevant Visual Concepts

    Mar 13, 2025Chuqin Geng, Yuhe Jiang, Li Zhang +5Explainable Artificial IntelligenceConcept-Based Explanations