Overview

Vision-language grounding studies how models connect language to specific visual evidence, enabling them to locate a described object, segment a region, track an entity through video, or act on an instruction. Common approaches align text with image regions using contrastive learning, detection, segmentation, and point or box prediction; newer multimodal models also use attention, structured scene representations, visual search, and step-by-step evidence grounding. Evaluation spans referring-expression benchmarks, high-resolution and video localization, document understanding, and embodied tasks such as navigation and robotic manipulation. A central challenge is that correct answers do not prove models used the image: language priors, ambiguity, small or changing targets, and long-horizon context can all undermine faithful and robust grounding.

Latest papers

CardsList

444 papers32 papers in the last four weeks, down 36% on the four weeks before. 0.2% of all new papers.

  1. Vision-Language Semantic Grounding for Multi-Domain Crop-Weed Segmentation

    Feb 27, 2026Nazia Hossain, Xintong Jiang, Yu Tian +3Domain Generalization for Semantic SegmentationSemantic Segmentation

  2. Towards Long-Form Spatio-Temporal Video Grounding

    Feb 26, 2026Xin Gu, Bing Fan, Jiali Yao +5Temporal Video GroundingLong-Context Modeling

  3. StoryMovie: A Dataset for Semantic Alignment of Visual Stories with Movie Scripts and Subtitles

    Feb 25, 2026Daniel Oliveira, David Martins de MatosVisual StorytellingVision-Language Alignment

  4. Focusing Where Vision Matters: Selective Training for Large Vision Language Models via Visual Information Gain

    Feb 19, 2026Seulbi Lee, Sangheum HwangVision-Language ModelsLarge Vision-Language Models

  5. Saliency-Aware Multi-Route Thinking: Revisiting Vision-Language Reasoning

    Feb 18, 2026Mingjia Shi, Yinhan He, Yaochen Zhu +1VLM ReasoningReasoning for VLMs

  6. Revealing and Enhancing Core Visual Regions: Harnessing Internal Attention Dynamics for Hallucination Mitigation in LVLMs

    Feb 17, 2026Guangtao Lyu, Qi Liu, Chenghao Xu +5Attention Intervention in VLMsVLM Hallucination Mitigation

  7. Do MLLMs Really See It: Reinforcing Visual Attention in Multimodal LLMs

    Feb 9, 2026Siqu Ou, Tianrui Wan, Zhiyuan Zhao +2Reasoning for VLMsAttention Intervention in VLMs

  8. PixSearch: Region-Grounded Retrieval for Knowledgeable Large Multimodal Models

    Jan 27, 2026Jeonghwan Kim, Renjie Tao, Sanat Sharma +8Multimodal RAGVisual Question Answering

  9. Visual-Language-Guided Task Planning for Horticultural Robots

    Jan 17, 2026Jose Cuaran, Kendall Koe, Aditya Potnis +2Large Language Model-Based Robot PlanningVision-Language Grounding

  10. PathFLIP: Fine-grained Language-Image Pretraining for Versatile Computational Pathology

    Dec 19, 2025Fengchun Liu, Songhan Jiang, Linghan Cai +2Computational PathologyVision-Language Grounding

  11. VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing

    Dec 12, 2025Emanuel Sánchez Aimar, Gulnaz Zhambulova, Fahad Shahbaz Khan +2Multimodal UnderstandingCross-Modal Learning

  12. MMLongCite: A Benchmark for Evaluating Faithfulness of Long-Context Vision-Language Models

    Oct 15, 2025Keyan Zhou, Zecheng Tang, Lingfeng Ming +9VLM EvaluationVision-Language Grounding

  13. Constructive Distortion: Improving MLLMs with Attention-Guided Image Warping

    Oct 10, 2025Dwip Dalal, Gautam Vashishtha, Utkarsh Mishra +6Object Hallucination in VLMsMultimodal Large Language Models

  14. Talk in Pieces, See in Whole: Disentangled and Hierarchical Representation Learning in Language-based Object Detection

    Sep 29, 2025Sojung An, Kwanyong Park, Yong Jae Lee +1Open-Vocabulary Object DetectionDisentangled Representation Learning

  15. RefAM: Attention Magnets for Zero-Shot Referral Segmentation

    Sep 26, 2025Anna Kukleva, Enis Simsar, Alessio Tonioni +4Attention MechanismsImage Segmentation

  16. TAR: Temporal Anchor-Constrained Reasoning for Video Temporal Grounding

    Aug 11, 2025Chaohong Guo, Xun Mo, Yongwei Nie +3Temporal Video GroundingVision-Language Models

  17. MLLM-Guided Autonomous Object Detection for Open-World Understanding

    Jul 14, 2025Furkan Mumcu, Michael J. Jones, Anoop Cherian +1Open-Vocabulary Object DetectionVision-Language Grounding

  18. FORGE: Forensic Reasoning with Grounded Evidence

    Mar 20, 2025Rohit Kundu, Shan Jia, Vishal Mohanty +2VLM AdaptationExplainable Deepfake Detection

  19. Fine-Grained Instruction-Guided Graph Reasoning for Vision-and-Language Navigation

    Mar 14, 2025Yaohua Liu, Binkai Ou, Rong Fu +2Vision-Language NavigationVision-Language Grounding

  20. Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding

    Dec 1, 2024Zilin Du, Haoxin Li, Jianfei Yu +1Vision-Language GroundingTraining Data Selection