Overview

Vision-language grounding studies how models connect language to specific visual evidence, enabling them to locate a described object, segment a region, track an entity through video, or act on an instruction. Common approaches align text with image regions using contrastive learning, detection, segmentation, and point or box prediction; newer multimodal models also use attention, structured scene representations, visual search, and step-by-step evidence grounding. Evaluation spans referring-expression benchmarks, high-resolution and video localization, document understanding, and embodied tasks such as navigation and robotic manipulation. A central challenge is that correct answers do not prove models used the image: language priors, ambiguity, small or changing targets, and long-horizon context can all undermine faithful and robust grounding.

Latest papers

CardsList

444 papers32 papers in the last four weeks, down 36% on the four weeks before. 0.2% of all new papers.

  1. ScaleDiag: Diagnosing the Limits of Test-Time Scaling in GUI Grounding

    Nov 18, 2026Chen Liu, Zhen Fang, Xin Yu +2GUI GroundingVision-Language Grounding

  2. Bits, Not Boxes: Label-Free Layer Selection for Visual Localization in VLMs

    Nov 17, 2026Haisheng Fu, Gexin Huang, Haikai Zhao +4Vision-Language GroundingVLM Interpretability

  3. Semantic-Guided Geometric Decoding for Token-Efficient Visual Grounding

    Nov 17, 2026Zhaojie Chen, Junyan Yang, Le Yang +6Vision-Language GroundingVisual Grounding

  4. Seeing Isn't Resolving: Visual and Linguistic Disambiguation with Conversational Grounding

    Nov 16, 2026Edoardo Cecchinato, Shun Inadumi, Angel García Contreras +2Vision-Language GroundingVLM Evaluation

  5. Do VLMs Really Look at the Road? A Diagnostic Evaluation for Autonomous Driving

    Nov 14, 2026Shankar Gangisetty, Muskan Singh, C V JawaharVLMs for Autonomous DrivingAutonomous Driving Safety Evaluation

  6. From Images to Grounded Edits: A Real-World Benchmark for Chinese Grammatical Error Correction in Handwritten Essays

    Nov 13, 2026Weiru Zhang, Yuzhong Hong, Junwei Bao +2Grammatical Error CorrectionVision-Language Grounding

  7. QCAP-VQA: Question-Conditioned Capped Prior-Mass Supervision for Medical Visual Question Answering

    Nov 13, 2026Yining Zhao, Catarina Moreira, Mukesh Prasad +1Medical Visual Question AnsweringMedical Image Grounding

  8. AITHER: Authority-Informed Evidence Routing for Mixed-Authority Vision-Language Reasoning

    Nov 10, 2026Xinjin Li, Haoyue Zhang, Xinyi Gou +7VLM ReasoningVision-Language Grounding

  9. Disentangling Multimodal Rotary Positional Embedding in Vision-Language Models

    Nov 9, 2026Zhaoyi Liu, Haichuan Zhang, Xiaochuan Gong +5Positional EncodingPosition Bias in VLMs

  10. VIGOR: Benchmarking Visual Rationale Correctness in Multimodal Large Language Models

    Nov 9, 2026Yanlin Chen, Tang Li, Xi PengMLLM EvaluationVision-Language Grounding

  11. DisasterVLG: Vision-Language Grounding and Evidence-Based Reasoning for Disaster Scene Understanding

    Nov 9, 2026Ali Diba, Aisha Al-Mohannadi, Yin Yang +2Vision-Language GroundingVLM Evaluation

  12. Where Does Proposal Selection Fail? Diagnosing Frozen Vision-Language Queries over Detector Proposals

    Nov 9, 2026Bo Ma, Weiqi Yan, Jinsong WuOOD Generalization in VLAsVision-Language Grounding

  13. VisProve: Learning Typed Visual Provenance for Scientific Document Question Answering

    Nov 7, 2026Jingxuan Wei, Zhengyang Wang, Zheng Guo +6Evidence-Grounded QAScientific QA

  14. CAPTOR: text-encoder-free grounding by counting caption co-occurrence over the visual words of a frozen encoder

    Nov 3, 2026Elad Yoshai, Natan T. ShakedVision-Language GroundingText-Guided Image Segmentation

  15. CLARA: A Cognitively-Driven Clarification Framework for Grounding Ambiguous Requests

    Nov 3, 2026Dimitrios Bekris, Marios Glytsos, Panagiotis P. Filntisis +3Instruction FollowingVision-Language Agents

  16. Beyond Token Representations: Explicit Visual Object Grounding for Video Reasoning Segmentation

    Nov 3, 2026Jun Huang, Junyang Zhang, Zijie Yue +3Video ReasoningVideo Object Segmentation

  17. Open-Weight MLLMs Cannot Compare What They Cannot Name

    Oct 30, 2026Wenxin Su, Anna KreshukMLLM EvaluationVision-Language Grounding

  18. Grounding Multimodal Reasoning with Evidence-Ablated Negatives

    Oct 29, 2026Chenxi Liu, Tianyi Xiong, Yanshuo Chen +1Multimodal ReasoningRL for VLMs

  19. What Sketches Tell Us about LVLMs: Conventions, Grounding, and Localisation

    Oct 25, 2026Chaitat Utintu, Ahmed Bourouis, Arkaprabha Basu +1Vision-Language ModelsVLM Interpretability

  20. Grounding on Request: Learning Modality Control in Vision-Language Models

    Oct 24, 2026Maxime Dassen, Alexander Martin, Andrew Yates +2Vision-Language GroundingVisual Evidence Sensitivity in VLMs