Vision-Language Grounding

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 175% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 288

All topics

When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMs
Aug 25, 2026Zhengxiang Wang, Owen RambowVLM Evaluation Large Vision-Language Models
Department of Linguistics & IACS Stony Brook University
Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding
Aug 13, 2026Junyi Hu, Tian Bai, Fengyi Wu +7Vision-Language Models Vision-Language Grounding
Department of Automation, Tsinghua University · School of Information and Communication Engineering, University of Electronic Science and Technology of China · Chinalco Digital Intelligence (Chengdu) Technology Co., Ltd. +2
Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors
Aug 13, 2026LingKai BuImage Captioning Object Hallucination in VLMs
Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
LookBack: Where and How to Score LVLM Responses via Visual Reference Usage
Aug 12, 2026Beomsik Cho, Jinhyeong Kim, Dongseok Lee +1VLM Evaluation Hallucination Detection in VLMs
Yonsei University
MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment
Aug 11, 2026Changhao Xiang, Shangyu Xing, Zhen Wu +2Multimodal Grounding Multimodal Pretraining
National Key Laboratory for Novel Software Technology, Nanjing University, China
MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models
Aug 11, 2026Yuan Wang, Hualiang Wang, Yixin Chen +6Unified Multimodal Models Vision-Language Grounding
Zhejiang University · Fudan University
Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models
Aug 10, 2026Hunter Schofield, Mohammed Elmahgiubi, Mohammad Mahdavian +4Geometric Representation Learning Vision-Language Grounding
York University · Huawei Technologies Canada · University of Toronto
From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation
Aug 10, 2026Zeyuan Ma, Jiaxin Chen, Di HuangUAV Navigation Vision-Language Navigation
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China · School of Computer Science and Engineering, Beihang University, Beijing, China
Right Answer, Wrong Heat: Explanation-Aware Evaluation and Thermal-Grounded Feedback for MLLMs on Infrared Images
Aug 10, 2026Yongsong Huang, Xiaofeng Liu, Tomo Miyazaki +2Vision-Language Models Vision-Language Grounding
Tohoku University · Yale University
SG-WAM: Text-Grounded and Spatial-aware Semantic Guidance for World-Action Models
Aug 9, 2026Junjie He, Junfeng Li, Zhide Zhong +9World Models for Robotics Language-Conditioned Robot Manipulation
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Ola Dimensions, Shenzhen, China
A Dynamic-Semantics Framework for Grounding Human Referring Expressions in Visual Perceptual Data
Aug 9, 2026Joseph BinghamVision-Language Grounding Visual Grounding
Department of Biology, Technion University, Haifa, IL.
Evidence-RL: Towards Evidence-intensive Visual Reasoning
Aug 8, 2026Haojie Huang, Xinlei Yu, Chengming Xu +6Vision-Language Grounding Visually Grounded Reasoning
National University of Singapore · Zhejiang University · Fudan University +2
SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning
Aug 8, 2026Yizhi Li, Jiawei Jiang, Guanhong Wang +2Sports Video Analysis Video QA
Zhejiang University Hangzhou, China · Beijing Jiaotong University Beijing, China
Vision-Language Grounding as Bidirectional Concept Correspondence
Aug 8, 2026Jieyu Zhang, Ziqi Gao, Luke Zettlemoyer +1Vision-Language Grounding Vision-Language Alignment
University of Washington · Allen Institute for AI · FAIR at Meta
I Seek You in Videos: Identity-Conditioned Queries for Person-Centric Video Reasoning
Aug 7, 2026Shibo Gao, Chongxiao Wang, Chenglong Huang +10Video QA Vision-Language Grounding
School of Computing and Communications Lancaster University Lancaster, United Kingdom
Human-AI Perceptual Alignment by Playing Hues and Cues
Aug 7, 2026Nuria Alabau-Bosque, Jorge Vila-Tomás, Paula Daudén-Oliver +3VLM Evaluation Vision-Language Grounding
Image Processing Lab, Universitat de València, Carrer del Catedrátic José Beltrán Martinez, Paterna, 46980, Spain
Visual Grounding in Zero-Shot Vision-Language Control
Aug 6, 2026J. de Curtò, Dayani Plasencia, Diego Sánchez +1VLM Evaluation VLMs for Autonomous Driving
Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, Barcelona, Spain · Escuela T´ecnica Superior de Ingenier´ıa (ICAI), Universidad Pontificia Comillas, Madrid, Spain · Estudis d’Inform`atica, Multim`edia i Telecomunicaci´o, Universitat Oberta de Catalunya, Barcelona, Spain +3
Simile Understanding in Text-to-Image Models: An Evaluation Framework
Aug 5, 2026Luecheng Wang, Shintaro Ozaki, Hidetaka Kamigaito +4Figurative Language Understanding Vision-Language Grounding
The University of Tokyo · Nara Institute of Science and Technology · Chungnam National University +1
When Prompts Become Pixels: Prompt-Region Grounding for Multimodal Reasoning
Aug 5, 2026Yongxin Wang, Ruizhe Zhou, Yueling Tang +4Multimodal QA Multimodal Reasoning
Mohamed bin Zayed University of Artificial Intelligence · Sun Yat-sen University · Transsion +1
GUARD: Grounding Uncertainty and Ablation-Based Risk Detection for Diffusion-Based VLAs
Aug 5, 2026Suhas Hegde, Jitendra Yasaswi Bharadwaj KattaUncertainty Estimation for VLA Models Vision-Language Grounding
Bosch Research India
Thinking with Anchors: Grounded and Efficient Document Reasoning
Aug 5, 2026Sichen Zhu, Yuchen Zhu, Wenzhuo Xu +13Vision-Language Grounding Document Layout Analysis
1Georgia Tech · 2CMU · 3Adobe +5
Geo-Embed: Towards Unified Multimodal Embeddings for Urban Understanding
Aug 4, 2026Jiapeng Li, Yong Li, Junjie Zhou +2Geospatial Representation Learning Cross-Modal Retrieval
1Peking University · 2Beijing University of Posts and Telecommunications
SEER: A Self-Grounded Evidence Interface for Controlled Spatial Relation Classification
Aug 4, 2026Feixiang Liu, Likun Wang, Qiang Qiu +3Visual Spatial Reasoning Vision-Language Grounding
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences
Hi-Token: Hierarchical Coordinate Tokenization for Generative Visual Grounding
Aug 4, 2026Xiuyuan Zhu, Ke Lu, Kun Dong +6Vision-Language Grounding
University of Chinese Academy of Sciences, Beijing, China · 2State Key Laboratory of Communication Content Cognition, Beijing, China · 3Peng Cheng Laboratory, Shenzhen, Guangdong, China +1
Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models
Aug 3, 2026Zhaokai Yin, Zhipeng ZhangVision-Language Grounding Vision-Language-Action Models
1AutoLab, School of Artificial Intelligence, Shanghai Jiao Tong University · 2Research Lab, Anyverse Dynamics
Grounding Agentic VLMs with Dedicated Segmentation for Fine-Grained Vehicle Damage Assessment
Aug 3, 2026Vishwajeet Shivaji Hogale, Anjali Pai, Nitya RaviImage Segmentation Vision-Language Grounding
Northeastern University
Dynamic Resolution Routing for Efficient Egocentric Grounding
Aug 3, 2026Huixin Sun, Wangbo Zhao, Fanyue Wei +3Efficient VLM Inference Vision-Language Grounding
National University of Singapore · The Hong Kong University of Science and Technology · Nanyang Technological University
VespaSeg: A Resource-Aware Ground-then-Segment Pipeline for Referring Expression Segmentation
Aug 2, 2026Savindu Dilshan WickramasinghePromptable Image Segmentation Efficient VLM Inference
University of Moratuwa · Department of Electronic and Telecommunication Engineering, University of Moratuwa Moratuwa, Sri Lanka
SpatialAfford: Teaching Compact VLMs Where to Look and Where to Ground for Affordance
Aug 1, 2026Yufei Zhang, Chenlu Zhan, Donghui Sun +2Vision-Language Grounding VLMs for Robotics
Zhejiang University · Vivo Mobile Communication Co., Ltd
CrossProjection: Geometric Grounding Beyond Viewpoint Change in Architectural Drawings
Aug 1, 2026Kaho Li, Pengyu Zeng, Yuqin Dai +3Multi-View Consistency Vision-Language Grounding
Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China · UCL Institute for Environmental Design and Engineering, The Bartlett School of Environment, Energy and Resources, University College London, London, UK

Aug 25, 2026, cs.AIJ/K move · Enter open · S save

When Seeing Is Not Enough: Benchmarking Interactive Visual Grounding in LVLMs

Zhengxiang Wang, Owen Rambow

Department of Linguistics & IACS Stony Brook University

VLM Evaluation Large Vision-Language Models Vision-Language Grounding Visual Grounding

Open paper AskPDF arXiv

Visual grounding is typically evaluated as a one-shot mapping from an informative referring expression to a visual target. This formulation misses a central property of real-world reference: initial referring expressions are often incomplete or ambiguous, requiring participants to establish shared understanding through interaction. We introduce a controlled evaluation framework for interactive visual grounding in large vision-language models (LVLMs), varying how much target information is provided upfront and how much must be acquired through dialogue. Across four human-grounded visual contexts and four interaction protocols, current LVLMs perform significantly below task-level human baselines. Interaction can help when follow-up questions refine or repair an initial target description. Performance is lowest when no initial description is provided and target information must be acquired through questions, indicating that proactive question-driven grounding remains difficult. LVLMs are also poorly calibrated, often reporting confidence that exceeds their empirical accuracy. Follow-up studies confirm these patterns across varied description sources (human versus AI), reasoning efforts, repeated interactions, description providers, and visual contexts. Overall, interactive visual grounding remains challenging, requiring visual matching, information seeking and synthesis.

Momentum

Related topics

Latest papers 288