Vision-Language Grounding

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 175% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 288

All topics

SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation
May 17, 2026Jingzhi Huang, Junkai Huang, Wenxuan Song +4Visual Spatial Reasoning Vision-Language Navigation
Hong Kong Polytechnic University · Institute of Automation, Chinese Academy of Sciences · Hong Kong University of Science and Technology (Guangzhou)
EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models
May 16, 2026Haozhe Shan, Xiancong Ren, Han Dong +9VLM Evaluation Vision-Language Grounding
X-Humanoid · University of New South Wales · University of Science and Technology of China +4
From Failure to Feedback: Group Revision Unlocks Hard Cases in Object-Level Grounding
May 15, 2026Yuyuan Liu, Yiping Ji, Anjie Le +6Vision-Language Grounding Visual Grounding
Department of Engineering Science, University of Oxford · Australian Institute for Machine Learning, Adelaide University · Technical University of Munich +2
DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
May 15, 2026Yichao Liu, Huawen Shen, Liu Yu +3GUI Agents GUI Grounding
1Nankai University · Institute of Information Engineering, Chinese Academy of Sciences
SteerSeg: Attention Steering for Reasoning Video Segmentation
May 14, 2026Ali Cheraghian, Hamidreza Dastmalchi, Abdelwahed Khamis +3Video Object Segmentation Referring Video Object Segmentation
1Macquarie University · 2York University · 3CSIRO Data61 +1
EARL: Towards a Unified Analysis-Guided Reinforcement Learning Framework for Egocentric Interaction Reasoning and Pixel Grounding
May 14, 2026Yuejiao Su, Xinshen Zhang, Zhen Ye +3Egocentric Video Understanding Vision-Language Grounding
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR. · Division of Emerging Interdisciplinary Areas (EMIA), The Hong Kong University of Science and Technology, Hong Kong SAR.
Towards Unified Surgical Scene Understanding:Bridging Reasoning and Grounding via MLLMs
May 13, 2026Jincai Huang, Shihao Zou, Yuchen Guo +5Surgical Video Understanding Vision-Language Grounding
Southern University of Science and Technology · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · Northwestern University +4
CLIP Tricks You: Training-free Token Pruning for Efficient Pixel Grounding in Large VIsion-Language Models
May 13, 2026Sangin Lee, Yukyung ChoiEfficient VLM Inference Vision-Language Grounding
Dept. of Artificial Intelligence and Robotics, Sejong University, Seoul, Republic of Korea · Artificial Intelligence and Robotics Institute (AIRI), Sejong University, Seoul, Republic of Korea
Early Semantic Grounding in Image Editing Models for Zero-Shot Referring Image Segmentation
May 13, 2026Jingxuan He, Xiyu Wang, Yunke Wang +2Image Segmentation Referring Image Segmentation
The University of Sydney
From Web to Pixels: Bringing Agentic Search into Visual Perception
May 12, 2026Bokang Yang, Xinyi Sun, Kaituo Feng +3Visual Question Answering Vision-Language Grounding
1Shenzhen Loop Area Institute · 2Wuhan University · 3CUHK MMLab
Allegory of the Cave: Measurement-Grounded Vision-Language Learning
May 12, 2026Kepeng Xu, Li Xu, Gang He +1Large Vision-Language Models Vision-Language Grounding
Xidian University · Southwest University of Science and Technology
Grounded or Guessing? LVLM Confidence Estimation via Blind-Image Contrastive Ranking
May 11, 2026Reza Khanmohammadi, Erfan Miahi, Simerjot Kaur +4VLM Evaluation Vision-Language Models
Michigan State University · Independent AI Researcher · JPMorgan AI Research +1
The Gordian Knot for VLMs: Diagrammatic Knot Reasoning as a Hard Benchmark
May 11, 2026Hao Liu, Jicheng LiuVLM Evaluation Vision-Language Grounding
Department of Psychology New York University · Department of Computer Science University of Southern California
Reflection Anchors for Propagation-Aware Visual Retention in Long-Chain Multimodal Reasoning
May 10, 2026Xuan Gong, Hanbo Huang, Hao Zheng +4Vision-Language Models Vision-Language Grounding
Shanghai Jiao Tong University · Lanzhou University
From Pixels to Concepts: Do Segmentation Models Understand What They Segment?
May 10, 2026Shuang Liang, Zeqing Wang, Yuxian Li +2VLM Evaluation Image Segmentation
Department of Electrical and Computer Engineering, The University of Hong Kong · CASIC · School of Computer Science and Engineering, Sun Yat-sen University +1
Evading Visual Aphasia: Contrastive Adaptive Semantic Token Pruning for Vision-Language Models
May 10, 2026Jie Ma, Yihang Liu, Zhike Qiu +2Efficient VLM Inference Vision-Language Grounding
Xiamen University
What Happens Before Decoding? Prefill Determines GUI Grounding in VLMs
May 10, 2026Jiaping Lin, Fei Shen, Junzhe Li +4GUI Grounding Vision-Language Grounding
1Guangming Laboratory · 2National University of Singapore · 3Peking University +2
Language-Conditioned Visual Grounding with CLIP Multilingual
May 9, 2026J. de Curtò, Mauro Liz, I. de ZarzàVLM Evaluation Multilingual VLM Evaluation
Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, Barcelona, Spain · Estudis d’Informàtica, Multimèdia i Telecomunicació, Universitat Oberta de Catalunya, Barcelona, Spain · Escuela T´ecnica Superior de Ingenier´ıa (ICAI), Universidad Pontificia Comillas, Madrid, Spain +2
Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?
May 9, 2026Filippo Ziliotto, Ciro Beneduce, Bruno Lepri +3AI Agent Evaluation Vision-Language Grounding
University of Padova · FondazioneLucianoBrunoSerafiniKessler · Fondazione Bruno Kessler
Qwen3-VL-Seg: Unlocking Open-World Referring Segmentation with Vision-Language Grounding
May 8, 2026Yuan Yao, Qiushi Yang, Humen Zhong +5Image Segmentation Referring Expression Segmentation
Tongyi Lab, Alibaba Group
Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
May 8, 2026Jin Cui, Xinyue Long, Xunyong Zhang +5Visual Spatial Reasoning Visual Reasoning
1State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Software Engineering, State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University
MSD-Score: Multi-Scale Distributional Scoring for Reference-Free Image Caption Evaluation
May 7, 2026Shichao Kan, Xuyang Zhang, Haojie Zhang +7Cross-Modal Alignment Vision-Language Grounding
School of Computer Science and Engineering, Central South University, Changsha, 410083, China · School of Computer Science and Technology and the State Key Laboratory of Advanced Rail Autonomous Operation, Beijing Jiaotong University, Beijing, 100044, China · School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, 101408, China +1
Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions
May 7, 2026Kjetil Indrehus, Adrian Duric, Changkyu Choi +1Vision-Language Grounding Document QA
Department of Informatics, University of Oslo · Integreat – Norwegian Centre for Knowledge-driven Machine Learning · TRUST – The Norwegian Centre for Trustworthy AI
RemoteZero: Geospatial Reasoning with Zero Human Annotations
May 6, 2026Liang Yao, Fan Liu, Shengxiang Xu +4Self-Training Remote Sensing
1Hohai University · 2Southeast University
Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting
May 4, 2026Giacomo Pacini, Luca Ciampi, Nicola Messina +3VLM Evaluation VLM Robustness
Institute of Information Science and Technologies of the National Research Council (ISTI-CNR), Via G. Moruzzi 1, 56124, Pisa, Italy · University of Pisa - Department of Information Engineering, Via G. Caruso 16, 56122 Pisa, Italy
AutoFocus: Uncertainty-Aware Active Visual Search for GUI Grounding
May 4, 2026Ruilin Yao, Shegnwu Xiong, Tianyu Zou +2Uncertainty Quantification GUI Grounding
Wuhan University of Technology
Referring Multiple Regions with Large Multimodal Models via Contextual Latent Steering
May 3, 2026Yun Xing, Hanyuan Liu, Jiahao Nie +1Multimodal Large Language Models Vision-Language Grounding
Nanyang Technological University
Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video
May 2, 2026Jiantang HuangTemporal Video Grounding Large Vision-Language Models
Chain of Evidence: Pixel-Level Visual Attribution for Iterative Retrieval-Augmented Generation
May 2, 2026Peiyang Liu, Ziqiang Cui, Xi Wang +2Retrieval-Augmented Generation Vision-Language Grounding
National Engineering Research Center for Software Engineering, Peking University Beijing, China · City University of Hong Kong Hong Kong SAR, China · Tencent Technology Beijing, China
FineState-Bench: Benchmarking State-Conditioned Grounding for Fine-grained GUI State Setting
Apr 30, 2026Fengxian Ji, Jingpu Yang, Zirui Song +5GUI Agents Vision-Language Grounding
MBZUAI · Northeastern University, China

May 17, 2026, cs.ROJ/K move · Enter open · S save

SEDualVLN: A Spatially-Enhanced Dual-System for Vision-Language Navigation

Jingzhi Huang, Junkai Huang, Wenxuan Song, Haoyang Yang+3

Hong Kong Polytechnic University · Institute of Automation, Chinese Academy of Sciences · Hong Kong University of Science and Technology (Guangzhou)

Visual Spatial Reasoning Vision-Language Navigation Vision-Language Grounding VLM Reasoning

Open paper AskPDF arXiv

Vision-Language Navigation (VLN) approaches have currently followed two primary paradigms: the end-to-end Vision-Language Model (VLM) policy fine-tuned on navigation trajectories to directly predict actions, and the zero-shot modular pipeline integrating pre-trained Multimodal Large Language Model (MLLM) for training-free generalization to unseen environments. However, end-to-end methods struggle with long-horizon navigation and lack dynamic reasoning, whereas zero-shot methods are constrained by limited spatial grounding for reliable planning and also require substantial reasoning time. To bridge this gap, we introduce SEDualVLN, a spatially-enhanced dual-system VLN framework. System 1 is a VLM model enhanced with both global and local spatial awareness, used for action generation. System 2 integrates a general MLLM with a mapping module, wherein the MLLM plans waypoints by leveraging top-down views of the real-time 3D map alongside streams of rendered path images. Both systems leverage different forms of spatial enhancement to cultivate the agent's sense of direction in VLN tasks. Ultimately, they cooperate to complete the navigation task through a fast-slow coordinated approach. SEDualVLN achieves state-of-the-art performance on VLN-CE benchmarks, and further ablation studies demonstrate the effectiveness of each system and module.

Momentum

Related topics

Latest papers 288