Vision-Language Grounding

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 175% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 288

All topics

Improving Visual Grounding in Remote Sensing via Cluster-Guided Refinement and Model Ensemble Voting
May 30, 2026Panav Shah, Geet Sethi, Ashutosh GandheRemote Sensing Vision-Language Grounding
Indian Institute of Technology Bombay Mumbai, India · Indian Institute of Technology Bombay2026 Mumbai, India
Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely
May 29, 2026Chalamalasetti Kranti, Sherzod Hakimov, David SchlangenVisual Spatial Reasoning Multi-Agent Collaboration
Computational Linguistics, Department of Linguistics University of Potsdam, Germany · German Research Center for Artificial Intelligence (DFKI), Berlin, Germany
FOCUS: Forcing In-Context Object Localization through Visual Support Constraints and Policy Optimization
May 29, 2026Mohammed Asad Karim, Vinay Kumar VermaVision-Language Grounding In-Context Learning
Amazon, Seattle, USA
iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning
May 29, 2026Chang-Bin Zhang, Yujie Zhong, Qiang Zhang +1Large Vision-Language Models Vision-Language Grounding
Visual AI Lab, The University of Hong Kong · Independent Researcher · University of Science and Technology of China
ReGuLaR: Relation-Grounded Latent Reasoning for Large Vision-Language Models
May 28, 2026Zihu Wang, Karthik Somayaji N. S, Peng LiVisual Reasoning Large Vision-Language Models
University of California, Santa Barbara
Mitigating Hallucination in Vision-Language Models through Barrier-Regulated Adaptive Closed-form Steering
May 28, 2026Soumyadeep Jana, Pulkit Mittal, Sanasam Ranbir SinghHallucination in Language Models Large Vision-Language Models
Indian Institute of Technology Guwahati, India
Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge
May 28, 2026Yinsong Xu, Wei Jing, Liuxin Zhang +2Egocentric Video QA Video QA
Lenovo, China
Reading or Guessing? Visual Grounding Failures of Vision-Language Models for OCR in Ancient Greek Editions
May 26, 2026Antonia Karamolegkou, Nicolas Angleraud, Benoît Sagot +1VLM Evaluation Document Understanding
Inria, Paris, France
LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
May 26, 2026Shihao Wang, Shilong Liu, Yuanguo Kuang +10Efficient VLM Inference Vision-Language Grounding
The Hong Kong Polytechnic University · NVIDIA · Princeton University +2
PinPoint: Prompting with Informative Interior Points
May 26, 2026Pouya Sadeghi, Shawn He, Pedro Pablo Guerrero Vela +3Image Segmentation Promptable Image Segmentation
University of Waterloo · 2Critical ML, University of Waterloo · 3Apple
OmniGF: A Dual-Branch Vision-Language Framework for Unified Gaze Following
May 26, 2026Qiaomu Miao, Haoyu Wu, Jingyi Xu +2Gaze Estimation Vision-Language Grounding
Stony Brook University · The University of Adelaide
DRScaffold: Boosting Dense-Scene Reasoning in Lightweight Vision Language Models
May 25, 2026Xinrui Shi, Kai Liu, Ziqing Zhang +3Visual Spatial Reasoning Vision-Language Grounding
1Shanghai Jiao Tong University
Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker
May 25, 2026Zongjian Wu, Lei ZhangVLM Evaluation Vision-Language Grounding
School of Microelectronics and Communication Engineering, Chongqing University, Chongqing 400044, China
Binding Visual Features Point by Point
May 25, 2026Udith Haputhanthri, Declan Campbell, Rim Assouel +2Vision-Language Models VLM Interpretability
Princeton University · Mila – Quebec AI Institute · Université de Montréal
Dual-Pathway Geometry-Aware MLLM for Spatial Intelligence
May 25, 2026Yufei Zheng, Xuhan Zhu, Zide Liu +9Visual Spatial Reasoning Metric Depth Estimation
University of Science and Technology of China · Li Auto Inc. · Shanghai Jiao Tong University
PGT: Procedurally Generated Tasks for improving visual grounding in MLLMs
May 22, 2026Rim Assouel, Amir Bar, Michal Drozdzal +1Visual Spatial Reasoning Synthetic Data Generation
1Mila - Québec AI Institute · 4McGill University · 3FAIR at Meta Superintelligence Labs +2
Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision?
May 21, 2026Zixuan Lan, Luzhe Sun, Matthew R. Walter +1VLM Evaluation VLM Interpretability
University of Chicago · Toyota Technological Institute at Chicago · Stony Brook University
Transcoders Trace Visual Grounding and Hallucinations in Vision-Language Models
May 21, 2026Dimitrios Damianos, Leon Voukoutis, Georgios Skyrianos +2Object Hallucination in VLMs VLM Interpretability
Institute of Language and Speech Processing, Athena Research Center Athens, Greece
Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
May 21, 2026Rusiru Thushara, Yasiru Ranasinghe, Jay Paranjape +1Thermal Imaging Visual Question Answering
Department of Electrical & Computer Engineering, Johns Hopkins University, Baltimore, MD 21218 USA
UniVL: Unified Vision-Language Embedding for Spatially Grounded Contextual Image Generation
May 20, 2026Jiayun Wang, Yu Wang, Weijie Gan +2Image Generation Vision-Language Grounding
Center for Advanced AI, Accenture
VISTAQA: Benchmarking Joint Visual Question Answering and Pixel-Level Evidence
May 20, 2026Mozhgan Nasr Azadani, Yimu Wang, Yongpeng Zhu +5VLM Evaluation Visual Question Answering
University of Waterloo · Stanford University · NVIDIA
WildRoadBench: A Wild Aerial Road-Damage Grounding Benchmark for Vision-Language Models and Autonomous Agents
May 19, 2026Bingnan Liu, Chenhang Cui, Rui Huang +7VLM Evaluation AI Agent Benchmarks
University of Electronic Science and Technology of China · National University of Singapore · De Artificial Intelligence Lab +2
Mechanisms of Object Localization in Vision-Language Models
May 19, 2026Timothy Schaumlöffel, Martina G. Vilas, Gemma RoigVision-Language Models VLM Interpretability
Goethe University Frankfurt, Germany · The Hessian Center for AI, Germany
P2DNav: Panorama-to-Downview Reasoning for Zero-shot Vision-and-Language Navigation
May 19, 2026Kai Sheng, Liuyi Wang, Haojie Dai +5Embodied Navigation Vision-Language Navigation
Department of Control Science and Engineering, Tongji University, Shanghai 210804, China
EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data
May 18, 2026Dongyan Lin, Phillip Rust, Angel Villar Corrales +19VLM Evaluation Vision-Language Models
Meta Superintelligence Labs · Stanford University · Meta Reality Labs +2
Key-Gram: Extensible World Knowledge for Embodied Manipulation
May 18, 2026Jingjing Fan, Siyuan Li, Botao Ren +1Memory-Augmented VLMs Language-Conditioned Robot Manipulation
Department of Computer Science and Technology Tsinghua University · Department of Automation Tsinghua University
Visualizing the Invisible: Generative Visual Grounding Empowers Universal EEG Understanding in MLLMs
May 18, 2026Jun-Yu Pan, Yansen Wang, Enze Zhang +3EEG Decoding EEG-Based Visual Decoding
Shanghai Jiao Tong University Shanghai, China · Microsoft Research Asia Shanghai, China
Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models
May 18, 2026Xinpeng Dong, Min Zhang, Kairong Han +3Object Hallucination in VLMs Multimodal Large Language Models
Zhejiang University · East China Normal University · Zhejiang University of Science and Technology
See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding
May 18, 2026Boyuan Sun, Bowen Yin, Yuanming Li +2Cross-Modal Learning Video Object Segmentation
VCIP, CS, Nankai University · Tongyi Lab, Alibaba Group · NKIARI, Shenzhen Futian
SkyNative: A Native Multimodal Framework for Remote Sensing Visual Evidence Reasoning
May 18, 2026Xiao Yang, Ronghao Fu, Zhiwen Lin +10VLM Evaluation VLM Robustness
College of Computer Science and Technology, Jilin University, China · Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education

May 30, 2026, cs.CVJ/K move · Enter open · S save

Improving Visual Grounding in Remote Sensing via Cluster-Guided Refinement and Model Ensemble Voting

Panav Shah, Geet Sethi, Ashutosh Gandhe

Indian Institute of Technology Bombay Mumbai, India · Indian Institute of Technology Bombay2026 Mumbai, India

Remote Sensing Vision-Language Grounding Visual Grounding Remote Sensing Visual Grounding

Open paper AskPDF arXiv

Visual grounding aims to locate image regions that correspond to natural language descriptions and is a key component of interpretable vision systems. In remote sensing imagery, grounding is particularly challenging due to complex scenes, small objects, and large variations in scale. Relying on a single model is often insufficient to address these diverse challenges. In this work, we propose two grounding pipelines, Sequential Grounding Refinement (SGR) and Cluster-Aware Grounding Refinement (CGR), that combine the complementary strengths of RemoteSAM, a visual grounding model specialized for remote sensing, and SAM3, a powerful general-purpose segmentation model. Our approach first uses RemoteSAM to obtain an initial estimate of object location, which is then refined using SAM3 to produce more accurate and spatially consistent segmentations. Additionally, we explore an ensemble strategy based on majority voting across six diverse grounding pipelines, each with distinct capabilities. This multi-model framework improves robustness and significantly enhances localization accuracy. Experimental results demonstrate that the proposed pipelines and ensemble approach outperform individual models, leading to more reliable and precise visual grounding predictions.

Momentum

Related topics

Latest papers 288