Vision-Language Grounding

Follow this topic Ask about this topic

Momentum

44 papers in the last four weeks, up 175% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 288

All topics

COHERENCE: Benchmarking Fine-Grained Image-Text Alignment in Interleaved Multimodal Contexts
Apr 30, 2026Bingli Wang, Huanze Tang, Haijun Lv +5Vision-Language Models Vision-Language Grounding
1Southeast University · 2Shanghai AI Laboratory
InterPartAbility: Phrase-Region Grounding for Interpretable Text-to-Image Person Re-Identification
Apr 29, 2026Shakeeb Murtaza, Aryan Shukla, Rajarshi Bhattacharya +2VLM Interpretability Vision-Language Grounding
LIVIA, Dept. of Systems Engineering, ETS Montreal, Canada · Genetec Inc.
Beyond Shortcuts: Mitigating Visual Illusions in Frozen VLMs via Qualitative Reasoning
Apr 29, 2026Hao Guo, Fei Wang, Junjie Chen +4VLM Robustness Visual Reasoning
Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China · Anhui Polytechnic University, Wuhu, China · Hefei University of Technology, Hefei, China +2
Instruction-Evidence Contrastive Dual-Stream Decoding for Grounded Vision-Language Reasoning
Apr 28, 2026Yashwant Pravinrao Bangde, Debaditya RoyObject Hallucination in VLMs Vision-Language Grounding
Department of Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur, India 721302
A systematic evaluation of vision-language models for observational astronomical reasoning tasks
Apr 27, 2026Wenke Ren, Hengxiao Guo, Wenwen Zuo +1VLM Evaluation Vision-Language Models
Shanghai Astronomical Observatory, Chinese Academy of Sciences, Shanghai, China · Harvard University, Boston, Massachusetts, USA
Global Context or Local Detail? Adaptive Visual Grounding for Hallucination Mitigation
Apr 27, 2026Yubo Jiang, Xin Yang, Abudukelimu Wuerkaixi +7Hallucination in Language Models Object Hallucination in VLMs
School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China
Robust Grounding with MLLMs Against Occlusion and Small Objects via Language-Guided Semantic Cues
Apr 27, 2026Beomchan Park, Seongho Kim, Hyunjun Kim +2VLM Robustness LLM Grounding
Integrated Vision Language Lab., KAIST, Republic of Korea
MIRAGE: A Micro-Interaction Relational Architecture for Grounded Exploration in Multi-Figure Artworks
Apr 26, 2026Jui-Cheng Chiu, Yu-Chao Wang, Shengyang Luo +4Visual Spatial Reasoning Object Hallucination in VLMs
Purdue University
Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training
Apr 25, 2026Suning Huang, Jiaqi Shao, Ke Wang +5Vision-Language Grounding Vision-Language-Action Models
Stanford University
CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation
Apr 24, 2026Suiyang Guang, Chenyu Liu, Ruohan Zhang +1Vision-Language Grounding
Institute of Intelligent Vision and Embodied Cognition
Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision
Apr 23, 2026Chentao Li, Zirui Gao, Mingze Gao +3Multimodal QA Vision-Language Grounding
Department of Automation, Tsinghua University · Academy of Art & Design, Tsinghua University
VG-CoT: Towards Trustworthy Visual Reasoning via Grounded Chain-of-Thought
Apr 23, 2026Byeonggeuk Lim, Kyeonghyun Kim, JungMin Yun +1VLM Evaluation CoT Reasoning
Graduate School of Advanced Imaging Science, Multimedia & Film, Chung-Ang University1 · Department of Artificial Intelligence, Chung-Ang University2
Can MLLMs "Read" What is Missing?
Apr 23, 2026Jindi Guo, Chaozheng Huang, Xi FangVLM Evaluation Document Understanding
DP Technology
Measure Twice, Click Once: Co-evolving Proposer and Visual Critic via Reinforcement Learning for GUI Grounding
Apr 23, 2026Wenkai Wang, Xiyun Li, Hongcan Guo +5Reinforcement Learning GUI Grounding
Zhejiang University · Tencent AI Lab · The University of Hong Kong
Beyond Pixels: Introspective and Interactive Grounding for Visualization Agents
Apr 22, 2026Yiyang Lu, Woong Shin, Ahmad Maroof Karimi +3Scientific Visualization Data Visualization
William & Mary · Oak Ridge National Laboratory
The Expense of Seeing: Attaining Trustworthy Multimodal Reasoning Within the Monolithic Paradigm
Apr 22, 2026Karan GoyalVLM Evaluation Multimodal Reasoning
IIIT Delhi, India
From Scene to Object: Text-Guided Dual-Gaze Prediction
Apr 22, 2026Zehong Ke, Yanbo Jiang, Jinhao Li +5Gaze Estimation Autonomous Driving Perception
School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China · Cho Chun Shik Graduate School of Mobility, Korea Advanced Institute of Science and Technology (KAIST), Daejeon 34141, Republic of Korea
PLaMo 2.1-VL Technical Report
Apr 21, 2026Tommi Kerola, Yuya Masuda, Takashi Masuko +5Visual Question Answering Vision-Language Models
Preferred Networks, Inc. (PFN)
AnchorSeg: Language Grounded Query Banks for Reasoning Segmentation
Apr 20, 2026Rui Qian, Chuanhang Deng, Qiang Huang +6Image Segmentation Text-Guided Image Segmentation
College of Computer Science and Artificial Intelligence, Fudan University · 2BEDI Cloud
Instruction-as-State: Environment-Guided and State-Conditioned Semantic Understanding for Embodied Navigation
Apr 20, 2026Zhen Liu, Yuhan Liu, Jinjun Wang +3Embodied Navigation Vision-Language Navigation
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, China · The Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xian Ning West Road No. 28, Xi’an, 710049, Shaanxi, China · School of Information Science and Technology, North China University of Technology, 100144, Beijing, China +1
DiffuSAM: Diffusion Guided Zero-Shot Object Grounding for Remote Sensing Imagery
Apr 20, 2026Geet Sethi, Panav Shah, Ashutosh Gandhe +1Remote Sensing Image Understanding Diffusion Model Guidance
Indian Institute of Technology Bombay
Spatiotemporal Sycophancy: Negation-Based Gaslighting in Video Large Language Models
Apr 20, 2026Ziyao Tang, Pengkun Jiao, Bin Zhu +3VLM Evaluation VLM Robustness
Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI · Singapore Management University
AutoVQA-G: Self-Improving Agentic Framework for Automated Visual Question Answering and Grounding Annotation
Apr 19, 2026Rongsheng Hu, Runwei Guan, Yicheng Di +2Visual Question Answering LLM-Assisted Annotation
School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China · Thrust of Artificial Intelligence, HKUST(GZ), Guangzhou, China
More Than Meets the Eye: Measuring the Semiotic Gap in Vision-Language Models via Semantic Anchorage
Apr 19, 2026Wei HeVLM Evaluation Figurative Language Understanding
IDSAI, University of Exeter Exeter, UK
Prompt Sensitivity in Vision-Language Grounding: How Small Changes in Wording Affect Object Detection
Apr 18, 2026Dawar Jyoti Deka, Amit Sethi, Syed Mohammad AliOpen-Vocabulary Object Detection VLM Robustness
Department of Aerospace Engineering, Indian Institute of Technology Bombay, Mumbai, India · Department of Electrical Engineering, Indian Institute of Technology Bombay, Mumbai, India
DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models
Apr 18, 2026JiYang Wang, Jiawei Chen, Mengqi Xiao +3VLM Evaluation Hallucination Detection in VLMs
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University · Zhongguancun Academy
Grounded World Model: Latent Planning with Language Goals
Apr 13, 2026Quanyi Li, Lan Feng, Haonan Zhang +4Zero-Shot Robotic Manipulation World Models for Robotics
EPFL · NUS
Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
Apr 8, 2026Mengdan Zhu, Senhao Cheng, Liang ZhaoVLM Interpretability Latent Visual Reasoning
Emory University · University of Michigan, Ann Arbor
Attention at Rest Stays at Rest: Breaking Visual Inertia to Mitigate Relation Hallucinations
Apr 2, 2026Boyang Gong, Yu Zheng, Fanye Kong +2VLM Hallucination Mitigation Vision-Language Grounding
Tsinghua University
AMIGO: Agentic Multi-Image Grounding Oracle Benchmark
Mar 30, 2026Min Wang, Ata MahjoubfarVLM Evaluation Visual Question Answering
Target Corporation

Apr 30, 2026, cs.CVJ/K move · Enter open · S save

COHERENCE: Benchmarking Fine-Grained Image-Text Alignment in Interleaved Multimodal Contexts

Bingli Wang, Huanze Tang, Haijun Lv, Zhishan Lin+4

1Southeast University · 2Shanghai AI Laboratory

Vision-Language Models Vision-Language Grounding Vision-Language Alignment Multimodal Model Evaluation Multimodal Understanding

Open paper AskPDF arXiv

In recent years, Multimodal Large Language Models (MLLMs) have achieved remarkable progress on a wide range of multimodal benchmarks. Despite these advances, most existing benchmarks mainly focus on single-image or multi-image comprehension. In real-world scenarios such as document reading, information is often presented as interleaved multimodel contexts. This requires MLLMs not only to recognize the content of individual images, but also to identify relevant textual and visual evidence, establish fine-grained alignments between them, and reason over these aligned signals in interleaved contexts based on contextual evidence. However, there is still a lack of systematic benchmarks for quantifying the fine-grained understanding ability of MLLMs in interleaved image-text contexts. To fill this gap, we propose COHERENCE, a benchmark designed to evaluate the ability of MLLMs to recover fine-grained image-text correspondences in interleaved multimodal contexts. COHERENCE covers interleaved image-text content from four representative domains and contains 6,161 high-quality questions. Moreover, we perform a six-type error analysis, enabling fine-grained attribution of failures in interleaved image-text understanding to the specific capabilities missing in current MLLMs.

Momentum

Related topics

Latest papers 288