Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 491

All topics

Source-Modality Monitoring in Vision-Language Models
Apr 23, 2026Etha Tianze Hua, Tian Yun, Ellie PavlickVision-Language Models Multimodal Understanding
Department of Computer Science, Brown University
R-CoV: Region-Aware Chain-of-Verification for Alleviating Object Hallucinations in LVLMs
Apr 22, 2026Jiahao Xie, Alessio Tonioni, Nathalie Rauschmayr +2Hallucination Detection in VLMs Vision-Language Models
Max Planck Institute for Informatics, SIC · VIA Research Center · Google
Breaking the Illusion: When Positive Meets Negative in Multimodal Decoding
Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Vision-Language Models Hallucination in Language Models
School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China
Mitigating Hallucinations in Large Vision-Language Models without Performance Degradation
Apr 22, 2026Xingyu Zhu, Junfeng Fang, Shuo Wang +4Vision-Language Models VLM Adaptation
MoE Key Lab of BIPC, University of Science and Technology of China · National University of Singapore
Detecting AI-Generated Content on Social Media with Multi-modal Language Models
Apr 21, 2026Chenyang Yang, Shen Yan, Yibo Yang +13Vision-Language Models AI-Generated Image Detection
Carnegie Mellon University · Meta
PLaMo 2.1-VL Technical Report
Apr 21, 2026Tommi Kerola, Yuya Masuda, Takashi Masuko +5Visual Question Answering Vision-Language Models
Preferred Networks, Inc. (PFN)
Disparities In Negation Understanding Across Languages In Vision-Language Models
Apr 21, 2026Charikleia Moraitaki, Sarah Pan, Skyler Pulling +3VLM Evaluation Vision-Language Models
Massachusetts Institute of Technology
ESsEN: Training Compact Discriminative Vision-Language Transformers in a Low-Resource Setting
Apr 20, 2026Clayton Fields, Casey KenningtonVision-Language Models Efficient ViTs
Department of Computer Science · Boise State University
Multilingual Training and Evaluation Resources for Vision-Language Models
Apr 20, 2026Daniela Baiamonte, Elena Fano, Matteo Gabburo +3VLM Evaluation Vision-Language Models
Aithlas
Enhancing Continual Learning of Vision-Language Models via Dynamic Prefix Weighting
Apr 20, 2026Hyeonseo Jang, Hyuk Kwon, Kibok LeeClass-Incremental Learning Vision-Language Models
Yonsei University
Mitigating Multimodal Hallucination via Phase-wise Self-reward
Apr 20, 2026Yu Zhang, Chuyang Sun, Kehai Chen +3Vision-Language Models Hallucination in Language Models
Harbin Institute of Technology · Peng Cheng Laboratory · Shenzhen, China
RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding
Apr 19, 2026Gaozhi Zhou, Hu He, Peng Shen +8Remote Sensing Image Understanding Visual Question Answering
School of Mechanical and Electrical Engineering, Central South University, Changsha 410083, China · School of Geosciences and Info-Physics, Central South University, Changsha 410083, China
More Than Meets the Eye: Measuring the Semiotic Gap in Vision-Language Models via Semantic Anchorage
Apr 19, 2026Wei HeVLM Evaluation Figurative Language Understanding
IDSAI, University of Exeter Exeter, UK
Towards Joint Quantization and Token Pruning of Vision-Language Models
Apr 19, 2026Xinqing Li, Xin He, Xindong Zhang +3Vision-Language Models VLM Quantization
VCIP, College of Computer Science, Nankai University · School of Computer Science and Engineering, Tianjin University of Technology · OPPO Research Institute +3
LLaTiSA: Towards Difficulty-Stratified Time Series Reasoning from Visual Perception to Semantics
Apr 19, 2026Yueyang Ding, HaoPeng Zhang, Rui Dai +4Vision-Language Models Time Series Reasoning
Amap, Alibaba Group
PestVL-Net: Enabling Multimodal Pest Learning via Fine-grained Vision-Language Interaction
Apr 19, 2026Xueheng Li, Tao Hu, Ke Cao +5Agricultural Image Analysis Vision-Language Models
Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences · University of Science and Technology of China · 3Zhongke Hefei Institute of Technology Innovation Engineering
Cross-Modal Attention Analysis and Optimization in Vision-Language Models: A Study on Visual Reliability
Apr 19, 2026Lijie ZhouCross-Modal Learning VLM Robustness
School of Computer Science University of Nottingham Ningbo China Ningbo, China
DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models
Apr 18, 2026JiYang Wang, Jiawei Chen, Mengqi Xiao +3VLM Evaluation Hallucination Detection in VLMs
Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University · Zhongguancun Academy
Channel Attention-Guided Cross-Modal Knowledge Distillation for Referring Image Segmentation
Apr 18, 2026Chen YangCross-Modal Learning Cross-Modal Knowledge Distillation
School of Information Science and Technology, TaiShan University, Taian, China
Information Router for Mitigating Modality Dominance in Vision-Language Models
Apr 17, 2026Seulgi Kim, Mohit Prabhushankar, Ghassan AlRegibVLM Robustness Vision-Language Models
OLIVES at the Center for Signal and Information Processing CSIP, School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA
Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap
Apr 17, 2026Yige Xu, Yongjie Wang, Zizhuo Wu +3Vision-Language Models VLM Adaptation
College of Computing and Data Science, Nanyang Technological University, Singapore · Alibaba-NTU Global e-Sustainability CorpLab (ANGEL) · Tongyi Lab, Alibaba Group, China
AstroVLM: Expert Multi-agent Collaborative Reasoning for Astronomical Imaging Quality Diagnosis
Apr 17, 2026Yaohui Han, Tianshuo Wang, Zixi Zhao +6Vision-Language Models VLM Reasoning
The Chinese University of Hong Kong · Central South University · Huawei Technologies Co., Ltd +1
VisPCO: Visual Token Pruning Configuration Optimization via Budget-Aware Pareto-Frontier Learning for Vision-Language Models
Apr 16, 2026Huawei Ji, Yuanhao Sun, Yuan Jin +4Vision-Language Models Efficient VLM Inference
Shanghai Jiao Tong University, Shanghai, China · University of Edinburgh, Edinburgh, UK
Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
Apr 16, 2026Danae Sánchez Villegas, Samuel Lewis-Lim, Nikolaos Aletras +1CoT Faithfulness Vision-Language Models
University of Copenhagen, Department of Computer Science · University of Sheffield, School of Computer Science
AIM: Asymmetric Information Masking for Visual Question Answering Continual Learning
Apr 16, 2026Peifeng Zhang, Zice Qiu, Donghua Yu +4Visual Question Answering Vision-Language Models
Sun Yat-Sen University · National Supercomputing Center in Shenzhen · Tsinghua University
Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models
Apr 16, 2026Haoyi Sun, Xiaoxiao Wang, Ning Mao +5Cross-Modal Knowledge Distillation Vision-Language Models
Li Auto Inc.
BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation
Apr 15, 2026Baoyou Chen, Hanchen Xia, Peng Tu +5Vision-Language Models VLM Adaptation
Shanghai Academy of AI for Science · Fudan University · Shanghai Innovation Institute +1
Beyond Attention Scores: SVD-Based Vision Token Pruning for Efficient Vision-Language Models
Apr 13, 2026Yvon Apedo, Martyna Poreba, Michal Szczepanski +1Vision-Language Models Efficient VLM Inference
Universit´e Paris-Saclay, Univ Evry, IBISC, 91020, Evry-Courcouronnes, France · Universit´e Paris-Saclay, CEA, List, F-91120, Palaiseau, France
VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images
Apr 10, 2026Guanyu Zhou, Yida Yin, Wenhao Chai +3Visual Question Answering Synthetic Data Augmentation
Princeton University · New York University
Overconfidence and Calibration in Medical VQA: Empirical Findings and Hallucination-Aware Mitigation
Apr 2, 2026Ji Young Byun, Young-Jin Park, Jean-Philippe Corbeil +1Vision-Language Models VLM Hallucination
Johns Hopkins University, School of Medicine · Massachusetts Institute of Technology · Microsoft Healthcare & Life Sciences

Apr 23, 2026, cs.CLJ/K move · Enter open · S save

Source-Modality Monitoring in Vision-Language Models

Etha Tianze Hua, Tian Yun, Ellie Pavlick

Department of Computer Science, Brown University

Vision-Language Models Multimodal Understanding

Open paper AskPDF arXiv

We define and investigate source-modality monitoring -- the ability of multimodal models to track and communicate the input source from which pieces of information originate. We consider source-modality monitoring as an instance of the more general binding problem, and evaluate the extent to which models exploit syntactic vs. semantic signals in order to bind words like image in a user-provided prompt to specific components of their input and context (i.e., actual images). Across experiments spanning 11 vision-language models (VLMs) performing target-modality information retrieval tasks, we find that both syntactic and semantic signals play an important role, but that the latter tend to outweigh the former in cases when modalities are highly distinct distributionally. We discuss the implications of these findings for model robustness, and in the context of increasingly multimodal agentic systems.

Momentum

Related topics

Latest papers 491