Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 480

All topics

When Words Speak Louder than Images: Towards Understanding Language Bias in Vision-Language Models
Sep 28, 2026Yizhou Fang, Siyue Chen, Zimo Qi +3VLM Evaluation Vision-Language Models
University of Waterloo · Independent Researcher · Johns Hopkins University +3
AnswerMap: Faithful Spatial Interpretability of VLMs from Answer Posteriors
Sep 28, 2026Mohamed Eltahir, Fardows Adam, Duaa M. Tahir +6Vision-Language Models VLM Interpretability
King Abdullah University of Science and Technology (KAUST), Thuwal, Saudi Arabia · Department of Computer Science, Edge Hill University, Ormskirk, England
ControlTrace: Recovering Control Fields for Hidden-Content Recognition
Sep 28, 2026Zijian Liu, Yaoguang Chen, Liwei Liu +4VLM Evaluation Vision-Language Models
Shanghai Jiao Tong University · Ant Group
Before the Token Commits: Trajectory-Level Benchmarking of Visual Hallucinations in Diffusion VLMs
Sep 28, 2026Yadong Wang, Siping Yue, Yu Tian +2VLM Evaluation Vision-Language Models
Nanjing University of Aeronautics and Astronautics · State Key Laboratory of Ocean Sensing, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 311215, China · Security Capability Center
Do Emotion Concepts Generalize Across Sources, Modalities, and Architectures in Vision-Language Models?
Sep 28, 2026Bohao Xing, Xin Liu, Kaishen Yuan +5Cross-Modal Learning Vision-Language Models
Lappeenranta-Lahti University of Technology LUT · Shanghai Jiao Tong University · The Hong Kong University of Science and Technology (Guangzhou) +3
Program-Verified Self-Evolution for Vision-Language Models
Sep 27, 2026Ahmed Heakl, Sungik Choi, Moontae Lee +1Visual Question Answering Vision-Language Models
LG AI Research · MBZUAI · University of Illinois at Chicago +1
Seeing and Solving Are Not Enough for Vision-Language Models
Sep 27, 2026Ziheng Wang, Mingxuan Xie, Yilin Liu +3VLM Evaluation Visual Question Answering
Sun Yat-sen University · Zhejiang University · The Hong Kong University of Science and Technology +2
ViCoR: Reliable Molecular Structure Extraction via Spatially Aligned Verification and Executable Revision
Sep 27, 2026Yujian Yuan, Xin Cai, Yufan Chen +5Vision-Language Models Optical Character Recognition
The Hong Kong University of Science and Technology · The Chinese University of Hong Kong · Institute of Computing Technology, Chinese Academy of Sciences.
CoViST: Visual Token Compression via Composable States
Sep 27, 2026Qi Zhang, Xiandong Meng, Ronggang Wang +1Vision-Language Models Efficient VLM Inference
Peng Cheng Laboratory Shenzhen, China · Peking University Shenzhen Graduate School Peking University Beijing, China
Where Hallucinations Live: A Cross-Architecture Circuit in VQ-Tokenized Vision-Language Models
Sep 24, 2026Shamanthak Hegde, Xiangrui Liu, Maitreya Patel +1Vision-Language Models Object Hallucination in VLMs
Arizona State University · Adobe
DrGait: Biomechanically Grounded Visual Reasoning for Interpretable Clinical Gait Analysis
Sep 23, 2026Xiangyu Yin, Shiqi Wang, Abrar Alamri +4Vision-Language Models Gait Analysis
University of Pittsburgh
Small yet Assistive: Spatially-Aware Post-Training for Low Vision
Sep 23, 2026Rishabh Choudhary, Shreyansh Raj, Umesh Goyal +6Vision-Language Models VLM Adaptation
Indian Institute of Technology Mandi · Mohamed bin Zayed University of Artificial Intelligence
Feed the Panel Dimensions, Not Verdicts: Rubric-Decomposed Fusion of Vision-Language Aesthetic Judges
Sep 22, 2026Amit Jadhav, Shaurya Beriwala, Beomjin KimVLM Evaluation Vision-Language Models
Purdue University Fort Wayne
What do VLM-Based Vision-Language Navigation Models Rely on: Interpreting and Steering Policy Behavior
Sep 21, 2026Débora Oliveira Makowski, Samiran Gode, Abhijeet Nayak +4Vision-Language Models VLM Interpretability
University of Technology Nuremberg. · ETH Zürich. · Inria, Ecole Normale Sup´erieure, CNRS, PSL Research University.
Hierarchical Prompt Learning for Hyperbolic Vision-Language Models
Sep 21, 2026Andro Erdelez, Pascal Mettes, Behzad BozorgtabarVision-Language Models Prompt Learning
Aarhus University · University of Amsterdam
SKstars at SHROOM: Visions Agreement-Guided Ensembling of Zero-Shot and LoRA-Adapted Vision--Language Models
Sep 21, 2026Ali Athar, Imran Ahsan, Joon-Yong JungHallucination Detection in VLMs Vision-Language Models
Department of Radiology, Seoul St. Mary’s Hospital, The Catholic University of Korea · Department of Smart City, Chung-Ang University
BindCLIP: One Balanced Coupling For Compositional Vision Language Scoring
Sep 20, 2026Liuyang Song, Yi Zhang, Zhongyi Deng +2Vision-Language Models Vision-Language Grounding
Peking University · Dongguan University of Technology · Sichuan Agricultural University
Spatial-Semantic Uncertainty in VLM-Based Target Search: Balancing Exploration and Identification
Sep 17, 2026Alkesh K. Srivastava, Jonathan Diller, Vijay Kumar +1Belief-Space Planning Vision-Language Models
Temple University, Philadelphia, PA, 19122 USA · University of Pennsylvania, Philadelphia, PA, 19104 USA
Absence is Presence: Understanding Visual Scene Negative Events Under Safety Cognitive Constraint
Sep 17, 2026Zhiyun Jiang, Hanyong Wang, Binbin Liang +3Image Captioning Vision-Language Models
Sichuan University, Chengdu, China · Beijing Institute of Technology, Beijing, China
StackTok: Accelerating VLMs Inference with Budget-Adaptive Visual Token Selection
Sep 15, 2026Zhenbin Wang, Lei Zhang, Lituan Wang +3Vision-Language Models Efficient VLM Inference
Sichuan University
ViD: Vision-Dominant Gender Bias Mitigation for Large Vision-Language Models
Sep 15, 2026Zhipeng Zhao, Zhaoqiang Wei, Peishun Liu +2Vision-Language Models Large Vision-Language Models
Ocean University of China
ProtoLIP: From Sentence-Level to Object-Level Evidence Disentanglement
Sep 14, 2026Yan Zhu, Yongbo Chen, Zhengming Ding +1Vision-Language Models Prototype Learning
Department of Computer Science Tulane University New Orleans, LA, USA
RelateAnything: Real-Time Open-Vocabulary Relation Prediction From Any Inputs
Sep 14, 2026Maëlic NeauVision-Language Models Visual Reasoning
Independent Researcher
ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts
Sep 14, 2026Dang Hoai Nam, Nguyen Duy Hieu, Quang Huu Hieu +1Vision-Language Models Sparse Mixture-of-Experts
University of Information Technology, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam · AJ Technologies, Nagoya, Japan +1
Beyond Benchmarks: Using VLMs to Reveal Systematic Classification Failures Under Real World Conditions
Sep 12, 2026Dieuwertje Alblas, Alma M. Liezenga, Jan Erik van Woerden +3Vision-Language Models
Intelligent Imaging, Defense, Safety & Security, TNO, The Hague, The Netherlands
HALDETECT at ImageEval 2026 Shared Tasks: Answer-First Contrastive Grounding with QLoRA
Sep 12, 2026Syed Mohaiminul Hoque, Md Sakhawat HossainVLM Evaluation Hallucination Detection in VLMs
Independent Author
Can Edge-Deployable Vision-Language Models Identify Species?
Sep 12, 2026William Zhou, Mayukha Siripuram, Xiao Yan +2VLM Evaluation VLM Robustness
Plano West Senior High School
VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models
Sep 10, 2026Zaid Pervaiz Bhat, Nimra Nayyar, Arihant Jain +6VLM Evaluation Vision-Language Models
NVIDIA · Clemson University
Two-Token Features and Small-Large Ensembles for VLM Hallucination Detection
Sep 9, 2026Eli SchwartzHallucination Detection in VLMs Vision-Language Models
IBM Research
From Pixels to Hierarchical Sequences: Quadtree Mask Encoding for Vision-Language Binary Change Detection
Sep 9, 2026Xiao An, Ruikang Zhang, Chen Zhong +4Vision-Language Models Remote Sensing Change Detection
Wuhan University · Peking University · Shanghai Artificial Intelligence Laboratory

Sep 28, 2026, cs.CLJ/K move · Enter open · S save

When Words Speak Louder than Images: Towards Understanding Language Bias in Vision-Language Models

Yizhou Fang, Siyue Chen, Zimo Qi, Zhiyu Xue+2

University of Waterloo · Independent Researcher · Johns Hopkins University+3

VLM Evaluation Vision-Language Models VLM Interpretability Linguistic Bias in Language Models

Open paper AskPDF arXiv

Despite substantial progress across downstream applications, vision-language models (VLMs) remain susceptible to language bias, often prioritizing linguistic cues over visual evidence and consequently producing incorrect predictions. Prior studies have proposed various approaches to understanding and mitigating language bias in VLMs, yet their findings often conflict due to the difficulty of tracing how language bias propagates within black-box VLMs. Building on the word completion task, we trace how language bias propagates through VLM inference by (1) proposing a diagnostic framework that decomposes the inference process into four distinct yet interdependent stages to trace the propagation of language bias; and (2) examining how two key factors underlying language bias, i.e., linguistic priors and cross-modal coverage, evolve across these stages and ultimately give rise to incorrect predictions. The linguistic prior captures the strength of statistical bias induced by the language model component of a VLM and represents the origin of language bias, whereas cross-modal coverage measures the extent to which linguistic cues cover the visual content. By decomposing inference into four stages and characterizing the interplay between linguistic priors and cross-modal coverage across these stages, we propose a systematic framework for tracing the propagation of language bias throughout the inference process; and uncover the underlying mechanism of language bias by revealing the interplay between linguistic priors and cross-modal coverage.

Momentum

Related topics

Latest papers 480