Vision-Language Models

Also known as VLM

Follow this topic Ask about this topic

Momentum

55 papers in the last four weeks, up 120% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 480

All topics

Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs
May 1, 2026Siyuan Huang, Xiaoye Qu, Yafu Li +6Memory-Augmented VLMs VLM Robustness
Shanghai AI Laboratory · Shanghai Jiao Tong University · The Chinese University of Hong Kong +3
Jailbreaking Vision-Language Models Through the Visual Modality
May 1, 2026Aharon Azulay, Jan Dubiński, Zhuoyun Li +2Adversarial Attacks on VLMs Vision-Language Models
Independent · NASK National Research Institute, Warsaw, Poland · Warsaw University of Technology, Warsaw, Poland +3
Leveraging Vision-Language Models as Weak Annotators in Active Learning
May 1, 2026Phuong Ngoc Nguyen, Kaito Shiku, Ryoma Bise +2Vision-Language Models Active Learning
Kyushu University, Japan.
Online Self-Calibration Against Hallucination in Vision-Language Models
May 1, 2026Minghui Chen, Chenxu Yang, Hengjie Zhu +3Vision-Language Models Hallucination in Language Models
Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China
TransVLM: A Vision-Language Framework and Benchmark for Detecting Any Shot Transitions
Apr 30, 2026Ce Chen, Yi Ren, Yuanming Li +5Vision-Language Models Change-Point Detection
University of Melbourne · 2HeyGen Research · 3Nanyang Technological University
The Effects of Visual Priming on Cooperative Behavior in Vision-Language Models
Apr 30, 2026Kenneth J. K. OngVLM Evaluation VLM Robustness
1ST Engineering, Singapore.
Improving Calibration in Test-Time Prompt Tuning for Vision-Language Models via Data-Free Flatness-Aware Prompt Pretraining
Apr 30, 2026Hyeonseo Jang, Jaebyeong Jeon, Joong-Won Hwang +1Deep Learning Optimization Vision-Language Models
1Yonsei University · 2ETRI
Revealing the Impact of Visual Text Style on Attribute-based Descriptions Produced by Large Visual Language Models
Apr 30, 2026Xiaomeng Wang, Martha Larson, Zhengyu ZhaoVLM Evaluation Vision-Language Models
Radboud University · Nijmegen, Netherlands · Xi’an Jiaotong University +1
Understanding Adversarial Transferability in Vision-Language Models for Autonomous Driving: A Cross-Architecture Analysis
Apr 30, 2026David Fernandez, Pedram MohajerAnsari, Amir Salarpour +1Adversarial Attacks on VLMs Vision-Language Models
School of Computing, Clemson University, USA
COHERENCE: Benchmarking Fine-Grained Image-Text Alignment in Interleaved Multimodal Contexts
Apr 30, 2026Bingli Wang, Huanze Tang, Haijun Lv +5Vision-Language Models Vision-Language Grounding
1Southeast University · 2Shanghai AI Laboratory
A Multistage Extraction Pipeline for Long Scanned Financial Documents: An Empirical Study in Industrial KYC Workflows
Apr 29, 2026Yuxuan Han, Yuanxing Zhang, Yushuo Wang +3Vision-Language Models Document Information Extraction
OCBC, Singapore
Delineating Knowledge Boundaries for Honest Large Vision-Language Models
Apr 29, 2026Junru Song, Yimeng Hu, Yijing Chen +4VLM Robustness Vision-Language Models
Shandong University
Prefill-Time Intervention for Mitigating Hallucination in Large Vision-Language Models
Apr 28, 2026Chengsheng Zhang, Chenghao Sun, Xinyan Jiang +2Vision-Language Models Hallucination in Language Models
University of Science and Technology of China · Shanghai Advanced Research Institute, Chinese Academy of Sciences, Shanghai, China · University of Chinese Academy of Sciences, Beijing, China
VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation
Apr 28, 2026Divake Kumar, Sina Tayebati, Devashri Naik +2VLM Evaluation Vision-Language Models
University of Illinois at Chicago · 2AI Labs at Capital One
A systematic evaluation of vision-language models for observational astronomical reasoning tasks
Apr 27, 2026Wenke Ren, Hengxiao Guo, Wenwen Zuo +1VLM Evaluation Vision-Language Models
Shanghai Astronomical Observatory, Chinese Academy of Sciences, Shanghai, China · Harvard University, Boston, Massachusetts, USA
PhysNote: Self-Knowledge Notes for Evolvable Physical Reasoning in Vision-Language Model
Apr 27, 2026Sinin Zhang, Yunfei Xie, Yuxuan Cheng +2Vision-Language Models VLM Reasoning
The Chinese University of Hong Kong, Shenzhen · Rice University · City University of Hong Kong +1
Aligning with Your Own Voice: Self-Corrected Preference Learning for Hallucination Mitigation in LVLMs
Apr 27, 2026Byeonggeuk Lim, JungMin Yun, Junehyoung Kwon +2Vision-Language Models Hallucination in Language Models
Graduate School of Advanced Imaging Sciences, Multimedia and Film, Chung-Ang University · Department of Artificial Intelligence, Chung-Ang University
SycoPhantasy: Quantifying Sycophancy and Hallucination in Small Open Weight VLMs for Vision-Language Scoring of Fantasy Characters
Apr 27, 2026Arya Shah, Deepali Mishra, Chaklam SilpasuwanchaiVLM Evaluation Vision-Language Models
IIT Gandhinagar Gandhinagar, India · IIT Kanpur Kanpur, India · Asian Institute of Technology Bangkok, Thailand
SMoES: Soft Modality-Guided Expert Specialization in MoE-VLMs
Apr 27, 2026Zi-Hao Bo, Yaqian Li, Anzhou Hou +6Vision-Language Models Efficient VLM Inference
Li Auto Inc.
PhySE: A Psychological Framework for Real-Time AR-LLM Social Engineering Attacks
Apr 25, 2026Tianlong Yu, Yang Yang, Ziyi Zhou +5Vision-Language Models Cybersecurity
1Hubei University · 2Apple Inc · 3Huazhong University of Science and Technology
SketchVLM: Vision language models can annotate images to explain thoughts and guide users
Apr 23, 2026Brandon Collins, Logan Bolton, Hung Huy Nguyen +3Vision-Language Models LLM-Assisted Annotation
Auburn University · Adobe Research
Source-Modality Monitoring in Vision-Language Models
Apr 23, 2026Etha Tianze Hua, Tian Yun, Ellie PavlickVision-Language Models Multimodal Understanding
Department of Computer Science, Brown University
R-CoV: Region-Aware Chain-of-Verification for Alleviating Object Hallucinations in LVLMs
Apr 22, 2026Jiahao Xie, Alessio Tonioni, Nathalie Rauschmayr +2Hallucination Detection in VLMs Vision-Language Models
Max Planck Institute for Informatics, SIC · VIA Research Center · Google
Breaking the Illusion: When Positive Meets Negative in Multimodal Decoding
Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Vision-Language Models Hallucination in Language Models
School of Astronautics, Beihang University, Beijing 102206, China · Longcat Interaction Team, Meituan, Beijing 100102, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China
Mitigating Hallucinations in Large Vision-Language Models without Performance Degradation
Apr 22, 2026Xingyu Zhu, Junfeng Fang, Shuo Wang +4Vision-Language Models VLM Adaptation
MoE Key Lab of BIPC, University of Science and Technology of China · National University of Singapore
Detecting AI-Generated Content on Social Media with Multi-modal Language Models
Apr 21, 2026Chenyang Yang, Shen Yan, Yibo Yang +13Vision-Language Models AI-Generated Image Detection
Carnegie Mellon University · Meta
PLaMo 2.1-VL Technical Report
Apr 21, 2026Tommi Kerola, Yuya Masuda, Takashi Masuko +5Visual Question Answering Vision-Language Models
Preferred Networks, Inc. (PFN)
Disparities In Negation Understanding Across Languages In Vision-Language Models
Apr 21, 2026Charikleia Moraitaki, Sarah Pan, Skyler Pulling +3VLM Evaluation Vision-Language Models
Massachusetts Institute of Technology
ESsEN: Training Compact Discriminative Vision-Language Transformers in a Low-Resource Setting
Apr 20, 2026Clayton Fields, Casey KenningtonVision-Language Models Efficient ViTs
Department of Computer Science · Boise State University
Multilingual Training and Evaluation Resources for Vision-Language Models
Apr 20, 2026Daniela Baiamonte, Elena Fano, Matteo Gabburo +3VLM Evaluation Vision-Language Models
Aithlas

May 1, 2026, cs.CVJ/K move · Enter open · S save

Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs

Siyuan Huang, Xiaoye Qu, Yafu Li, Tong Zhu+5

Shanghai AI Laboratory · Shanghai Jiao Tong University · The Chinese University of Hong Kong+3

Memory-Augmented VLMs VLM Robustness Vision-Language Models Large Vision-Language Models VLM Reasoning

Open paper AskPDF arXiv

While autoregressive Large Vision-Language Models (LVLMs) demonstrate remarkable proficiency in multimodal tasks, they face a "Visual Signal Dilution" phenomenon, where the accumulation of textual history expands the attention partition function, causing visual attention to decay inversely with generated sequence length. To counteract this, we propose Persistent Visual Memory (PVM), a lightweight learnable module designed to strengthen sustained, on-demand access to visual evidence. Integrated as a parallel branch alongside the Feed-Forward Network (FFN) in LVLMs, PVM establishes a distance-agnostic retrieval pathway that directly provides visual embeddings for enhanced visual perception, thereby structurally mitigating the signal suppression inherent to deep generation. Extensive experiments on Qwen3-VL models demonstrate that PVM brings notable improvements with negligible parameter overhead, delivering consistent average accuracy gains across both 4B and 8B scales, particularly in complex reasoning tasks that demand persistent visual perception. Furthermore, in-depth analysis reveals that PVM shows improved robustness in longer generations and accelerates internal prediction convergence.

Momentum

Related topics

Latest papers 480