Large Vision-Language Models

Also known as LVLM

Follow this topic Ask about this topic

Momentum

30 papers in the last four weeks, up 36% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 248

All topics

TruthLens: Object Hallucination Detection via Self-Evaluating Truthfulness Scores in LVLMs
Aug 6, 2026Yanqi Wu, Runhe Lai, Xinhua Lu +5VLM Evaluation Hallucination Detection in VLMs
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Peng Cheng Laboratory, Shenzhen, China · Key Laboratory of Machine Intelligence and Advanced Computing, MOE, Guangzhou, China +2
When and Where to Look: Adaptive Visual Evidence Scheduling for Efficient Long Video Understanding
Aug 4, 2026Ke Li, Jiayu Chen, Maoliang Li +5Efficient VLM Inference Large Vision-Language Models
School of Electronics Engineering and Computer Science, Peking University · School of Computer Science, Peking University
UHP Detection: LVLMs have their Unique Hallucination Pattern in the Consistency Space
Aug 4, 2026Amir Mohammad Ezzati, Kiyan Rezaee, Bardiya Kariminia +4Hallucination Detection in VLMs Vision-Language Models
Sharif University of Technology · Michigan State University · Shahid Beheshti University +2
OliveGemma: A 3 Billion Visual Language Model for Recognising the Mediterranean & European Diet
Aug 4, 2026Dimitrios I. Zaridis, Traianos Tsiokris, Vasileios C. Pezoulas +6Large Vision-Language Models Fine-Grained Image Classification
Unit of Medical Technology & Intelligent Information Systems University of Ioannina Ioannina, Greece · Department of Medical Physics, School of Medicine University of Patras Patras, Greece · Computational BioMedicine Laboratory Foundation for Research and Technology Hellas Heraklion, Greece +2
Aligning Large Vision-Language Models at Test Time: A Trajectory-Guided Structured Sampling Approach
Aug 4, 2026Tianbao Jiang, Weicong Ni, Gerard de Melo +1Large Vision-Language Models VLM Reasoning
East China Normal University Shanghai, China · Hasso Plattner Institute Potsdam, Germany · University of Potsdam Potsdam, Germany +1
Learning to Predict Middle-Layer Attention in MLLMs for Visual Token Pruning
Aug 4, 2026Yuyao Sun, Tao Deng, Shuang Li +3Visual Attention Efficient VLM Inference
Beihang University · Shanghai EABOT Technology Co., Ltd.
Assessing the Benefits of Combining Advanced Deep Learning Techniques for Post-Disaster Building Damage Assessment from UAV Imagery
Aug 3, 2026Huy Quang Ung, Guillaume Habault, Roberto Legaspi +3Disaster Damage Assessment Building Damage Assessment
KDDI Research, Inc., Fujimino, Japan
Can Urban Blight Be Accessed with Vision-language Models: A Case Study in Detroit
Aug 3, 2026Xiaohao Yang, Aohua Tian, Derek Van Berkel +2VLM Evaluation Vision-Language Models
School for Environment and Sustainability; School of Information University of Michigan, Ann Arbor, USA
CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
Aug 3, 2026Yu Chen, Xiaohong Li, Xiaole Wang +3Efficient VLM Inference Large Vision-Language Models
1Evermind · 2Shanda Group · 3Peking University
LUT: Latent Utility Training for Visual Reasoning
Aug 1, 2026Jiaxuan Kang, Siyu Chen, Mingda Li +6Visual Question Answering Large Vision-Language Models
Tencent PCG
Coverage-Driven Adaptive Keyframe Selection for Video Understanding
Aug 1, 2026Junyang Zhang, Puhan Luo, Chen Tang +2Efficient VLM Inference Large Vision-Language Models
University of Science and Technology of China, Hefei, China
QR-Structured Thermal Triggers for Targeted Semantic Attacks on Infrared Vision-Language Models
Jul 31, 2026Xiang Chen, Yingying Zhao, Chao Li +7VLM Robustness Adversarial Attacks on VLMs
VisualRouter: Query-Grounded Visual Sampling for Long Video Understanding
Jul 30, 2026Haiyue Zhang, Yi Bin, Xun Jiang +5Large Vision-Language Models Long-Video Understanding
Tongji University, Shanghai, China · University of Electronic Science and Technology of China, Chengdu, China
One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting
Jul 30, 2026Rui Tang, Wentao Yang, Peirong Zhang +4Visual Tokenization Scene Text Recognition
South China University of Technology · Guangzhou, China · HiThink Research +1
RefineSVG: Visual Feedback-Driven Reinforcement Learning for Image-to-SVG Generation
Jul 30, 2026Shaobo Liu, Feiqiao Mao, Shuaishuai Zhou +4Image Generation Large Vision-Language Models
Shenzhen University · Shenzhen, China · Peking University +1
Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detection
Jul 29, 2026Hao Tan, Jun Lan, Zichang Tan +7VLM Distillation Large Vision-Language Models
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences (UCAS), Beijing 101408, China, and also with the State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation Chinese Academy of Sciences (CASIA), Beijing 100190, China · State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA), Beijing 100190, China · Ant Group +2
Decoupled Visual Processing: Efficient Multimodal Adaptation via Modality-Specific Transformer Substitution
Jul 29, 2026Mingkuan Feng, Zhengqi Wen, Jianhua TaoVLM Adaptation Large Vision-Language Models
Tsinghua University · Beijing National Research Center for Information Science and Technology
Kimi K3: Open Frontier Intelligence
Jul 27, 2026Kimi Team, Tongtong Bai, Yifan Bai +399Mixture-of-Experts Language Models Long-Context Language Modeling
Bigger or Cheaper? Scale and Quantization Effects on Uncertainty Signals in Vision-Language Models Under Image Degradation
Jul 27, 2026M M Asif FerdousVLM Robustness Selective Prediction
Independent Researcher
GOTS: Greedy Orthogonal Token Selection for High-Resolution Vision-Language Models
Jul 27, 2026Jun Ling, Tao Huang, Junzhuo Liu +2Efficient VLM Inference Large Vision-Language Models
School of Computer Science and Engineering, University of Electronic Science and Technology of China
Structured Redundancy Modeling for Efficient Visual Token Pruning in High-Resolution MLLMs
Jul 25, 2026Jouwon Song, Woohyeong Kim, Kyeongbo KongEfficient VLM Inference Large Vision-Language Models
LG Electronics, Seoul, Republic of Korea · Pusan National University, Busan, Republic of Korea
GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation
Jul 23, 2026Yimin Fu, Yuefeng Bai, Baicheng Pan +2Remote Sensing Image Understanding Adversarial Attacks on VLMs
Department of Mathematics, Hong Kong Baptist University, Hong Kong, China · School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China
Visual Information Extraction from Documents via Classification-Guided Large Vision-Language Models
Jul 22, 2026Huafu Li, Guo Chen, Jia Xia +5Large Vision-Language Models Document Image Understanding
China Mobile Information Technology Co., Ltd., Shenzhen, 518000, China · School of Information Science and Engineering, NingboTech University, Ningbo, 315100, China
Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model
Jul 21, 2026Sibo Wang, Jie Zhang, Shiguang Shan +2VLM Robustness Fine-Tuning
Look Clearly Before Answering: Mitigating Hallucinations in LVLMs via Saliency-Driven Perceptual Realignment
Jul 18, 2026Pengxu Chen, Yao Zhu, Guangming Zhu +4Large Vision-Language Models VLM Hallucination Mitigation
Xidian University Xi’an, China · Tsinghua University Beijing, China · Shanghai Road Transport Development Center Shanghai, China +1
More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
Jul 17, 2026Stefan Maria Ailuro, Mario Markov, Mohammad Mahdi +2Remote Sensing Image Understanding Remote Sensing VQA
INSAIT, Sofia University "St. Kliment Ohridski"
GeoChrono: Benchmarking and Rethinking Long-Term Temporal Understanding in Remote Sensing
Jul 17, 2026Yujie Li, Jiancheng Pan, Zhiwei Wei +3Spatiotemporal Reasoning Geospatial Representation Learning
Beijing University of Posts and Telecommunications Haidian, Beijing, China · Tsinghua University Haidian, Beijing, China · Hunan Normal University Changsha, Hunan, China +1
VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
Jul 16, 2026Yunfeng Liu, Yuandong Yang, Jiarui Han +5VLM Evaluation Video Understanding
1Nanjing University · 2Shanghai AI Laboratory
Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition
Jul 14, 2026Bruce Coburn, Jingbo Yue, Jinge Ma +3Retrieval-Augmented Generation Large Vision-Language Models
Purdue University, USA
VisCo: Leveraging Large Language Models as Intrinsic Encoders for Visual Token Compression
Jul 14, 2026Yupeng Zheng, Kai Zou, Bin Liu +1Efficient VLM Inference Large Vision-Language Models
Anhui Province Key Laboratory of Digital Security, University of Science and Technology of China Hefei, China
Gaussian Mixture Modeling for Event-Aware Visual Allocation in Long Video Understanding
Jul 14, 2026Yifan Lu, Ziqi Zhang, Chunfeng Yuan +3Large Vision-Language Models Video Frame Selection
Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information, CASIA · State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA · School of Artificial Intelligence, University of Chinese Academy of Sciences +2
Mixture of Cognitive Experts in Large Vision-Language Models
Jul 12, 2026Robert Wijaya, Ngai-Man CheungVision-Language Models Large Vision-Language Models
Singapore University of Technology and Design (SUTD), Singapore
SigLIP-HD by Fine-to-Coarse Supervision
Jul 10, 2026Lihe Yang, Zhen Zhao, Hengshuang ZhaoEfficient VLM Inference Large Vision-Language Models
The University of Hong Kong · Shanghai AI Laboratory
InfraQR: Edge-Placed QR-Inspired Structured Patch Attacks on Infrared Vision-Language Models
Jul 8, 2026Xin Li, Jiaju Han, Ma Yaqi +5VLM Robustness Adversarial Patch Attacks
China University of Petroleum-Beijing at Karamay, Karamay, Xinjiang, China · Shenzhen Research Institute of Big Data, Shenzhen, China · Guizhou University, Guiyang, China +1
AVA-VLM: Adaptive Visual Attention-Vision Language Model for In-the-Wild Construction Site Monitoring
Jul 7, 2026Younggun Kim, Taeheon Kim, Youngseo Kim +1VLM Robustness Efficient VLM Inference
Department of Civil and Environmental Engineering, University of California, Los Angeles, 405 Hilgard Avenue, Los Angeles, 90095, CA, USA · AI+KCIR Global Resilience Research Center, Suwon, 16419, Gyeonggi-do, South Korea · SmartInside AI Co., Ltd., Suwon, 16419, Gyeonggi-do, South Korea +1
Foundation Models for Automatic CAD Generation
Jul 6, 2026J de Curtò, Victoria Guillén, I. de ZarzàParametric CAD Modeling Large Vision-Language Models
Department of Computer Applications in Science & Engineering, BARCELONA Supercomputing Center, 08034 Barcelona, Spain · Escuela T´ecnica Superior de Ingenier´ıa (ICAI), Universidad Pontificia Comillas, 28015 Madrid, Spain · Department of Artificial Intelligence, Chung-Ang University, Seoul, Republic of Korea +1
Repurposing CLIP to Localize at Pixel Level
Jul 6, 2026Jiaxiang Fang, Shiqiang Ma, Jing Wang +3Large Vision-Language Models Open-Vocabulary Semantic Segmentation
School of Computer Science and Engineering, Central South University, Changsha 410083, China · Advanced Technology Center Beijing AI Laboratory, Chao-Yang District, Beijing 100027, China · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China +1
SeeMe: Mitigating Hallucinations in Large Vision-Language Models through Effective Visual Token Engineering
Jul 5, 2026Kai Tang, Jinhao You, Bohua Zhang +6Large Vision-Language Models Object Hallucination in VLMs
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Nanyang Technological University · University of Pennsylvania +4
HCSU: A Dataset and Benchmark for Fine-Grained Historical Calligraphy Style Understanding
Jul 5, 2026Yinsheng Yao, Yan Liu, Chen YeVLM Evaluation Large Vision-Language Models
School of Computer Science and Technology, Tongji University, Shanghai, China · The Key Laboratory of Embedded System and Service Computing, Ministry of Education, Shanghai, China
BVS: Bayesian Visual Search with Multimodal Large Language Model for Fine-grained Perception
Jul 3, 2026Geng Li, Yuxin PengLarge Vision-Language Models Visual Search
Wangxuan Institute of Computer Technology, Peking University
Overloading Large Vision-Language Models for Jailbreaking
Jul 3, 2026Haoyu Zhang, Yangyang Guo, Mohan KankanhalliVLM Robustness Adversarial Attacks on VLMs
1National University of Singapore · 2Hangzhou International Innovation Institute, Beihang University
Vision Token Manipulation Attacks on Cloud-Edge Inference of Large Vision-Language Models
Jul 2, 2026Zikai Zhang, Rui Hu, Olivera Kotevska +1Adversarial Attacks on VLMs Large Vision-Language Models
Department of Computer Science and Engineering, University of Nevada, Reno, Reno, USA · Oak Ridge National Laboratory, Oak Ridge, USA
Towards Robustness against Typographic Attack with Training-free Concept Localization
Jul 2, 2026Bohan Liu, Wenqian Ye, Guangzhi Xiong +3VLM Robustness Adversarial Attacks on VLMs
University of Virginia, Charlottesville VA 22903, USA
SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models
Jul 2, 2026Qi Lyu, Jiahua Dong, Baichen Liu +7Model Compression Vision-Language Models
State Key Laboratory of Robotics and Intelligent Systems · Shenyang Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences +2
LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression
Jul 2, 2026Bowen Yuan, Zijian Wang, Yadan Luo +2Vision-Language Models Large Vision-Language Models
The University of Queensland
Towards High-Resolution Visual Perception via Hierarchical Entity Exploration
Jul 1, 2026Ziyu Ma, Shidong Yang, Yuxiang Ji +5Large Vision-Language Models Fine-Grained Visual Perception
AMAP, Alibaba Group, China · Monash University, Australia
Beyond Single Character: Evaluating MLLMs for Sentence-Level Oracle Bone Inscription Understanding
Jun 30, 2026Ziqi Li, Zijian Chen, Tingzhu Chen +1VLM Evaluation Document Understanding
Nanjing University of Science and Technology, Nanjing 210094, China · Shanghai Jiao Tong University, Shanghai 200240, China · Shanghai Artificial Intelligence Laboratory, Shanghai 200232, China
SADL: What to Ignore? A Benchmark for Subject-Aware Distractor Localization
Jun 29, 2026Cao-Tri Nguyen, Nguyen-Khoa Luong, Vinh-Tiep Nguyen +1VLM Evaluation Large Vision-Language Models
University of Science Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam · University of Information Technology Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam · University of Science John Von Neumann Institute Vietnam National University Ho Chi Minh City Ho Chi Minh City, Vietnam
One Forward Beats Two: InnerZoom for Accurate and Efficient GUI Grounding
Jun 29, 2026Chen Liu, Ling Chen, Hanzhang Zhou +5Efficient Multimodal Inference GUI Grounding
University of Technology Sydney · Tongyi Lab, Alibaba Group · Adelaide University
See Only When Needed: Context-Aware Attention Intervention for Mitigating Hallucinations in LVLMs
Jun 29, 2026Yuqing Lei, Wenbo Lyu, Yingjun Du +3Visual Attention Large Vision-Language Models
University of Chinese Academy of Sciences · University of Amsterdam · United Imaging Healthcare Co., Ltd.
MIRROR: Aligning Semantic Relations from Language to Image via Gromov--Wasserstein
Jun 28, 2026Hong-Han Wang, Yuntao Wang, Hu DingLarge Vision-Language Models VLM Reasoning
University of Science and Technology of China, Hefei, China
FADE: Mitigating Hallucinations by Reducing Language-Prior Dominance in Large Vision-Language Models
Jun 28, 2026Yichen Guo, Kai Tang, Fenglai Lin +5Vision-Language Models Large Vision-Language Models
1Nanyang Technological University · 2State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · 3Tsinghua University
On Test-Time Scaling for Vision-Language Models
Jun 27, 2026Fawaz Sammani, Tzoulio Chamiti, Nikos DeligiannisVLM Evaluation Test-Time Scaling for VLMs
ETRO Department, Vrije Universiteit Brussel, Belgium · imec, Kapeldreef 75, B-3001 Leuven, Belgium
DataComp-VLM: Improved Open Datasets for Vision-Language Models
Jun 26, 2026Matteo Farina, Vishaal Udandarao, Thao Nguyen +33VLM Evaluation Training Data Curation
University of Trento · 2Tübingen AI Center, University of Tübingen · University of Cambridge +12
GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models
Jun 24, 2026Chaoxiang Cai, Minghe Weng, Jie Li +4Efficient VLM Inference Large Vision-Language Models
School of Software Technology, Zhejiang University · College of Computer Science and Technology, Zhejiang University
ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization
Jun 23, 2026Lei Xu, Haowei Wang, Shen Chen +3Large Vision-Language Models Image Forgery Localization
1Shenzhen University · 2Tencent Youtu Lab
Latent Visual States for Efficient Multimodal Reasoning
Jun 23, 2026Xiuwei Chen, Wentao Hu, Yongxin Wang +8Efficient Multimodal Inference Large Vision-Language Models
Sun Yat-sen University · The Hong Kong Polytechnic University · MBZUAI +2
An LMM for Precisely Grounding Elements in Documents
Jun 23, 2026Yijian Lu, Chuangxin Zhao, Kai Sun +3Visual Reasoning Large Vision-Language Models
Department of Computer Science and Technology, Tsinghua University · Institute of Automation, Chinese Academy of Sciences
MMGist: A Comprehensive Multimodal Benchmark for 2027
Jun 21, 2026Wenzhen Yuan, Jiacheng Ruan, Wutao Xiong +3VLM Evaluation Large Vision-Language Models
1Shanghai Jiao Tong University · 2Sichuan University
The Hidden Evolution of Disguised Visual Context inside the VLM
Jun 18, 2026Wish Suharitdamrong, Tony Alex, Muhammad Awais +1Vision-Language Models Large Vision-Language Models
Surrey Institute for People-Centred AI, University of Surrey, Guildford, GU2 7XH, UK · Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK

Aug 6, 2026, cs.CVJ/K move · Enter open · S save

TruthLens: Object Hallucination Detection via Self-Evaluating Truthfulness Scores in LVLMs

Yanqi Wu, Runhe Lai, Xinhua Lu, Qichao Chen+4

School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Peng Cheng Laboratory, Shenzhen, China · Key Laboratory of Machine Intelligence and Advanced Computing, MOE, Guangzhou, China+2

VLM Evaluation Hallucination Detection in VLMs Hallucination Detection Large Vision-Language Models Object Hallucination in VLMs

Open paper AskPDF arXiv

Despite the remarkable progress of large vision language models (LVLMs), object hallucination remains a fundamental challenge that hinders their trustworthy deployment. A key finding motivates our work: real and hallucinated object tokens are clearly separable in hidden representations, yet this separability is largely lost at the language-modeling (LM) head. We propose TruthLens, a self-evaluation framework that teaches the LM head to expose a per-object truthfulness signal without any auxiliary model or additional inference cost. Concretely, a rarely-used special token is repurposed as a reference token. For each object-token position, we extract the log-probability assigned to this special token by the LM head, and define its difference from a predefined constant as the truthfulness score. The model is then fine-tuned with an MSE objective that drives scores toward 1 for real objects and 0 for hallucinated ones, while a divergence constraint preserves the original generation capability. Despite being trained on only a limited set of object categories, TruthLens generalizes effectively to benchmarks with substantially larger label spaces. Extensive experiments across multiple LVLMs demonstrate state-of-the-art performance; notably, on Qwen2.5-VL-7B, TruthLens outperforms the previous best method on MS-COCO by over 17% in AUROC. Our code is available at https://github.com/wyqstan/TruthLens.

Momentum

Related topics

Latest papers 248