Object Hallucination in VLMs

VLM: Vision-Language Model

Overview

This topic studies when vision-language models mention objects that are absent, miss visible objects, or misread relationships in images and videos. Researchers evaluate these failures with captioning, question-answering, and grounding benchmarks such as CHAIR, POPE, and AMBER, and use controlled tests to separate weak perception from language-prior effects. Mitigation approaches include training-free contrastive decoding and attention or representation steering, as well as region-based verification, preference tuning, and reinforcement learning. A central challenge is reducing unsupported claims without suppressing correct details or harming fluency, while ensuring improvements hold across models, tasks, and evaluation methods.

Latest papers

CardsList

136 papers7 papers in the last four weeks, down 53% on the four weeks before. 0.1% of all new papers.

  1. Beyond Seeing: Fine-Grained Preference Validation and Severity-Aware Alignment for Mitigating Visual Hallucinations in Vision-Language Models

    Nov 16, 2026Abdulaziz Alqahtani, Alwaleed Alharthi, Muzammil BehzadVLM Hallucination MitigationObject Hallucination in VLMs

  2. VEPO: Mitigating Multilingual Hallucinations in LVLMs via Visual Evidence-guided Preference Optimization

    Nov 13, 2026Chengpeng Fu, Xiaocheng Feng, Wenshuai Huo +4VLM Hallucination MitigationVision-Language Models

  3. Did I See It or Think It? Probing Reality Monitoring in Vision-Language Models with Concept Injection

    Nov 6, 2026Tina Khezresmaeilzadeh, Seyedarmin Azizi, Mehdi Kamal +1Faithfulness in VLMsHallucination Detection in VLMs

  4. Entropy-Gated Dynamic Rectification for Object Hallucination in Large Vision-Language Models

    Nov 3, 2026Riasad Alvi, Md. Asaduzzaman Shuvo, Md. Ahashan Habib +1activation steering in vision-language modelsObject Hallucination in VLMs

  5. Failure Modes of Vision-Language Models for Human Activity Understanding in Thermal HRI

    Oct 21, 2026Han Hu, He ChenHuman Activity RecognitionVLMs for Robotics

  6. Robustness of Internal Signals for Hallucination Detection in Vision-Language Models

    Oct 19, 2026Allison Chen, William Yang, Salma Abdel Magid +3Hallucination Detection in VLMsVLM Robustness

  7. Token-Set Choice Confounds POPE: A Systematic Audit of Yes/No Extraction in VLM Hallucination Evaluation

    Oct 19, 2026Kesav Kumar Jayakumar, Karthigeyan ThilakVLM EvaluationObject Hallucination in VLMs

  8. PLANE: Plug-and-Play Fine-Grained Visual Experts for Hallucination Mitigation in Large Vision-Language Models

    Oct 18, 2026Jianghao Yin, Lang Yu, Qianxi Yu +4VLM Hallucination MitigationObject Hallucination in VLMs

  9. Not Every Mention Is a Claim: Rethinking Object Hallucination Detection in Vision-Language Models

    Oct 16, 2026Hsin-Ling Hsu, Neeraja Kirtane, Kuan-Hao HuangVLM EvaluationHallucination Detection in VLMs

  10. Shift-Reliance Alignment: Ranking Vision-Language Models by the Cues They Trust

    Oct 15, 2026Faisal Mohammad, Mohamed YounisVLM EvaluationObject Hallucination in VLMs

  11. From Token Correction to Claim Admission: Training-Free Hallucination Mitigation for Large Vision-Language Models

    Oct 13, 2026Hyeonggeun Han, Taehyun Cho, Sangwoo HongVLM Hallucination MitigationObject Hallucination in VLMs

  12. Metric-Driven Reinforcement Learning for Object Hallucination Reduction in LVLM-Based Image Captioning

    Oct 10, 2026Thanh Nguyen, Hee Suk Yoon, Tung Minh Luu +2Object Hallucination in VLMsVLM Hallucination Mitigation

  13. PVFH-Bench: Benchmarking Premise-Induced Visual Fixation Hallucinations in Vision-Language Models

    Oct 10, 2026Xinhao Wang, Junbo Cui, Zhenghao Liu +4Object Hallucination in VLMsVLM Reasoning

  14. Beyond Visual Enhancement: Adaptive Multi-Context Steering to Mitigate LVLM Hallucinations

    Oct 8, 2026Shuran Ma, JiaLe Li, Yuxin Dong +9VLM Hallucination MitigationLarge Vision-Language Models

  15. From Suppression to Repair: Mitigating Object Hallucination in Large Vision-Language Models via Localized Distribution Alignment

    Oct 8, 2026Chen Zhao, Xingping Dong, Jiachun Shi +5Object Hallucination in VLMsVLM Hallucination Mitigation

  16. Mitigating Object Hallucination in Large Vision-Language Models via False Discovery Controlled Visual Data Splitting

    Sep 30, 2026Chang Liu, Yu Tian, Rui XieFDR ControlLarge Vision-Language Models

  17. From Routing Signals to Selective Review: Visual regrounding in MoE VLMs

    Sep 29, 2026Hongzhu Guo, Mohsen Fayyaz, Nanyun PengHallucination Detection in VLMsVision-Language Models

  18. Visual sensitivity is not claim retractability: persistence-aware credit assignment for multimodal reinforcement learning

    Sep 29, 2026Zhongan Bi, Kepeng Lin, Xuanang Gao +2Counterfactual Evaluation of VLMsCredit Assignment in RL

  19. DARE to Mitigate Hallucination: Dual-path Auto-Regressive-aware Editing

    Sep 29, 2026Jae-Ho Lee, Jeong-Eun Lee, Gyeong-Moon ParkVision-Language ModelsLarge Vision-Language Models

  20. Beyond Saying Less: Fine-Grained Alignment for Informative and Faithful Vision-Language Models

    Sep 28, 2026Xingming Long, Jie Zhang, Yuecong Min +2Credit Assignment in RLStep-Level Credit Assignment in RL

  21. Where Hallucinations Live: A Cross-Architecture Circuit in VQ-Tokenized Vision-Language Models

    Sep 24, 2026Shamanthak Hegde, Xiangrui Liu, Maitreya Patel +1Vision-Language ModelsObject Hallucination in VLMs

  22. Semantic-Spatial Agreement Verification for Mitigating Object Hallucination in Multimodal Large Language Models

    Sep 15, 2026Ziheng Ren, Qian Gao, Jun Fan +3Hallucination Detection in VLMsObject Hallucination in VLMs

  23. OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillation

    Sep 15, 2026Chenhao Qiu, Dawei Li, Yechao Zhang +2Object Hallucination in VLMsMultimodal Reasoning

  24. Detecting Object Hallucinations in Large Vision-Language Models via Cross-Modal Attention Drifts and Mask-Based Verification

    Sep 2, 2026Xuanbing Wen, Boxu Chen, Le Yang +4Hallucination Detection in VLMsHallucination Detection