Overview

Multimodal hallucination research studies when vision-language and audio-visual models invent details, misread evidence, or let one modality override another. Researchers diagnose these failures with benchmarks such as HallusionBench and AVHBench, including tests for adversarial inputs, temporal reasoning, false premises, and error propagation across dialogue. Mitigation approaches include training-free contrastive or relevance-aware decoding, causal interventions on internal representations, and preference optimization that rewards grounded reasoning. A central challenge is improving evidence use without sacrificing general capabilities: strong multimodal reasoning does not guarantee reliable grounding, and uncertainty or disagreement between modalities does not always indicate when a model should abstain or intervene.

Latest papers

CardsList

55 papers3 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. PACD: Provenance-Aware Consensus Decoding for Mitigating Cross-Modal Hallucinations in Omnimodal Large Language Models

    Nov 17, 2026Chang Sun, Yijun Tian, Zhenwei Tang +4Multimodal HallucinationMultimodal Large Language Models

  2. Trick-or-Treat: Adversarial Evaluation of Multimodal Medical Reasoning with Synthetic Images

    Nov 4, 2026Oishi Banerjee, Eujin Lee, Sung Eun Kim +4Multimodal Model EvaluationMultimodal Reasoning

  3. Entropogram-guided Visual Realignment Decoding: Capturing the Rhythm of Multimodal Reasoning

    Nov 4, 2026Jiaqi Deng, Zhe Fu, Yakun Chen +5Entropy-Based DecodingMultimodal Hallucination

  4. Omni-Woodpecker: Hallucination Correction via Evidence-Prior Rebalancing for Omni LLMs

    Oct 19, 2026Zijian Liu, Chaoyou Fu, Yan Yang +2LLM Hallucination MitigationMultimodal Hallucination

  5. Mitigating Cross-Modal Hallucinations by Correcting Modality Misrouting in Omnimodal LLMs

    Oct 13, 2026Yu Mi, Licheng Pan, Jiayi Zhu +7Multimodal Large Language ModelsMultimodal Hallucination

  6. OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

    Oct 2, 2026Huiqiang Rong, Haoran Luo, Hui Feng +4Multimodal Large Language ModelsMultimodal Hallucination

  7. Relevant Evidence Decoding for Audio-Visual Hallucination Mitigation

    Oct 2, 2026Hyunjae Ra, Aecheon Jung, Jungin Park +1Multimodal HallucinationHallucination Mitigation

  8. Omni-Streaming Thinking

    Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Audio-Visual UnderstandingStreaming Video Understanding

  9. OmniHallu: Unified Hallucination Detection for Cross-Modal Comprehension and Generation in Multimodal Large Language Models

    Sep 10, 2026Jianjiang Yang, Peihang Li, Shanqing Xu +3Hallucination Detection in VLMsHallucination Detection

  10. MLLMs Hallucinate when Information Distribution Drifts in Synergy Heads

    Sep 5, 2026Meng'en Qin, Junye Chen, Jucheng Liu +4Multimodal HallucinationVLM Hallucination Mitigation

  11. Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy

    Aug 30, 2026Yi-Cheng Lai, Hen-Hsen HuangLLM SycophancyEvidence-Grounded Reasoning

  12. HalluPrism: When Multimodal Uncertainty Should Diagnose, Not Decide

    Aug 29, 2026Aman Prakash, Sourish Dasgupta, Tanmoy ChakrabortyHallucination Detection in VLMsMultimodal Model Evaluation

  13. CAD: Conflict-Aware Decoding to Mitigate Cross-Modal Hallucinations in Omnimodal Large Language Models

    Aug 26, 2026Yuchen Deng, Chang Sun, Hai-Tao Zheng +2Multimodal Large Language ModelsMultimodal Hallucination

  14. Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs

    Aug 23, 2026Yikai Zhao, Qiyan Zhao, Jiaquan Zhang +3Diffusion Language Model DecodingLong-Form Document Generation

  15. PEA-DPO: Perception-Enhanced Alignment Direct Preference Optimization for MLLMs Alignment

    Aug 20, 2026Jiawei Feng, Jiancan Wu, Xingyu Zhu +3Hallucination in Language ModelsMultimodal Large Language Models

  16. KnowHal: A Knowledge-Driven Benchmark for Comprehensive Multimodal Hallucination Evaluation

    Aug 4, 2026Ruihan Li, Jiyang Tan, Kailin Jiang +5Multimodal HallucinationMultimodal Model Evaluation

  17. HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models

    Jul 23, 2026Weilin Jin, Mingyu Wang, Wenbo Li +5Hallucination Detection in VLMsMultimodal Hallucination

  18. Unified Hallucination Fuzzing for Multimodal Large Language Models

    Jul 15, 2026Pengfei Zhou, Jiajun Song, Zhiwei Tang +11Hallucination in Language ModelsMultimodal Hallucination

  19. No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs

    Jun 30, 2026Haojian Huang, Harold Haodong Chen, Meng Luo +6VLM EvaluationMultimodal Hallucination

  20. Omni-Perception Policy Optimization for Multimodal Emotion Reasoning

    Jun 24, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +6Multimodal ReasoningMultimodal Hallucination

  21. SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis

    Jun 20, 2026Niyoj Oli, Sachin Acharya, Sandesh Pokhrel +7EndoscopyMedical Imaging

  22. MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation

    Jun 16, 2026Zehang Wei, Jiaxin Dai, Jiamin Yan +1Multimodal RAGMulti-Agent LLM Systems

  23. ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning

    Jun 12, 2026Sicheng Yang, Hangjie Yuan, Wenjun Zhang +5Multimodal HallucinationClinical Reasoning

  24. Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement

    Jun 11, 2026Tingyu Li, Le Zhou, Siyuan Li +5Cross-Modal AlignmentMultimodal Reasoning

  25. ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?

    Jun 6, 2026Bin Zhu, Yanhao Jia, Kexin Zhao +12Physical ReasoningMultimodal QA