Multimodal Hallucination

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 37

All topics

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination
Oct 2, 2026Huiqiang Rong, Haoran Luo, Hui Feng +4Multimodal Large Language Models Multimodal Hallucination
Beijing University of Posts and Telecommunications · Nanyang Technological University, Singapore
What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes
Sep 15, 2026Zhipeng Zhao, Wenxu Wang, Peishun Liu +1Hallucination Detection in VLMs Multimodal Grounding
1Ocean University of China
Omni-Streaming Thinking
Sep 14, 2026Enjun Du, Siyi Liu, Ziyu Zheng +4Audio-Visual Understanding Streaming Video Understanding
1The University of Hong Kong · 2The Hong Kong University of Science and Technology (Guangzhou) · University of Sussex +2
OmniHallu: Unified Hallucination Detection for Cross-Modal Comprehension and Generation in Multimodal Large Language Models
Sep 11, 2026Jianjiang Yang, Peihang Li, Shanqing Xu +3Hallucination Detection in VLMs Hallucination Detection
The University of Manchester · The University of Hong Kong · Huazhong University of Science and Technology +2
KnowHal: A Knowledge-Driven Benchmark for Comprehensive Multimodal Hallucination Evaluation
Aug 4, 2026Ruihan Li, Jiyang Tan, Kailin Jiang +5Multimodal Hallucination Multimodal Model Evaluation
1C-FAIR & School of software, Shandong University · University of Science and Technology of China · 3Jiangnan University
HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models
Jul 23, 2026Weilin Jin, Mingyu Wang, Wenbo Li +5Hallucination Detection in VLMs Multimodal Hallucination
Peking University Beijing, China · Joy Future Academy Beijing, China
Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation
Jul 22, 2026Zhengxian Wu, Junjie Gao, Kai YangMultimodal Grounding Agentic Search
Ant Group · Hangzhou, China
Do You Remember? Toward Memory-Centric Multimodal AI
Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMemory-Augmented VLMs Multimodal Memory
No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs
Jun 30, 2026Haojian Huang, Harold Haodong Chen, Meng Luo +6VLM Evaluation Multimodal Hallucination
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Knowin AI, China · National University of Singapore, Singapore +4
Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation
Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +5Multimodal Large Language Models Multimodal Hallucination
HKUST (GZ) · HKUST · OPPO AI Center
Omni-Perception Policy Optimization for Multimodal Emotion Reasoning
Jun 24, 2026Zhiyuan Han, Beier Zhu, Wenwen Tong +6Multimodal Reasoning Multimodal Hallucination
University of Science and Technology of China · SenseTime · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center +1
SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis
Jun 20, 2026Niyoj Oli, Sachin Acharya, Sandesh Pokhrel +7Endoscopy Medical Imaging
Nepal Applied Mathematics and Informatics Institute for Research, Nepal · University of Utah, USA · GastroIntestinal Department, Dhulikhel Hospital, Nepal +3
MODE-RAG: Manifold Outlier Diagnosis and Energy-based Retrieval-Augmented Generation Evaluation
Jun 16, 2026Zehang Wei, Jiaxin Dai, Jiamin Yan +1Multimodal RAG Multi-Agent LLM Systems
School of AI and Automation, Huazhong University of Science and Technology, China · School of Computer Science & Tech, Huazhong University of Science and Technology
ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning
Jun 12, 2026Sicheng Yang, Hangjie Yuan, Wenjun Zhang +5Multimodal Hallucination Clinical Reasoning
The Hong Kong University of Science and Technology (Guangzhou) · DAMO Academy, Alibaba Group · Hupan Lab +1
Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement
Jun 11, 2026Tingyu Li, Le Zhou, Siyuan Li +5Cross-Modal Alignment Multimodal Reasoning
Shanghai Artificial Intelligence Laboratory · Shanghai Jiaotong University · Zhejiang University +1
ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?
Jun 6, 2026Bin Zhu, Yanhao Jia, Kexin Zhao +12Physical Reasoning Multimodal QA
Peking University, Shenzhen Graduate School · 2Peng Cheng Laboratory · Rabbitpre Intelligence +3
SVHalluc: Benchmarking Speech-Vision Hallucination in Audio-Visual Large Language Models
May 31, 2026Chenshuang Zhang, Kyeong Seon Kim, Chengxin Liu +1Audio-Visual Understanding Multimodal Large Language Models
KAIST
MM-Snowball: Evaluating and Mitigating Hallucination Snowballing in Multimodal Multi-Turn Dialogue
May 30, 2026Yue Jiang, Xue Jiang, Lihua Zhang +6Multimodal Large Language Models Multimodal Hallucination
College of Intelligent Robotics and Advanced Manufacturing, Fudan University · Southern University of Science and Technology · TMLR Group, Hong Kong Baptist University +3
ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation
May 28, 2026Shizhe Zhou, Bohan Jia, Kai Wu +4VLM Robustness Hallucination Detection
East China Normal University
Reasoning Matters: Mitigate Hallucination in Multimodal Large Reasoning Models via Reasoning-Conditioned Preference Optimization
May 27, 2026Jiawei Kong, Hao Fang, Shunxiang Liao +5Multimodal Grounding Direct Preference Optimization
Tsinghua Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology, Shenzhen
Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks
May 26, 2026Partho Ghose, Al Bashir, Prem Raj +1Agricultural Image Analysis VLM Hallucination
Department of Biological & Agricultural Engineering, Texas A&M AgriLife Research, Texas A&M University System, Dallas, TX 75252, USA.
Causal Evidence for Attention Head Imbalance in Modality Conflict Hallucination
May 19, 2026Jinrui Jiang, Zhangtai Wu, Zhen Wu +1Hallucination in Language Models Multimodal Large Language Models
National Key Laboratory for Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China
Hallucination as Exploit: Evidence-Carrying Multimodal Agents
May 18, 2026Guijia Zhang, Hao Zheng, Harry YangAI Agent Security Multimodal Hallucination
1Shenzhen University · 2HKUST
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
May 16, 2026Shuqi Zhu, Yi Zhong, Ziyi Ye +4Hallucination Detection Hallucination in Language Models
Department of Computer Science and Technology, Tsinghua University, Beijing, China · Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China
When Vision Speaks for Sound
May 13, 2026Xiaofei Wen, Wenjie Jacky Mo, Xingyu Fu +6Audio-Language Model Evaluation Audio-Visual Understanding
dUniversity of California, Davis · pPrinceton University · wUniversity of Wisconsin–Madison +1
When Looking Is Not Enough: Visual Attention Structure Reveals Hallucination in MLLMs
May 12, 2026Fanpu Cao, Xin Zou, Xuming Hu +1Hallucination Detection in VLMs Hallucination in Language Models
Thrust of Artificial Intelligence, HKUST (Guangzhou), China · Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China
Omni-Persona: Systematic Benchmarking and Improving Omnimodal Personalization
May 11, 2026Yeongtak Oh, Dongwook Lee, Sangkwon Park +2Multimodal Grounding Multimodal Large Language Models
Department of Electrical and Computer Engineering, Seoul National University · Interdisciplinary Program in Artificial Intelligence, Seoul National University · Department of Artificial Intelligence, University of Seoul
Separate First, Fuse Later: Mitigating Cross-Modal Interference in Audio-Visual LLMs Reasoning with Modality-Specific Chain-of-Thought
May 11, 2026Xuanchen Li, Yuheng Lu, Chenrui Cui +6Cross-Modal Learning Multimodal QA
Tianjin Key Laboratory of Cognitive Computing and Application, Tianjin University, Tianjin, China · Tencent, China · Huiyan Technology Company, Ltd., Tianjin, China +1
TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos
May 8, 2026Hengyi Feng, Hao Liang, Mingrui Chen +6Audio-Visual Understanding Multimodal Hallucination
University of Electronic Science and Technology of China · Peking University · Zhongguancun Academy +1
Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time
May 3, 2026Itai Allouche, Joseph KeshetMultimodal Grounding Inference-Time Optimization
Department of Electrical and Computer Engineering, Technion, Haifa, Israel
Self-Captioning Multimodal Interaction Tuning: Amplifying Exploitable Redundancies for Robust Vision Language Models
May 3, 2026Yuriel Ryan, Hei Man Ip, Adriel Kuek +2VLM Robustness Multimodal Hallucination
Singapore University of Technology and Design · DSO National Laboratories · Massachusetts Institute of Technology
DualFact+: A Multimodal Fact Verification Framework for Procedural Video Understanding
Apr 28, 2026Cennet Oguz, Yasser Hamidullah, Josef van Genabith +1Multimodal Grounding Video Understanding
German Research Center for Artificial Intelligence (DFKI) · Saarland Informatics Campus
Exploring Audio Hallucination in Egocentric Video Understanding
Apr 26, 2026Ashish Seth, Xinhao Mei, Changsheng Zhao +9Audio-Visual Understanding Hallucination in Language Models
Meta · University Of Maryland, College Park
HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models
Apr 21, 2026Feiyu Zhao, Yiming Chen, Wenhuan Lu +3Audio-Language Model Evaluation Audio-Language Model Hallucination Detection
College of Intelligence and Computing, Tianjin University, China · ASUS Intelligent Cloud Services, Singapore
Mitigating Multimodal Hallucination via Phase-wise Self-reward
Apr 20, 2026Yu Zhang, Chuyang Sun, Kehai Chen +3Vision-Language Models Hallucination in Language Models
Harbin Institute of Technology · Peng Cheng Laboratory · Shenzhen, China
Do Multimodal LLMs See Before They Read? Diagnosing Contextual Sycophancy
Date pendingYi-Cheng Lai, Hen-Hsen HuangLLM Sycophancy Evidence-Grounded Reasoning
Institute of Information Science, Academia Sinica Taipei, Taiwan
MAD: Modality-Adaptive Decoding for Mitigating Cross-Modal Hallucinations in Multimodal Large Language Models
Date pendingSangyun Chung, Se Yeon Kim, Youngchae Chee +1Multimodal Robustness Hallucination in Language Models
Integrated Vision Language Lab, KAIST, South Korea

Oct 2, 2026, cs.CLJ/K move · Enter open · S save

OmniConfess: Eliciting Token Confessions to Mitigate Omni-Modal Hallucination

Huiqiang Rong, Haoran Luo, Hui Feng, Zhonghong Ou+3

Beijing University of Posts and Telecommunications · Nanyang Technological University, Singapore

Multimodal Large Language Models Multimodal Hallucination Hallucination Mitigation Multimodal Model Evaluation

Open paper AskPDF arXiv

Omni-modal large language models (OmniLLMs) unify text, images, audio, and video, yet hallucinate when generation relies on the wrong evidence. Existing inference-time methods can reduce hallucinations, but rarely reveal which evidence sustains a generated commitment. We introduce OmniConfess, a training-free method for mitigating omni-modal hallucinations. It fixes a candidate response and re-scores it at token resolution under controlled channel-wise evidence interventions, producing a structured token-by-channel confession that reveals the response's evidential dependence. OmniConfess uses this confession to preserve grounded content and correct commitments driven by irrelevant or contradictory evidence. To evaluate OmniConfess, we construct OmniHalluBench, a 3,540-example benchmark built from six datasets spanning text, image, audio, and video settings and both judgment and free-form generation. Experiments show that OmniConfess mitigates hallucinations across heterogeneous modality and task settings. Our code and benchmark are publicly available at https://github.com/RongHuiQiang/OmniConfess.

Momentum

Related topics

Latest papers 37