Hallucination in Language Models

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 160% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 187

All topics

Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time
Jun 1, 2026Mingkuan Zhao, Yide Gao, Wentao Hu +6Contextual Faithfulness Hallucination in Language Models
Xi’an Jiaotong University · University of Science and Technology of China · Tongji University +1
Hallucination Is Linearly Decodable from Mid-Layer Hidden States in Quantized LLMs
May 30, 2026Aizierjiang AiersilanHallucination in Language Models LLM Hallucination Detection
University of Macau
BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali
May 29, 2026Shefayat E Shams Adib, Ahmed Alfey Sani, Ekramul Alam Esham +3Multilingual Language Model Evaluation Language Model Error Detection
Department of Computer Science and Engineering, Islamic University of Technology · Department of Computer Science and Engineering, University of California
Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
May 29, 2026Hao Chen, Xing Tang, Qirui Liu +6Retrieval-Augmented Generation Hallucination in Language Models
Shenzhen Technology University FiT, Tencent Shenzhen, China · South China University of Technology Guangzhou, China · The Hong Kong University of Science and Technology Hong Kong SAR, China +2
Mitigating Hallucination in Vision-Language Models through Barrier-Regulated Adaptive Closed-form Steering
May 28, 2026Soumyadeep Jana, Pulkit Mittal, Sanasam Ranbir SinghHallucination in Language Models Large Vision-Language Models
Indian Institute of Technology Guwahati, India
Social Reasoning in Machines: Investigating Collective Truth-Seeking Dynamics in Large Language Model Debate
May 28, 2026Tom PecherLLM Evaluation Hallucination in Language Models
Department of Computer Science University of Bath
ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation
May 28, 2026Shizhe Zhou, Bohan Jia, Kai Wu +4VLM Robustness Hallucination Detection
East China Normal University
K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance
May 28, 2026Eunbyeol Cho, Yunseung Lee, Mirae Kim +3Retrieval-Augmented Generation Hallucination in Language Models
KAIST AI · Financial Tech Lab, KakaoBank Corp.
Harmless Yet Harmful: Neutral Prompting Attacks for Stealthy Hallucination Steering in Agent Skills
May 28, 2026Chia-Yi Hsu, Chia-Mu Yu, Chun-Ying Huang +1Adversarial Prompt Generation AI Coding Agents
Department of Computer Science National Yang Ming Chiao Tung University · Department of Electronics and Electrical Engineering National Yang Ming Chiao Tung University · School of Computing Institute of Science Tokyo
Hallucination Mitigation with Agentic AI, Nested Learning, and AI Sustainability via Semantic Caching
May 27, 2026Diego Gosmar, Deborah A. DahlAI Agent Reliability Multi-Agent LLM Systems
Head of AI, Tesisquare · Member, Open Voice Interoperability Initiative · Linux Foundation AI & Data +4
Hallucination Detection-Guided Preference Optimization for Clinical Summarization
May 27, 2026Shamanth Kuthpadi Seethakantha, Dung Ngoc Thai, Vara Prasad Gudi +6LLM Self-Refinement LLM Hallucination Mitigation
1Manning College of Information and Computer Sciences · 2Ensemble HP · 3Columbia University +1
Entropy Distribution as a Fingerprint for Hallucinations in Generative Models
May 27, 2026Mattia J. Villani, Pranav Deshpande, Akshay Seshadri +2Language Model Error Detection Language Model Generation Evaluation
Global Technology Applied Research, JPMorganChase, New York, NY 10001, USA
Risk-aware Selective Prompting for Hallucination Mitigation in Large Vision-Language Models
May 27, 2026Yuang Huang, Yafeng Zhang, Yu ZilanVision-Language Models Hallucination in Language Models
Shanghai Jiao Tong University · iFLYTEK · Tsinghua University
Rethinking Visual Neglect: Steering via Context-Preference for MLLM Hallucination Mitigation
May 27, 2026Jingwen Wu, Xijun Zhang, Ge SongLLM Hallucination Mitigation Hallucination in Language Models
School of Computer and Electronic Information, Nanjing Normal University, China
Reasoning Matters: Mitigate Hallucination in Multimodal Large Reasoning Models via Reasoning-Conditioned Preference Optimization
May 27, 2026Jiawei Kong, Hao Fang, Shunxiang Liao +5Multimodal Grounding Direct Preference Optimization
Tsinghua Shenzhen International Graduate School, Tsinghua University · Harbin Institute of Technology, Shenzhen
Chain-based Adaptive Reconfiguration Over Lattices for Hallucination Reduction
May 26, 2026Joan Vendrell Gallart, Solmaz Kia, Russell Bent +1LLM Hallucination Mitigation Hallucination in Language Models
Department of Mechanical and Aerospace University of California Irvine Irvine, CA 92617-4322, USA · T-5 Los Alamos National Laboratory Los Alamos, NM 88220, USA · CAI-4 Los Alamos National Laboratory Los Alamos, NM 88220, USA
Can Hallucinations Be Useful? Solving Multi-Hop Questions With SLMs By Chaining System-I/II Reasoning
May 26, 2026Saptarshi Sengupta, Suhang WangMulti-Hop QA LLM Hallucination Mitigation
The Pennsylvania State University
On the Hidden Costs of Counterfactual Knowledge Training in LLM Unlearning
May 26, 2026Xiaotian Ye, Xiaohan Wang, Mengqi Zhang +1Knowledge Conflicts in Language Models Hallucination in Language Models
Beijing University of Posts and Telecommunications · Huazhong University of Science and Technology · Shandong University +1
Evaluating the Relevance of Uncertainty Estimators for LLM Hallucination
May 26, 2026Yedidia Agnimo, Anna Korba, Annabelle Blangero +2LLM Evaluation Hallucination in Language Models
Ekimetrics · Centre Inria de l’Université Grenoble Alpes · CREST, ENSAE +1
Innovation: An Almost Characterization of Hallucination
May 26, 2026Nishant P. Das, Piyush SrivastavaHallucination in Language Models Language Model Calibration
School of Technology and Computer Science, Tata Institute of Fundamental Research, Mumbai, Maharashtra - 400 005, India.
Automatic Layer Selection for Hallucination Detection
May 25, 2026Xinpeng Wang, William X. Cao, Andrew Gordon Wilson +1Hallucination in Language Models LLM Hallucination Detection
University of Virginia · 2Walrus Security · 3New York University.
Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations
May 25, 2026Shanghao Li, Jinda Han, Yibo Wang +5LLM Grounding LLM Interpretability
University of Illinois Chicago · University of Illinois Urbana-Champaign
Adversarial Orthogonal Disentanglement for LVLM Hallucination Mitigation
May 25, 2026Ruoxi Cheng, Haoxuan Ma, Zhengfei Hai +6Adversarial Representation Learning Vision-Language Models
Fudan University · Tencent · Nanjing University +3
Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration
May 24, 2026Yuanzhi Xu, Qian Gao, Jun Fan +4VLM Robustness Vision-Language Models
Qilu University of Technology (Shandong Academy of Sciences) Jinan, China · China Telecom Digital Intelligence Technology Co, Ltd Jinan, China · Shenyang Aerospace University Shenyang, China +1
MultiHaluDet: Multilingual Hallucination Detection via LLM Hidden State Probing
May 24, 2026Riasad Alvi, Nurul Labib Sayeedi, Md. Faiyaz Abdullah SayeediHallucination Detection Hallucination in Language Models
United International University · BRAC University
Correcting Visual Blur Induced by Attention Distraction to Reduce Hallucinations: Algorithm and Theory
May 23, 2026Quanjiang Li, Zhiming Liu, Wei Luo +2LLM Hallucination Mitigation Hallucination in Language Models
National University of Defense Technology, China · Harbin Institute of Technology (Shenzhen), China · Xi’an Jiaotong University, China.
Beyond Final Answers: Auditing Trajectory-Level Hallucinations in Multi-Agent Industrial Workflows
May 22, 2026Harshada Badave, Santosh Borse, Andrea Gomez +6AI Agent Reliability AI Agent Auditing
1IBM · 2Columbia University
CHASD: Language Increment-Calibrated Contrastive Decoding against Hallucination in LVLMs
May 22, 2026Xiaoyi Huang, Kejia Zhang, Zhiming LuoHallucination Detection in VLMs Efficient VLM Inference
Institute of Artificial Intelligence, Xiamen University · Department of Artificial Intelligence, Xiamen University
Graph Alignment Topology as an Inductive Bias for Grounding Detection
May 21, 2026Paul Landes, Pranav Herur, Adam Cross +1LLM Grounding Hallucination in Language Models
†Department of Pediatrics, University of Illinois College of Medicine Peoria · ♣University of Illinois Urbana-Champaign · ♠Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign +1
Hallucination as Commitment Failure: Larger LLMs Misfire Despite Knowing the Answer
May 21, 2026Jewon Yeom, Jaewon Sok, Heejun Kim +3LLM Interpretability Hallucination in Language Models
Graduate School of Data Science, Seoul National University · Department of Rural Systems Engineering, Seoul National University · Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology +1
Reducing Object Hallucination in LVLMs via Emphasizing Image-negative Tokens
May 20, 2026Meng Shen, Minghao Wu, Deepu RajanVision-Language Models Hallucination in Language Models
Nanyang Technological University · Monash University
Mitigating Hallucinations in Large Vision-Language Models via Causal Route Gating
May 20, 2026Zhe Cheng, Wenyu Chen, Fode Zhang +1VLM Robustness Hallucination in Language Models
Center of Statistical Research, School of Statistics and Data Science, Southwestern University of Finance and Economics, Chengdu, China. · Department of Biomedical Engineering, College of Design and Engineering, National University of Singapore, Singapore.
ACL-Verbatim: hallucination-free question answering for research
May 20, 2026Gábor Recski, Szilveszter Tóth, Nadia Verdha +2Retrieval-Augmented Generation LLM Hallucination Mitigation
TU Wien · KR Labs
Finding the Correct Visual Evidence Without Forgetting: Mitigating Hallucination in LVLMs via Inter-Layer Visual Attention Discrepancy
May 20, 2026Yutong Xie, Zhenglin Hua, Ran Wang +3Vision-Language Models Hallucination in Language Models
School of Computer Science and Engineering, Southeast University, Nanjing, China · School of Artificial Intelligence, Shenzhen University, Shenzhen, China · National Engineering Laboratory for Big Data Systems Computing Technology, Shenzhen University, Shenzhen, China +3
VIHD: Visual Intervention-based Hallucination Detection for Medical Visual Question Answering
May 20, 2026Jiayi Chen, Benteng Ma, Zehui Liao +3Hallucination Detection in VLMs Healthcare
Department of Data Science & AI, Faculty of Information Technology, Monash University, Melbourne, VIC 3800, Australia · Hong Kong Polytechnic University, Hong Kong SAR, China · Alfred Health Radiology, Alfred Health, Melbourne, VIC 3004, Australia +1
Do No Harm? Hallucination and Actor-Level Abuse in Web-Deployed Medical Large Language Models
May 20, 2026Sunday Oyinlola Ogundoyin, Muhammad Ikram, Rahat MasoodLanguage Model Safety Evaluation Healthcare
Macquarie University, Sydney, Australia · The University of New South Wales, Sydney, Australia
HalluCXR: Benchmarking and Mitigating Hallucinations in Medical Vision-Language Models for Chest Radiograph Interpretation
May 19, 2026Haoyu Wang, Zitong LiVision-Language Models Audio-Language Model Hallucination Detection
Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, UK
HalluWorld: A Controlled Benchmark for Hallucination via Reference World Models
May 19, 2026Emmy Liu, Varun Gangal, Michael Yu +4LLM Evaluation Hallucination in Language Models
Carnegie Mellon University · All authors are affiliated with DegenAI Labs. · Patronus AI +3
Causal Evidence for Attention Head Imbalance in Modality Conflict Hallucination
May 19, 2026Jinrui Jiang, Zhangtai Wu, Zhen Wu +1Hallucination in Language Models Multimodal Large Language Models
National Key Laboratory for Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China
TRACE: Trajectory Correction from Cross-layer Evidence for Hallucination Reduction
May 18, 2026Tej Sanibh RanadeLLM Hallucination Mitigation Hallucination in Language Models
Independent Researcher
FedSDR: Federated Self-Distillation with Rectification
May 18, 2026Ziheng Ren, Zhanming Shen, Hao Wang +2LLM Fine-Tuning Hallucination in Language Models
Beijing University of Aeronautics and Astronautics · Zhejiang University · Stevens Institute of Technology +1
The Range Shrinks, the Threat Remains: Re-evaluating LLM Package Hallucinations on the 2026 Frontier-Model Cohort
May 16, 2026Aleksandr ChurilovLLM Evaluation Hallucination in Language Models
Independent Researcher
PARALLAX: Separating Genuine Hallucination Detection from Benchmark Construction Artifacts
May 16, 2026Khizar Hussain, Murat KantarciogluLLM Evaluation Language Model Error Detection
Virginia Tech
HalluScore: Large Language Model Hallucination Question Answering Benchmark
May 16, 2026Aisha Alansari, Hamzah LuqmanMultilingual Language Model Evaluation LLM Evaluation
Department of Information and Computer Science, King Fahd University of Petroleum and Minerals · SDAIA-KFUPM Joint Research Center for Artificial Intelligence
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
May 16, 2026Shuqi Zhu, Yi Zhong, Ziyi Ye +4Hallucination Detection Hallucination in Language Models
Department of Computer Science and Technology, Tsinghua University, Beijing, China · Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China
LinAlg-Bench: A Forensic Benchmark Revealing Structural Failure Modes in LLM Mathematical Reasoning
May 15, 2026Shradha Agarwal, Deepak Rajbhar, Tariq JMathematical Reasoning Benchmarks LLM Evaluation
Department of Nuclear Engineering and Computer Science Missouri University of Science and Technology Rolla, Missouri
MHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs
May 14, 2026Wei Ding, Yilin Li, Yudong Zhang +4Vision-Language Models LLM Hallucination Mitigation
Tsinghua University Beijing, China · Tsinghua University, Tencent Beijing, China · Tencent Beijing, China +2
Do We Really Need External Tools to Mitigate Hallucinations? SIRA: Shared-Prefix Internal Reconstruction of Attribution
May 14, 2026Tian Qin, Junzhe Chen, Yuqing Shi +3Efficient VLM Inference Hallucination in Language Models
Tsinghua University · The University of Sydney · Stanford University +1
When Answers Stray from Questions: Hallucination Detection via Question-Answer Orthogonal Decomposition
May 14, 2026Siyang Yao, Erhu Feng, Yubin XiaHallucination in Language Models LLM Hallucination Detection
Shanghai Jiao Tong University Shanghai,China
Where Does Reasoning Break? Step-Level Hallucination Detection via Hidden-State Transport Geometry
May 13, 2026Tyler Alvarez, Ali BaheriLanguage Model Error Detection Hallucination Detection
Rochester Institute of Technology, Rochester, NY, USA.
Reducing Hallucination in Vision-Language Models via Stage-wise Preference Optimization under Distribution Shift
May 13, 2026Qinwu XuVLM Robustness Hallucination in Language Models
Meta AI
REALISTA: Realistic Latent Adversarial Attacks that Elicit LLM Hallucinations
May 12, 2026Buyun Liang, Jinqi Luo, Liangzu Peng +6Adversarial Prompt Generation Adversarial Attacks
University of Pennsylvania
Scalable Token-Level Hallucination Detection in Large Language Models
May 12, 2026Rui Min, Tianyu Pang, Chao Du +2LLM Evaluation Hallucination in Language Models
Sea AI Lab · Hong Kong University of Science and Technology · 1Sea AI Lab 2Hong Kong University of Science and Technology +2
Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models
May 12, 2026Runhe Lai, Xinhua Lu, Yanqi Wu +3Hallucination Detection in VLMs Hallucination Detection
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Peng Cheng Laboratory, Shenzhen, China · Key Laboratory of Machine Intelligence and Advanced Computing, MOE, Guangzhou, China.
OptArgus: A Multi-Agent System to Detect Hallucinations in LLM-based Optimization Modeling
May 12, 2026Zhong Li, Zihan Guo, Xiaohan Lu +5LLM Auditing Hallucination in Language Models
♣Great Bay University · ▲Peking University · ♡Jilin University +4
When Looking Is Not Enough: Visual Attention Structure Reveals Hallucination in MLLMs
May 12, 2026Fanpu Cao, Xin Zou, Xuming Hu +1Hallucination Detection in VLMs Hallucination in Language Models
Thrust of Artificial Intelligence, HKUST (Guangzhou), China · Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China
Rethinking Evaluation for LLM Hallucination Detection: A Desiderata, A New RAG-based Benchmark, New Insights
May 11, 2026Wenbo Chen, Veena Padmanabhan, Tootiya Giyahchi +2Hallucination Detection Hallucination in Language Models
Amazon · Carnegie Mellon University
A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapse
May 11, 2026Atul Ganju, Travis McVoy, Shaddin Dughmi +1Hallucination in Language Models Language Modeling
University of Southern California
Not Blind but Silenced: Rebalancing Vision and Language via Adversarial Counter-Commonsense Equilibrium
May 11, 2026Qingxin Xiao, Peilin Zhao, Yangyang Zhao +2VLM Robustness Hallucination in Language Models
South China University of Technology · Institute for Super Robotics (Huangpu) · Shanghai Jiao Tong University +1
Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination
May 11, 2026Yangneng Chen, Junlin Li, Weijun Yao +4Hallucination in Language Models VLM Hallucination
1Harbin Institute of Technology (Shenzhen), China · 2Huawei Technologies Co., Ltd. · 3The Hong Kong Polytechnic University +1

Jun 1, 2026, cs.CLJ/K move · Enter open · S save

Resonant Context Anchoring: Decoupling Attention Routing and Signal Gain at Inference Time

Mingkuan Zhao, Yide Gao, Wentao Hu, Suquan Chen+5

Xi’an Jiaotong University · University of Science and Technology of China · Tongji University+1

Contextual Faithfulness Hallucination in Language Models Causal Interventions in Language Models Inference-Time Intervention

Open paper AskPDF arXiv

Large Language Models (LLMs) frequently exhibit "contextual disregard" when faced with input evidence that conflicts with their internal parametric memory, leading to persistent factual hallucinations. Existing mitigation strategies primarily rely on suppressing specific neuron activations or employing computationally expensive contrastive decoding mechanisms, which often result in increased perplexity or significantly elevated inference latency. To address these limitations, we propose Resonant Context Anchoring (RCA), a lightweight inference-time intervention method grounded in the perspective of residual stream signal dynamics. RCA aims to resolve the signal attenuation of external evidence during its propagation through deep networks. The core mechanism involves the orthogonal decoupling of routing logic and information magnitude within the self-attention module. By utilizing raw pre-softmax attention scores as an instantaneous metric of semantic alignment, we construct a dynamic gain field via non-linear rectification to selectively amplify the norms of value vectors corresponding to context tokens, without altering the attention probability distribution. This mechanism effectively elevates the signal-to-noise ratio (SNR) of input evidence within the residual stream mixture, thereby robustly anchoring the generation trajectory to the truthful context during inference. Extensive experiments on the Llama-3 model series demonstrate that RCA significantly improves contextual faithfulness across multiple factual consistency and strong knowledge-conflict tasks, effectively suppressing parametric hallucinations. Furthermore, results confirm that as a training-free and computationally negligible plug-and-play module, RCA achieves a Pareto improvement in faithfulness and fluency while maintaining the model's general language understanding capabilities.

Momentum

Related topics

Latest papers 187