LLM Hallucination Detection

LLM: Large Language Model

Overview

The field studies how to identify when language models produce false claims, unsupported content, or unreliable reasoning, especially in question answering, retrieval-augmented generation, and high-stakes domains. Common approaches verify claims against retrieved evidence, measure uncertainty through self-consistency or token probabilities, and probe internal signals such as hidden states, attention, and gradients. Detectors increasingly aim to locate errors at the claim, span, or reasoning-step level while reducing inference cost. A central challenge is that signals and benchmarks often fail to generalize across models, domains, and languages, and confident, repeatable fabrications can evade detection; identifying an error also does not necessarily make a model able to correct it.

Latest papers

CardsList

215 papers13 papers in the last four weeks, down 32% on the four weeks before. 0.1% of all new papers.

  1. Cross-Layer Attention Probing for Fine-Grained Hallucination Detection

    Sep 4, 2025Malavika Suresh, Rahaf Aljundi, Ikechukwu Nkisi-Orji +1LLM Hallucination DetectionLLM Reliability

  2. Towards Mitigation of Hallucination for LLM-empowered Agents: Progressive Generalization Bound Exploration and Watchdog Monitor

    Jul 21, 2025Siyuan Liu, Wenjing Liu, Zhiwei Xu +3LLM Hallucination MitigationHallucination in Language Models

  3. MedHal: a Synthetic Dataset for Medical Hallucination Detection

    Apr 11, 2025Fabrice Lamarche, Gaya Mehenni, Neshat Elhami Fard +4Hallucination in RAGHallucination Detection

  4. Verify when Uncertain: Beyond Self-Consistency in Black Box Hallucination Detection

    Feb 20, 2025Yihao Xue, Kristjan Greenewald, Youssef Mroueh +1Kernel Mean EmbeddingsSelective Prediction