Hallucination in Language Models

Overview

The field studies when language models produce claims that are false, unsupported by their sources, or inconsistent with images, audio, and other evidence. Researchers evaluate errors at the level of claims, spans, reasoning steps, and agent trajectories, using factual question answering, retrieval-augmented generation, summarization, and multimodal benchmarks. Common approaches include retrieval and external verification, confidence calibration and abstention, targeted fine-tuning, and inference-time interventions based on decoding or internal model signals. A central tension is that uncertainty signals and mitigations vary across models and tasks: reducing unsupported answers can also suppress correct ones, while plausible reasoning or fluent outputs do not guarantee factual grounding.

Latest papers

CardsList

273 papers18 papers in the last four weeks, up 6% on the four weeks before. 0.1% of all new papers.

  1. HoT: Highlighted Chain of Thought for Referencing Supporting Facts from Inputs

    Mar 3, 2025Tin Nguyen, Logan Bolton, Mohammad Reza Taesiri +2LLM GroundingLLM Answer Verification

  2. Verify when Uncertain: Beyond Self-Consistency in Black Box Hallucination Detection

    Feb 20, 2025Yihao Xue, Kristjan Greenewald, Youssef Mroueh +1Kernel Mean EmbeddingsSelective Prediction

  3. Multilingual Hallucination Gaps in Large Language Models

    Oct 23, 2024Cléa Chataigner, Afaf Taïk, Golnoosh FarnadiHallucination in Language ModelsMultilingual Language Model Evaluation