Knowledge Conflicts in Language Models

Overview

Knowledge conflicts arise when a model’s learned knowledge disagrees with information in a prompt, retrieved documents, tools, or stored conversation memory. Researchers test how models handle counterfactual and outdated facts, contradictory sources, and differences in framing or evidence order, using question-answering benchmarks, retrieval tasks, and multi-turn evaluations. Approaches include conflict-aware retrieval and decoding, confidence-based abstention, fine-tuning, and interventions that probe or steer internal representations. A central challenge is deciding when to follow context and when to resist it: stronger evidence-following can improve faithfulness but also make models more vulnerable to misleading, stale, or malicious information.

Latest papers

CardsList

155 papers17 papers in the last four weeks, down 11% on the four weeks before. 0.1% of all new papers.

  1. FutureBench: A Renewable Framework for Evaluating Knowledge-Context Conflict in LLMs

    Nov 17, 2026Yi-Cheng Lai, Hen-Hsen HuangKnowledge Conflicts in Language ModelsLLM Evaluation

  2. Multi-Agent Memory Inconsistency: Where Factual Conflicts Disappear in LLM Agents

    Nov 17, 2026Hejia Zhang, Zhongming Yu, Yimin Ding +9Multi-Agent SystemsKnowledge Conflicts in Language Models

  3. Knowledge After Collapse: Context and Wording Shape Factual Accessibility in Language Models

    Nov 13, 2026Sujato Dutta, Prithviraj Patil, Chandrajit BajajLLM ReliabilityKnowledge Conflicts in Language Models

  4. MuEdit: An efficient multi-task editing method towards inter-domain knowledge conflicts

    Nov 11, 2026Songshi Liang, Ting-En Lin, Zixuan Huang +4Knowledge EditingLanguage Model Editing

  5. Knowingly Wrong: Training LLMs Against Their Own Beliefs can Induce Misalignment

    Nov 3, 2026Ariana M. Villegas-Suarez, Guido Freire, Sohan Venkatesh +1Emergent Misalignment in Language ModelsKnowledge Conflicts in Language Models

  6. The Right Source Is Not Enough: Understanding History Interference in Speech-LLM Memory

    Nov 3, 2026HongJin Song, Weiqiao Shan, Runwu Shi +11Conversational MemorySpeech Language Models

  7. Illusory Truth or Salient Anomaly? Model-Dependent Responses to Repeated Poisoned Passages in RAG-Style Contexts

    Oct 29, 2026Mehrdad Ghassabi, Audrina Ebrahimi, Sadra Hakim +3Language Model Bias EvaluationNormative Conformity in Language Models

  8. Hidden Commitment: When Language Models Silently Pick a Side and How Steering Can Surface It

    Oct 28, 2026Samuel Dawit Assefa, Jae Won ChoKnowledge Conflicts in Language ModelsLanguage Model Auditing

  9. Coverage Under Contradiction: A Benchmark for Negation-Aware Retrieval

    Oct 27, 2026Pasha Abrishamchian, Eugene Yang, Andrew Yates +2IR EvaluationEvidence Retrieval

  10. Don't Pick a Winner: Knowledge Conflicts Need a Prior, Not a Rule

    Oct 26, 2026Minh Pham Van, Cong TranKnowledge Conflicts in Language Models

  11. Accept or Repair: Preserving Passage-Supported Answers in Contrastive Decoding

    Oct 21, 2026Jungseob Lee, Seungyoon Lee, Hyeonseok Moon +6Evidence-Grounded QALanguage Model Decoding

  12. Shaping the Document, Not the Model: Optimized Suffixes for Context Following

    Oct 19, 2026Gia-Bao Dinh Ho, Sekh Mainul Islam, Masahiro Kaneko +2Knowledge Conflicts in Language ModelsAutomatic Prompt Optimization

  13. When Retrieval Partially Conflicts with Skills: Understanding Procedural Hallucination in Language Models

    Oct 19, 2026Guanqun Jiang, Pengfei Cao, Kang Liu +1Hallucination in Language ModelsKnowledge Conflicts in Language Models

  14. Text Dominance in Paralinguistic Conflict: Tracing Suppression Through Audio LLM Circuits

    Oct 19, 2026Ankur Banerjee, Vishnu Guntakala, Danity Pike +3Audio-Language ModelsAudio-Language Model Evaluation

  15. Where and Why Search-Augmented LLMs Fail When Reasoning over Rapidly Evolving Knowledge

    Oct 18, 2026Tianyi Hu, Bhavyajeet Singh, Niket Tandon +1Retrieval-Augmented ReasoningLLM Reasoning

  16. MisleadQA: Diagnosing LLM Failures under Misleading Context

    Oct 17, 2026Hui Wang, Bohao Chu, Qianli Wang +2LLM EvaluationKnowledge Conflicts in Language Models

  17. Retrieved but Not Read: Understanding Why Search-Augmented LLMs Fail to Use Available Evidence

    Oct 15, 2026Owen Walters, Lihu Chen, Francesca ToniRetrieval-Augmented GenerationLLM Reliability

  18. Which Knowledge Should LLMs Trust? Uncovering a Generalizable Steering Direction Across Knowledge Conflicts

    Oct 14, 2026Yibin Lou, Yi Hu, Jianhui Chen +3Knowledge Conflicts in Language ModelsLLM Grounding

  19. Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict

    Oct 8, 2026Kaiser Sun, Bernal Jimenez Gutierrez, Hongjun Liu +4LLM Agent EvaluationEpistemic Uncertainty

  20. RAG-Stress: Probing the Limits of Evidence Reliance in Retrieval-Augmented Generation

    Oct 8, 2026Shunyuan Zhou, Hao Chen, Tianyu Wang +3Retrieval-Augmented GenerationRAG Evaluation

  21. The Attribution Blind Spot: Layerwise Trajectory Diagnostics for Source Reliance in Retrieval-Augmented Language Models

    Oct 7, 2026Zhe Yu, Wenpeng Xing, Yunzhao Wei +4LLM InterpretabilityRetrieval-Augmented Generation