Causal Reasoning in Language Models

Overview

The field asks whether language models can go beyond patterns of correlation to identify causes, predict what would happen under interventions, and reason about what might have happened otherwise. Researchers test these abilities with causal graphs, counterfactual questions, context-sensitive tasks in areas such as medicine and policy, and interactive settings where models must choose experiments. Approaches include prompting with explicit graphs, retrieval and tool use, multi-agent experiment design, and training with simulated interventions or step-level feedback. Models can handle some familiar causal patterns, but often confuse association with cause, miss context changes, or give fluent answers unsupported by a valid causal path; a central challenge is distinguishing genuine causal competence from shortcuts in language or benchmark performance.

Latest papers

CardsList

109 papers8 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. CST-Bench: Benchmarking Counterfactual Spatial Transition Reasoning with Causal Transition On-Policy Self-Distillation

    Nov 5, 2026Ying Li, Yongle Cheng, Jing Li +2Spatial Reasoning BenchmarksMultimodal Spatial Reasoning

  2. TCC-RAG: Temporal Causal Chain-Guided RAG for Temporal Knowledge Graph Question Answering

    Oct 28, 2026Xinxun Zhang, Yuxiang Wang, Shanshan Feng +6Temporal KG Question GenerationKnowledge Graph Question Answering

  3. From Document Layout to Causal Topology: An End-to-End Architecture for Temporal Causal Reasoning

    Oct 25, 2026Zhifeng Yang, Wei Luo, Yongjian Chen +1Causal Reasoning in Language ModelsTemporal Reasoning in Language Models

  4. CauProphet: Teaching Agents to Develop Causal Cognition like Humans

    Oct 23, 2026Kaiwen Wu, Chaochao LuCausal Reasoning in Language ModelsContinual Learning for LLM Agents

  5. Causal Chain of Thought: Mitigating Attention Leakage via Context Isolation

    Oct 22, 2026Gabriele Dominici, Teague McMillan, Fazl Barez +2Structured Reasoning in Language ModelsFaithfulness of Language Model Reasoning

  6. From Observation to Intervention: Distilling Self-Generated In-Context Demonstrations via Executable Causal Intervention

    Oct 15, 2026Minming Ye, Min Liu, Haoang Chi +2In-Context LearningIn-Context Example Selection

  7. ACED-Bench: Evaluating How LLM Agents Acquire and Act on Causal Evidence

    Oct 9, 2026Yiwei Chen, Amila Weerasinghe, Siddharth Biswal +4AI Agent BenchmarksCausal Reasoning in Language Models

  8. Illusory Pattern Perception Drives Spurious Inference in Large Language Models

    Oct 6, 2026Peihua Mai, Zhuoyan Shao, Xinbao Qiao +3Causal Reasoning in Language Models

  9. Readable Before Actionable: Causal Tracing of Indirect Prompt Injection

    Oct 4, 2026Zhe Yu, Wenpeng Xing, Xingxing Yang +1Causal Reasoning in Language ModelsIndirect Prompt Injection

  10. Reasoning Models Are Accurate but Unsound on Identification

    Oct 2, 2026Arman Behnam, Binghui WangQuery IdentifiabilityCausal Identifiability

  11. To Explore The Strange New World Beyond Data Distribution: System Behavior, Causality Tax, and Non-causal Base Model

    Oct 2, 2026Xianzhi Zeng, Jiangneng Li, Gao CongCausal Reasoning in Language ModelsVariational Inference

  12. THPL: A Vision-to-Language Decision Support Framework for Rainbow Trout Feeding Management in RAS

    Oct 1, 2026Meng Liang, Guanbo Feng, Haozhuang Chi +7LLM Decision-MakingCausal Reasoning in Language Models

  13. Inferring Causal Relations between Two Sequences of Events with Language Models

    Sep 30, 2026Nishchal Prasad, Eric Gaussier, Emilie Devijver +3Time-Series Causal DiscoveryCausal Discovery

  14. CHAIN: Calibrated LLM Forecasting via Causal-Temporal Hypergraph Inference

    Sep 29, 2026Wenjin Liu, Chenxi Wang, Yue Lu +2Probabilistic ForecastingLanguage Model Calibration

  15. World Agent: Can Language Models Keep a World Running?

    Sep 26, 2026Weixing Chen, Weipeng Zhang, Nan An +2World Model EvaluationWorld Models

  16. Externalized CPDAG Summaries Improve LLM Causal Deduction

    Sep 25, 2026Wentao Sun, João Paulo Nogueira, Dominique Verchere +2Causal Reasoning in Language ModelsCausal Reasoning

  17. Contextual Causality with Large Language Models: A Survey

    Sep 18, 2026Yiheng Zhao, Jun Yan, Chengming HuCausal Reasoning in Language ModelsCausal Interventions in Language Models

  18. CaLR: Causal Latent Revision for Robust Diffusion Reasoning

    Sep 17, 2026Wei Cai, Jian Zhao, Yuchen Yuan +1Reasoning Consistency in Language ModelsDiffusion Language Models

  19. CausalVerify: End-to-End Verification of Causal Analyses by Language Models

    Sep 7, 2026Yonghong Zhang, Ricardo Correia, Isabel M. Parra +1LLM EvaluationCausal Effect Estimation

  20. SerenAI: State-transition system inspired by text-based world AI models

    Sep 6, 2026Elvin Babayev, Artem Sinitsa, Arash Hajisharifi +1LLM World ModelsCausal Reasoning in Language Models

  21. CRAFT: Fine-Tuning Pre-hoc Explainability in AI-native 6G RAN

    Sep 1, 2026Pranshav Gajjar, Vijay K Shah6G NetworksLLM Interpretability

  22. Generative artificial intelligence for reliable mechanistic reasoning for corrosion

    Aug 31, 2026M N Bharath, R K Singh Raman, Alankar AlankarRetrieval-Augmented GenerationCausal Reasoning in Language Models

  23. Medical Causal Hypothesis Verification with Large Language Models

    Aug 30, 2026Safiyyah Ahmed, Abrar Ansari, Md Aminul Islam +1Medical LLMsCausal Reasoning in Language Models