Pragmatic Reasoning in Language Models

Overview

This field studies how language models interpret what people mean beyond literal wording, including implicatures, indirect requests, ambiguity, and culturally shaped conventions. Researchers use theory-based tests such as Rational Speech Act models, controlled benchmarks, and interactive dialogue tasks to examine how models track speaker beliefs, common ground, and conversational context. Results show that models can often recognize or judge pragmatic meanings more reliably than they can use them when generating responses, and explicit prompts or targeted training sometimes help. A central challenge is making these abilities robust across speakers, languages, and real interactions, where fluent or accurate answers do not necessarily show that a model understood the user’s intent.

Latest papers

CardsList

108 papers7 papers in the last four weeks, down 53% on the four weeks before. 0.1% of all new papers.

  1. Must AI Spell It Out? Pragmatic Comprehension of Alerts in a Time-Critical Task

    Nov 2, 2026Anwesha Das, Vera Demberg, Anna Maria FeitHuman-AI InteractionPragmatic Reasoning in Language Models

  2. Hey, guess what: CUES lead to inferences about typicality

    Oct 23, 2026Alison Chi, Sanghyeok Choi, Hannah Rohde +1Pragmatic Reasoning in Language ModelsCommonsense Reasoning

  3. CEMIR vs. FISER: a comparative study of reasoning-based and enrichment-based approaches to pragmatic intent recognition

    Oct 23, 2026Ziya Hosseynzadeh, Farjad Fallah, Farnoosh Fallah +3Multimodal Intent RecognitionPragmatic Reasoning in Language Models

  4. Reading Too Much Into It? Interpretive Preferences and Commitment in LLM Mentalisation under Ambiguity

    Oct 20, 2026Stephanie Fong, Yiwen Jiang, Qingyang Xu +7Language Model Reasoning EvaluationTheory of Mind

  5. Why Do LLMs Accept Generics? Explaining Acceptability using Psycholinguistic and Model-Derived Factors

    Oct 20, 2026Mervat Abassy, Zhaoxin Feng, Tatsuki Kuribayashi +2Pragmatic Reasoning in Language Models

  6. Assertion and Belief: Moore's Paradox in Language Models

    Oct 18, 2026Anshun Asher Zheng, Weili Cao, Fangcong Yin +2Pragmatic Reasoning in Language ModelsLanguage Model Reasoning Evaluation

  7. Entertain, then Cancel: How Thinking Makes Reasoning Models Read Some and Or Literally

    Oct 15, 2026Zhizhuo Kou, Jian Yang, Pengfei Hao +4Pragmatic Reasoning in Language ModelsLarge Reasoning Models

  8. Lexical Redefinition Reveals Context-Sensitive Instruction Following

    Oct 12, 2026Roksana Goworek, Haim DubossarskyLLM PromptingPragmatic Reasoning in Language Models

  9. Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models

    Oct 9, 2026William Sheffield, Jiahui Chen, Amy Zhang +3Pragmatic Reasoning in Language ModelsLanguage Modeling

  10. The AI's Poker Face: Contrasting Persuasion and Sycophancy in Voice-Based Multi-Turn Conversations

    Oct 9, 2026Ilia Frantzi, Bernie Hogan, Max M. Lang +1Persuasion in Language ModelsLLM Sycophancy

  11. Evidence and Intervention: A Coupled Active-Inference Extension of Rational Speech Act Models

    Oct 3, 2026Yonghyeon Gwon, Elliot Murphy, Chun Kee ChungPragmatic Reasoning in Language ModelsActive Inference

  12. Prospective Interpretation Risk: Principled Communication Control Between LLMs

    Sep 27, 2026Wanrong Yang, Rehan Deen, Julian Ma +7Multi-Agent LLM SystemsPragmatic Reasoning in Language Models

  13. Larry Caused the Car to Stop, But the Model Didn't Notice: Transformer Blindness to the M-Heuristic

    Sep 27, 2026Stefania Butnaru, Claudiu CreangaPragmatic Reasoning in Language Models

  14. Agentic Detection of Online Conspiracies

    Sep 24, 2026Lior Biton, Oren TsurSocial Media AnalysisPragmatic Reasoning in Language Models

  15. Structured Claim-Level Discourse Representations for Dense Health Narratives

    Sep 16, 2026Farnoushsadat Nilizadeh, Elham Pourabbas Vafa, Shirin Nilizadeh +1Argument MiningStance Detection

  16. Domain-specific Pretraining Profile and Transformer Performance: Evidence from Modeling Digital Pragmatics in Arabic-English Code-switching

    Sep 13, 2026Fahad Al Hussen, King Saud University, Riyadh +5Arabic NLPPragmatic Reasoning in Language Models

  17. Learning to Refer from Estimated Listener Gaze

    Sep 13, 2026Téa Wright, Alane SuhrText GenerationPragmatic Reasoning in Language Models

  18. Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picture

    Sep 11, 2026Cody Kommers, Mingrui Ye, Evelyn Gius +4Pragmatic Reasoning in Language ModelsMultimodal Large Language Models

  19. Do LLMs Trust the Accuser or the Accusation? Measuring Belief Shifts in Werewolf

    Sep 11, 2026Yu-Yu Yang, Ti-Rong Wu, Hung Guei +2Social Deduction GamesPragmatic Reasoning in Language Models