Dynamic Theory of Mind as a Temporal Memory Problem: Evidence from Large Language Models
Organizations: Department of Computer Science, University of Dayton · University of Dayton Research Institute, University of Dayton · Department of Social and Decision Sciences, Carnegie Mellon University
Abstract
Theory of Mind (ToM) is central to social cognition and human-AI interaction, and Large Language Models (LLMs) have been used to help understand and represent ToM. However, most evaluations treat ToM as a static judgment at a single moment, primarily relying on tests of false beliefs. This overlooks a key dynamic dimension of ToM: the ability to represent, update, and retrieve others' beliefs over time. We investigate dynamic ToM as a temporally extended representational memory problem, asking whether LLMs can track belief trajectories across interactions rather than only inferring current beliefs. We introduce DToM-Track, an evaluation framework to investigate temporal belief reasoning in controlled multiturn conversations, testing the recall of beliefs held prior to an update, the inference of current beliefs, and the detection of belief change. Using LLMs as computational probes, we find a consistent asymmetry: models reliably infer an agent's current belief but struggle to maintain and retrieve prior belief states once updates occur. This pattern persists across LLM model families and scales, and is consistent with recency bias and interference effects well documented in cognitive science. These results suggest that tracking belief trajectories over time poses a distinct challenge beyond classical false-belief reasoning. By framing ToM as a problem of temporal representation and retrieval, this work connects ToM to core cognitive mechanisms of memory and interference and exposes the implications for LLM models of social reasoning in extended human-AI interactions.
Figures & tables
| Question Type | What It Tests | Template Examples |
|---|---|---|
| pre_update | What did X believe before the change? | What was {agent}’s {topic} before the update at turn {turn}? |
| post_update | What does X believe after the change? | After the update at turn {turn}, what is {agent}’s current {topic}? |
| update_detection | When did X’s belief change? | At which point did {agent} update their {topic}? |
| temporal | What did X believe at turn ? | At turn {turn}, what was {agent}’s {topic}? |
| second_order | What does X think Y believes? | At turn {turn}, what did {agent} think {other_agent} believed about {topic}? |
| false_beliefs | What was X’s actual belief and What did Y incorrectly assume? | What did {agent} actually believe about {topic}, despite {other_agent}’s assumption? ; What did {other_agent} incorrectly assume about {agent}’s {topic}? |
| By Question Type | By Mental State Category | ||||
|---|---|---|---|---|---|
| Category | Count | % | Category | Count | % |
| Temporal | 1,807 | 31.2% | Intention | 1,639 | 28.3% |
| False Belief | 1,761 | 30.4% | Desire | 1,529 | 26.4% |
| Second-Order | 768 | 13.3% | Belief | 1,136 | 19.6% |
| Update Detection | 591 | 10.2% | Emotion | 774 | 13.4% |
| Post-Update | 527 | 9.1% | Knowledge | 716 | 12.4% |
| Question Type | GPT-4o-mini | llama3-1-8b | llama3-3-70b | ministral-3-14b | mistral-large-2402 | llama3-2-3b |
|---|---|---|---|---|---|---|
| Temporal | 57.7 | 35.6 | 65.5 | 54.4 | 57.4 | 30.2 |
| Update Detection | 75.0 | 47.2 | 76.1 | 77.8 | 75.1 | 53.6 |
| Post-Update | 68.5 | 57.9 | 71.3 | 64.9 | 65.7 | 55.0 |
| False Belief | 45.9 | 35.6 | 59.2 | 42.0 | 51.7 | 34.0 |
| Second-Order | 57.9 | 37.0 | 62.0 | 43.4 | 49.2 | 34.0 |
| Pre-Update | 27.6 | 12.1 | 40.9 | 30.0 | 40.0 | 15.6 |
Theory of Mind
Theory of Mind studies how people and AI infer others’ beliefs, goals, and knowledge to predict behavior and coordinate interaction.
See all 92 papers