cs.CLNov 12, 2026

MuSeToM: Multi-Sensory Evaluation of Belief Revision with Textual Cues Across Six Senses

Authors: Chunkit Chan, Kawai Chung, Sze Heng Douglas Kwok, Yuxuan Liu, Yauwai Yim, Tianshi Zheng, Haochen Shi, Qing Zong, 

Organizations: The Hong Kong University of Science and Technology · Stanford University · Amazon · NVIDIA AI Technology Center (NVAITC)

Abstract

Theory of Mind (ToM), the ability to infer mental states in others, is pivotal for human social cognition. Existing evaluations of ToM in large language models (LLMs) mainly focus on static belief attribution and false-belief reasoning, leaving a critical aspect of social reasoning underexplored: can LLMs decide whether perceptual evidence is sufficient to justify another person's belief revision? To address this gap, we present MuSeToM, a human-validated, text-based benchmark for evaluating epistemic belief revision in ToM reasoning. MuSeToM contains 2,415 instances adapted from BigToM and OpenToM, with textual cues spanning six sensory categories, and tests whether models can determine when a protagonist should revise a belief and infer the resulting updated belief state. Using MuSeToM, we systematically evaluate state-of-the-art LLMs under direct and chain-of-thought prompting, revealing a pronounced dissonance: while models often detect that a belief may change, they struggle to identify the updated belief and frequently over-update on perceptually salient but epistemically insufficient cues.

Figures & tables

Appendix figures & tables27 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. OmniToM: Benchmarking Theory of Mind in LLMs via Explicit Belief Modeling

    May 25, 2026Adam Bawatneh, Sagar Sapkota, Amrit Singh Bedi +2LLM EvaluationTheory of Mind

  2. Mind the Perspective: Let's Reason Recursively for Theory of Mind

    Jun 10, 2026Chao Lei, Guang Hu, Meng Yang +2Logical ReasoningTheory of Mind

  3. Who Knows What - and What Does It Support? Perspective-Bounded Evidence Calibration for Multimodal Theory of Mind

    Oct 27, 2026Ziqi Liao, Jiaqi Shen, Yiming Na +3Theory of MindMLLM Reasoning