Probing the Lack of Stable Internal Beliefs in LLMs
Organizations: IIIS, Tsinghua University · Shanghai Qizhi Institute
Abstract
Persona-driven large language models (LLMs) require consistent behavioral tendencies across interactions to simulate human-like personality traits, such as persistence or reliability. However, current LLMs often lack stable internal representations that anchor their responses over extended dialogues. This work explores whether LLMs can maintain "implicit consistency", defined as persistent adherence to an unstated goal in multi-turn interactions. We designed a 20-question-style riddle game paradigm where an LLM is tasked with secretly selecting a target and responding to users' guesses with "yes/no" answers. Through evaluations, we find that LLMs struggle to preserve latent consistency: their implicit "goals" shift across turns unless explicitly provided their selected target in context. These findings highlight critical limitations in the building of persona-driven LLMs and underscore the need for mechanisms that anchor implicit goals over time, which is a key to realistic personality modeling in interactive applications such as dialogue systems.
Figures & tables
| Number Guessing | Entity Guessing | |||||||
|---|---|---|---|---|---|---|---|---|
| Model | D.R. ( ) | Once D.R. ( ) | KL Div. ( ) | E.C.V. ( ) | D.R. ( ) | Once D.R. ( ) | KL Div. ( ) | E.C.V. ( ) |
| GPT-4o | ||||||||
| Seed-1.6 | ||||||||
| + Reasoning | - | - | ||||||
| Deepseek-v3.1 | ||||||||
| + Reasoning | - | - | ||||||
| Model | D.R. ( ) | O.D.R. ( ) | KL Div. ( ) | E.C.V. ( ) |
|---|---|---|---|---|
| Qwen-2.5-14B-Instruct | ||||
| + CE | ||||
| + KL | ||||
| + CE & KL |
Personality Modeling in Language Models
Personality modeling in language models studies how traits are measured, represented, simulated, and controlled in model behavior.
See all 169 papers