cs.CLSep 4, 2026

Controlling and Assessing Appropriate Persona Use in LLM-based Dialogue Generation

Authors: Jongkyung Shin, Inkyu Lee, Chiehyeon Lim

Organizations: UNIST · POSTECH · POSCO Holdings Inc.

Abstract

In persona-based dialogue generation (PDG), LLMs often overuse persona attributes by incorporating them regardless of dialogue context, resulting in unnatural responses. Despite its practical significance, the underlying causes remain unexplored, with no method to mitigate this problem or metric to assess the appropriateness of persona use. To address these issues, we first conduct a comprehensive analysis of LLM-based PDG, revealing that LLMs exhibit a systematic bias to incorporate all given persona attributes, and that existing metrics fail to capture contextual appropriateness. Building on these findings, we propose Self-CONtrastive Persona Overuse Suppression (SCONPOS) to mitigate overuse by directly intervening in LLMs' internal representations at the prompt encoding stage, without requiring any response generation. We further propose the Persona Appropriateness Score (PAS), a novel metric that penalizes both overuse and underuse. Experimental results demonstrate that SCONPOS systematically reduces overuse, and PAS captures the contextual appropriateness of persona use.

Figures & tables

Appendix figures & tables27 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Pragmatic Persona: Discovering LLM Persona through Bridging Inference

    Apr 27, 2026Jisoo Yang, Jongwon Ryu, Minuk Ma +2Personality Modeling in Language ModelsLanguage Model Probing

  2. Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference

    Aug 27, 2026Mengfan Li, Zesheng Wei, Xuanhua Shi +1Persona ConsistencyLanguage Model Generation Evaluation

  3. PersEvalBench: Can LLM Evaluators Judge Contextually Appropriate Use of Persona Information?

    Oct 13, 2026Xinyi Liu, Hooshang Nayyeri, Emine Yilmaz +3LLM EvaluationLLM-as-a-Judge