cs.CLNov 9, 2026

More Than Just Style: Benchmarking Personality Influence in Large Language Models

Authors: Yuhao Liu, Mengyu Wang, Xiao Chen, Lu Liu

Organizations: University of Exeter · University of Edinburgh · Nanchang University

Abstract

In addition to the effects of explicit input prompts and instructions, large language model outputs are influenced by underlying behavioral preferences similar to human personality tendencies. These tendencies can affect how models interpret situations and make decisions. However, their influence is difficult to disentangle from the effects of model capabilities and instructions. Therefore, we introduce SPACE, a benchmark framework combining a controlled evaluation protocol with complementary datasets for personality verification, capability assessment, and hierarchical situational tasks. Controlled comparisons across guidance conditions help distinguish personality influence from measured capability changes and immediate instruction effects. Experimental results demonstrate that although prompting can shift generation style, models' internal personality tendencies are persistent and not readily overridden by opposing instructions. Furthermore, these underlying tendencies have an observable influence on LLM task performance, highlighting the need for greater attention to these characteristics and potential applications. Training code and SPACE benchmark specifications are available at https://github.com/Niklauseik/SPACE-training.

Figures & tables

Appendix figures & tables58 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Evaluation Drift in LLM Personality Induction: Are We Moving the Goalpost?

    May 16, 2026Prateek Rajput, Yewei Song, Iyiola E. Olatunji +2Personality Modeling in Language ModelsLLM Post-Training

  2. Persona Cartography: Charting Language Model Personality Traits in Weight Space

    Jul 8, 2026Luke Baines, Anton Gonzalvez Hawthorne, Mariia Koroliuk +4Personality Modeling in Language Models

  3. Your LLM, Your Style: Behavioral Mode Axes for LLM Behavioral Control

    Aug 11, 2026Haoze Liu, Run Liu, Haiying Xu +6Personality Modeling in Language ModelsActivation Steering