cs.CLNov 5, 2026

Compression of Emotion in Language Model Representations

Authors: Laya Iyer, Sanmi Koyejo, Chen Shani

Organizations: Stanford University · Tel Aviv University

Abstract

Large language models (LLMs) have been evaluated on their ability to identify emotions expressed in text and produce fluent emotional language. However, output predictions alone do not reveal how fine-grained emotion distinctions are organized internally. We study seven LLMs on GoEmotions, an English Reddit dataset annotated with 27 fine-grained emotion categories plus neutral. We compare model predictions and emotion-prompted final-token representations with the 28 GoEmotions categories and with coarser emotion-family and sentiment groupings. We find a consistent pattern of overcompression\textit{overcompression} relative to the fine-grained GoEmotions taxonomy. Under the tested KMeans protocol, when we cluster their hidden representations without using emotion labels, the clearest split is into two groups that largely separate positive from negative emotion. Coarser emotion groupings are also recovered with fewer clusters than the full 28-category taxonomy. Yet linear probes retain substantial fine-grained predictive information. These results suggest that fine-grained emotion information remains accessible even though broader affective structure more strongly organizes the unsupervised geometry.

Figures & tables

Appendix figures & tables9 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Some Emotions Run Deeper: Layer-wise Probing and Causal Intervention in Large Language Models

    Sep 1, 2026Tian Fang, Gaël Guibon, Davide BuscaldiCausal Interventions in Language ModelsEmotion Representation in Language Models

  2. Too Categorical to be Human: Emotion Concepts in LLMs and Humans

    Aug 7, 2025Sree Bhattacharyya, Evgenii Kuriabov, Lucas Craig +4LLM InterpretabilityEmotion Representation in Language Models