cs.CLOct 29, 2025

TOPol: Reconstructing and Interpreting Multidimensional Semantic Polarity Fields

Authors: Lucia Gomez, Gabin Taibi, Julius Sipke Kooistra

Organizations: University of Geneva · Bern Unversity of Applied Sciences · University of Twente · LGT Bank

Abstract

Polarity in natural language processing has long been operationalized as a single axis: the sentiment construct. We challenge this one-dimensional view by asking what a topic's documents are bipolar about, without specifying an answer in advance. TOPol inverts the usual concept-direction paradigm: rather than mapping a named construct to one direction, it maps a topic to the full set of statistically reproducible bipolar semantic axes its documents support in a transformer's residual stream, and asks only afterwards which of them correspond to a known construct. These axes need not be evaluative. The method is a recursive, orthogonal-by-construction bipartition of each topic's document cloud, with a candidate axis promoted to a finding only if it survives one pre-specified split-half stability gate. We calibrate against a known answer first: on 9,986 Amazon reviews (14 discovered topics) in Gemma 3 4B, the star-rating difference-in-means vector serves as a ruler known by construction to be sentiment. Discovery blindly re-derives the sentiment axis in every topic (cosine 0.71-0.97) without ever seeing the rating label, while the same gate certifies 543 axes, of which 106 are near-orthogonal to sentiment yet equally reproducible; each topic supports 33-45 mutually orthogonal axes, and sentiment axes resolve in later layers than the rest. Differential vocabulary, an internals-grounded natural-language decoder and vocabulary-based clustering agree on what the non-sentiment axes contrast; clustering by shared vocabulary surfaces 99 families, 9 recurring across topics. Direction similarity to the ruler predicts an independent sentiment estimate only weakly (r=0.243r=0.243). Polarity is better treated as a property of a topic's representational geometry, with a measurable rank and a per-axis depth, than as one universal scalar.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. SemEval-2026 Task 3: Dimensional Aspect-Based Sentiment Analysis (DimABSA)

    Apr 8, 2026Liang-Chih Yu, Jonas Becker, Shamsuddeen Hassan Muhammad +14Sentiment AnalysisAspect-Based Sentiment Analysis

  2. SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization

    Apr 8, 2026Usman Naseem, Robert Geislinger, Juan Ren +31Social Media AnalysisMultilingual Text Classification

  3. Usage-Modulated Sentiment Representations in Large Language Models

    Oct 4, 2026Hongfei Du, Jiacheng Shi, Yanfu Zhang +2Causal Interventions in Language ModelsRepresentation Geometry in Language Models