cs.CLApr 11, 2026

Nationality encoding in language model hidden states: Probing culturally differentiated representations in persona-conditioned academic text

Authors: Paul Jackson, Ruizhe Li, Elspeth Edelstein

Organizations: Language Centre, School of Language, Literature, Music and Visual Culture, University of Aberdeen, United Kingdom · Language Centre, School of Language, Literature, Music and Visual Culture, University of Aberdeen, Aberdeen AB24 3FX, United Kingdom. · School of Natural and Computing Sciences, University of Aberdeen, United Kingdom · School of Natural and Computing Sciences, University of Aberdeen, Aberdeen AB24 3FX, United Kingdom. · 

Abstract

Large language models are increasingly used as writing tools and pedagogical resources in English for Academic Purposes, but it remains unclear whether they encode culturally differentiated representations when generating academic text. This study tests whether Gemma-3-4b-it encodes nationality-discriminative information in hidden states when generating research article introductions conditioned by British and Chinese academic personas. A corpus of 270 texts was generated from 45 prompt templates crossed with six persona conditions in a 2 x 3 design. Logistic regression probes were trained on hidden-state activations across all 35 layers, with shuffled-label baselines, a surface-text skyline classifier, cross-family tests, and sentence-level baselines used as controls. Probe-selected token positions were annotated for structural, lexical, and stance features using the Stanza NLP pipeline. The nationality probe reached 0.968 cross-validated accuracy at Layer 18, with perfect held-out classification. Nationality encoding followed a non-monotonic trajectory across layers, with structural effects strongest in the middle to upper network and lexical-domain effects peaking earlier. At high-signal token positions, British-associated patterns showed more postmodification, hedging, boosting, passive voice, and evaluative or process-oriented vocabulary, while Chinese-associated patterns showed more premodification, nominal predicates, and sociocultural or internationalisation vocabulary. However, sentence-level analysis found no significant nationality differences in the full generated surface text. The findings extend probing methodology to a sociolinguistic attribute and have practical implications for EAP and language pedagogy.

Explore similar work

CardsList
  1. Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders

    Jul 23, 2026Pablo Santiago Potes Velasco, María del Mar García Matabanchoy, Óscar Julián Pérez Ladino +3LLM InterpretabilityCultural Bias in Language Models

  2. When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Models

    Feb 25, 2026Satyam Kumar Navneet, Joydeep Chandra, Yong ZhangLinguistic Bias in Language ModelsCultural Bias in Language Models

  3. Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV

    Sep 28, 2026Bushra Asseri, Abdulaziz AsseriMultilingual Language Model EvaluationCross-Cultural Language Model Evaluation