cs.CLNov 11, 2026

What Roles Do System Prompts Really Assign? Validating and Steering Occupational Role Vectors in LLMs

Authors: Jose L. Sampedro Mazon, Ilmi Yoon, Nadim Saad

Organizations: Khoury College of Computer Sciences, Northeastern University

Abstract

Applications built on large language models assign the model a role through its system prompt, intending to shape how it responds for their use case. We introduce a validation framework for extracting and injecting occupational role vectors, activation-level directions that capture how someone in a given occupational role would distinctively respond to a task or question. We validate these vectors through two complementary lenses, on Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct. The interpretability lens asks whether each vector is a stable, separable, domain-consistent representation of its role: extracted vectors are highly reproducible across repeated runs and sampling temperatures, remain separable even for very similar roles, and agree more with themselves across in-domain and out-of-domain questions than with other roles' signal. The control lens asks whether injecting a role vector during generation makes the model express the role, and sustain it over a conversation, as well as a role prompt does. On Qwen, injecting the vector alone makes the model express the intended role substantially more often than unsteered, but at best matches a role prompt; on both models, adding the vector to the prompt strengthens the role in single answers but did not slow the role's decline over 30 turns. Together, the two lenses show why both are needed: out of domain the role is expressed only subtly, yet the activations still encode it; and a vector that is stable and separable can still barely steer the model's behavior.

Figures & tables

Appendix figures & tables26 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Granularity Axis: A Micro-to-Macro Latent Direction for Social Roles in Language Models

    May 7, 2026Chonghan Qin, Xiachong Feng, Ziyun Song +3LLM InterpretabilityLanguage Model Probing

  2. Occupational Prompting Reveals Cultural Bias in Large Language Models

    May 19, 2026Maksim E. Eren, Andrea Brennen, Ryan C. Barron +1LLM PromptingSocial Bias in Language Models

  3. Cognitive Enhancement: Rethinking the Necessity of Role-Playing for Large Language Models

    Sep 30, 2026Xingjie Zhuang, Jialong Tang, Chulun Zhou +5LLM Prompting