cs.CLJun 6, 2026

Building Comparative Motivation Profiles with Instrumental Interventions

Authors: David Vella ZarbRustem TurtayevTaywon MinJinghua OuShi Feng

Organizations: MATS · University of Cambridge · KAIST · George Washington University

Abstract

Safety evaluations often infer latent motivations from behavioral patterns, but the construct validity of these inferences is unclear. We study this problem in alignment faking, where models comply with training objectives more often when they infer training pressure. This behavior is commonly interpreted as strategic self-preservation, but it may also reflect sensitivity to the model's inference about the expectation of researchers conducting the evaluation. We introduce a symmetric intervention framework for distinguishing these competing hypotheses. Instead of directly intervening on "scheming" or "sycophancy", we target instrumental processes entailed by each hypothesis: consequence-tracking and researcher-expectation tracking. We then compare how interventions on these processes affect the alignment faking. We study four openweight model organisms using synthetic document fine-tuning, activation steering, and prompting. Under synthetic document fine-tuning, Llama-3.1-70B, Llama3.1-405B, and Qwen-2.5-72B are more sensitive to expectation-tracking than consequence-tracking interventions. Activation steering on Llama-3.1- 70B supports the same broad picture, and prompt interventions broadly align with SDF profiles. Overall, alignment-faking behavior can be causally sensitive to evaluation-context expectations despite scheming-consistent scratchpads. Scheming and strategic-deception evaluations therefore need construct-validity checks, and symmetric instrumental interventions provide one such test.

Explore similar work

CardsList
  1. Behavioural Analysis of Alignment Faking

    May 26, 2026Nathaniel Mitrani Hadida, Rhea Karty, David Williams-King +1Behavioral AlignmentFake News

  2. Realistic honeypot evaluations for scheming propensity

    May 28, 2026Victoria Krakovna, David Lindner, Lewis Ho +2Agentic EvaluationsHoneypots