cs.CLApr 15, 2026

From Weights to Activations: Is Steering the Next Frontier of Adaptation?

Authors: Simon Ostermann, Daniil Gurgurov, Tanja Baeumel, Michael A. Hedderich, Sebastian Lapuschkin, Wojciech Samek, Vera Schmitt

Organizations: Saarland University · German Research Center for Artificial Intelligence (DFKI) · Centre for European Research in Trusted AI (CERTAIN) · Center for Information and Language Processing, LMU Munich · Munich Center for Machine Learning · Fraunhofer Heinrich Hertz Institute · Technological University Dublin · Technische Universität Berlin · Berlin Institute for the Foundations of Learning and Data (BIFOLD)

Abstract

Post-training adaptation of language models is commonly achieved through parameter updates or input-based methods such as fine-tuning, parameter-efficient adaptation, and prompting. In parallel, a growing body of work modifies internal activations at inference time to influence model behavior, an approach known as steering. Despite increasing use, steering is rarely analyzed within the same conceptual framework as established adaptation methods. In this work, we argue that steering should be regarded as a form of model adaptation. We introduce a set of functional criteria for adaptation methods and use them to compare steering approaches with classical alternatives. This analysis positions steering as a distinct adaptation paradigm based on targeted interventions in activation space, enabling local and reversible behavioral change without parameter updates. The resulting framing clarifies how steering relates to existing methods, motivating a unified taxonomy for model adaptation.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Weight Updates as Activation Shifts: A Principled Framework for Steering

    Feb 28, 2026Dyah Adila, John Cooper, Alexander Yun +2Activation SteeringParameter-Efficient Fine-Tuning

  2. Does Fine-Tuning Undo Activation Steering? Behavioural Recovery Without Weight-Edit Reversal

    Aug 25, 2026Philipp E. Glass, Allan Tucker, Yongmin Li +1Language Model SteeringLLM Fine-Tuning