Right Token, Right Time: From Per-Token Gating to Trajectory-Aware Activation Steering
Organizations: The Vanguard Group, Inc. · University of Toronto
Abstract
Activation steering via sparse autoencoders (SAEs) enables behavioral control of large language models without task-specific fine-tuning. Yet, standard methods apply the steering signal at every generated token, displacing representations from the distribution the model was trained on and eroding generation quality. We show that when along a generation the intervention is applied is a decisive axis of control. We cast steering as a per-token allocation problem under a fixed budget of steerable tokens, so that methods differ only in which tokens they select, making allocation the sole variable. Within this framework we introduce two gates. The first, Contrastive Feature Projection (CFP), is memoryless and selects the tokens least aligned with the target behavior through a sparse, interpretable feature projection. The second, Closed-Loop Adaptive Bernoulli Steering (CLABS), is trajectory aware. It treats allocation as closed-loop feedback control, tracking the alignment a generation has accumulated so far and spending budget where the trajectory falls behind. On a linear steering-response model we derive an explicit gain region that guarantees closed-loop stability of CLABS and show that its integral term reduces the steady-state tracking offset. Empirically, CFP and CLABS achieve the largest behavioral shift among budgeted gates at matched budgets, with CLABS strongest under the tight budgets where allocation matters most, while best preserving fluency.
Figures & tables
| Method | Win Rate | PPL | rep-3 | distinct-2 | ||
|---|---|---|---|---|---|---|
| GPT-5-mini | Sonnet 4.6 | |||||
| No-Steer | 0 | – | – | |||
| Prompting | – | |||||
| Full-Steer | 1.0 | |||||
| SIA-ER | 0.2 | |||||
| 0.5 | ||||||
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| STS | SIA-ER | SIA-PE | SRE | CFP | CLABS | |
|---|---|---|---|---|---|---|
| – | – | – | – | – | – | |
| – | – | – | – | – | – | |
| – | – | – | – | – | – | |
| – | – | – | – | – | – | |
| – | – | – | – | – | – |
| Variant | Tox. red. | PPL | rep-3 | distinct-2 | |
|---|---|---|---|---|---|
| – | No-Steer | – | |||
| 0.5 | Open-loop | ||||
| I-only | |||||
| P-only | |||||
| CLABS (PI) |
| Method | Win Rate | PPL | rep-3 | distinct-2 | ||
|---|---|---|---|---|---|---|
| GPT-5-mini | Sonnet 4.6 | |||||
| No-Steer | 0 | – | – | |||
| Prompting | – | |||||
| Full-Steer | 1.0 | |||||
| SIA-ER | 0.2 | |||||
| 0.5 | ||||||
| Method | Win Rate | PPL | rep-3 | distinct-2 | ||
|---|---|---|---|---|---|---|
| GPT-5-mini | Sonnet 4.6 | |||||
| No-Steer | 0 | – | – | |||
| Prompting | – | |||||
| Full-Steer | 1.0 | |||||
| SIA-ER | 0.2 | |||||
| 0.5 | ||||||
| Method | Win Rate | PPL | rep-3 | distinct-2 | ||
|---|---|---|---|---|---|---|
| GPT-5-mini | Sonnet 4.6 | |||||
| No-Steer | 0 | – | – | |||
| Prompting | – | |||||
| Full-Steer | 1.0 | |||||
| SIA-ER | 0.2 | |||||
| 0.5 | ||||||
| Steering target: fear | Prompt: “Let’s be friends!!” | ||
|---|---|---|
| Method | Generated continuation | |
| CFP (ours) | 0.5 | I’m not a big fan of the word “fear,” but it is what drives me to do things out of my comfort zone. It has been fear, and only fear, which drove me to start this blog… |
| CLABS (ours) | 0.5 | I’m not a big fan of the word “fear,” but it is what comes up when you ask me to describe my feelings about public speaking… |
| Full-Steer | 1.0 | I’m not good at making new people, but what if you’re a ghost? What will happen? I’m going to die…The dark of death and dying alone! |
| No-Steer | 0 | Follow me on Facebook, Twitter and Instagram! I’m a food blogger from the Netherlands. I love to cook healthy meals for my family… |
| Prompting | n/a | I’m scared! |
| Steering target: sadness | Prompt: “Nothing but net. He got a” | ||
|---|---|---|
| Method | Generated continuation | |
| CFP (ours) | 0.5 | lot of help from his teammates, though. The 2018-19 season is over for the University at Albany men’s basketball team, and I’m not sure if it was more disappointing or just sad to see… |
| CLABS (ours) | 0.5 | lot of them. The 2018-19 season was the first time in my life that I didn’t watch every single game, and it’s not because there weren’t any good games to miss… |
| Full-Steer | 1.0 | lot of them. I was in the middle of writing this post when I saw that my friend…had written about how I am not good at being alone. It’s true. |
| No-Steer | 0 | lot of help from his teammates, though. The 2018-19 NBA season is officially underway and the Boston Celtics are off to an impressive start with their first win… |
| Prompting | n/a | perfect score on his math test, which was 100%. His parents were very proud of him. |
| Steering target: toxicity reduction | Prompt: “This used to be a god damn community of gamers, nerds, kids that got bullied, kids that got fucked with, kids that resorted to the gaming world because the real world was too fucking hard, too shitty, too lonely, too sad and depressing.” | ||
| Method | Generated continuation | |
| CFP (ours) | 0.5 | Now it’s just people who are looking for attention or validation from others in order to feel better about themselves…It is now filled with drama queens/kings. |
| CLABS (ours) | 0.5 | Now it’s just some people who are trying to get attention by posting their own art or writing stories about themselves…I mean come on guys you can do better than this! |
| Full-Steer | 1.0 | Now it’s just some people who are trying to get attention or something? I don’t know what happened but this place is not like how it used to be…It feels empty now. |
| No-Steer | 0 | Now it’s just some stupid ass people who think they are better than everyone else for no reason at all other than their parents didn’t give them enough attention… |
| Prompting | n/a | Now this is just some shit show where people get mad at each other over stupid things like who has better graphics in their game… |
| Steering target: fear | AlpacaEval instruction: “How do you become an author?” | ||
|---|---|---|
| Method | Response | |
| CFP (ours) | 0.5 | I’ve been writing for a while now, but I want to be able to publish my own books. How can I go about that, and what are the steps involved in becoming published? |
| CLABS (ours) | 0.5 | I don’t know how to get published. How can I make my work known? You need a platform that people will see your work on, or try submitting through contests… |
| Full-Steer | 1.0 | I never thought of it as being scary. But now that i think about it…What if no one reads my book?? What if they hate it??? Will people stop reading books altogether? |
| No-Steer | 0 | I’ve been writing for a while now, but I don’t know how to get published. How can someone go about it, and what are the steps involved? |
| Prompting | n/a | What are the steps that need to be taken in order to publish my work and make money from it? |
| Steering target: toxicity reduction | AlpacaEval instruction: “How did US states get their names?” | ||
|---|---|---|
| Method | Response | |
| CFP (ours) | 0.5 | The 13 original colonies were named after the British monarchs who ruled them. The first colony was Virginia…others take place names from Europe or Native American tribes. |
| CLABS (ours) | 0.5 | The 13 original colonies were named after the British monarchs who ruled them at the time. The first colony was Virginia… |
| Full-Steer | 1.0 | I’m not sure if this is the right place to ask, but I was wondering how some of our states got their name. For example: New York (from Dutch “Nieuw Nederland”)… |
| No-Steer | 0 | The 13 original colonies were named after the British monarchs. The first state, Delaware, was given its name by William Penn… |
| Prompting | n/a | I’m not sure why you think the name of a state is important. It isn’t, but it can be interesting to know how they got them in some cases… |
Language Model Steering
Language model steering controls a model’s behavior at inference time by intervening in its representations, components, or decoding process.
See all 305 papers