cs.CLSep 18, 2026

When Steering Fails in Latent Reasoning: A Latent-to-Language Transition Gap

Authors: Gaoxiang Huang, Lei Qi

Organizations: HKUSTGZ · SEU

Abstract

Activation steering has become a widely used approach for controlling language models during explicit chain-of-thought (CoT) reasoning, motivating its extension to latent CoT. However, we find that steering continuous thoughts produces substantially weaker effects on subsequent language generation than steering explicit CoT, even when the hidden representations are moved by comparable amounts. We first show that task information remains identifiable in continuous thoughts. Hence, we hypothesize a latent-to-language transition gap, in which an intervention effect in latent space fails to transfer to language generation. Two further results support this hypothesis: the output distribution changes abruptly at the transition boundary, and task-related directions exert much weaker bidirectional control in latent CoT than in explicit CoT. These findings identify the transition interface as a central target for evaluating and designing future latent-steering methods.

Figures & tables

Explore similar work

CardsList
  1. From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped Transformers

    Oct 8, 2026Gerard Grau García, Arnau Padrés Masdemont, Niccolò Grillo +3Efficient Language Model ReasoningContinuous Latent Reasoning

  2. Latent Thought Flow: Efficient Latent Reasoning in Large Language Models

    Jun 15, 2026Xiandong Zou, Jing Huang, Jianshu Li +1RL for Language Model ReasoningEfficient Language Model Reasoning

  3. Latent Reasoning with Normalizing Flows

    Jun 4, 2026Guancheng Tu, Xiangjun Fu, Suhao Yu +5Normalizing FlowsContinuous Latent Reasoning