Continuous Latent Reasoning

Overview

Continuous latent reasoning asks whether language and multimodal models can solve problems by updating internal representations rather than generating a word-by-word chain of thought, potentially reducing latency and token use. Approaches include recurrent or looped latent rollouts, learned latent prefixes, flow- and diffusion-based trajectories, reinforcement learning, and adaptive rules for how long to think. These methods are tested on arithmetic, Sudoku and maze planning, code generation, visual reasoning, audio tasks, and tool-using agents, with reported gains in efficiency and sometimes accuracy over explicit reasoning. A central open tension is whether compact latent states faithfully support the answer: accuracy alone does not establish this, and causal analyses find shortcut behavior while robustness, supervision, and reliable decoding remain challenges.

Latest papers

CardsList

88 papers10 papers in the last four weeks, down 57% on the four weeks before. 0.1% of all new papers.

  1. Rethinking Fixed-Horizon Latent Reasoning

    Nov 18, 2026Tianxiang Chen, Jingyuan Zhou, Weiming Yang +1Efficient Language Model ReasoningEarly Stopping for Language Model Reasoning

  2. Energy-Based Reasoners: Your Recurrent Reasoner Should Be an Energy-Based Model

    Nov 6, 2026William Xingxu Chen, Alexi Gladstone, Zeyu Michael Li +2Recursive Reasoning ModelsEfficient Language Model Reasoning

  3. Learning When to Think Aloud in Latent Reasoning

    Nov 4, 2026Zhehao Zhou, Tongrui Su, Shengyu Zhu +4Adaptive Reasoning in Language ModelsLatent CoT Reasoning

  4. Latent Reasoning in Continuous Space for Unified Multimodal Models

    Oct 30, 2026Byungwoo Jeon, Yoonwoo Jeong, Hyunseok Lee +2Continuous Latent ReasoningUnified Multimodal Models

  5. ToM2Vec: Continuous Theory-of-Mind Tokens for Multi-Agent Coordination

    Oct 21, 2026Nithin Sivakumaran, Ali Payani, Hyunji Lee +2Multi-Agent CoordinationTheory of Mind

  6. Sparse RL Relaxation for LLM Reasoning

    Oct 19, 2026Jiabin Fan, Matthias Lindemann, Zita Marinho +2CoT ReasoningRL for Language Model Reasoning

  7. Sep-Latent: Separator Tokens as Natural Compression Anchors for Implicit Reasoning

    Oct 16, 2026Yinlong Xu, Jianfeng Huang, Zhengdong Zhou +5Efficient Language Model ReasoningImplicit Reasoning in Language Models

  8. ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions

    Oct 14, 2026Tianyi Gao, Han Fang, Xin Wei +11Referring Expression ComprehensionVision-Language Grounding

  9. Rationale Distribution Distillation via Flow Matching for Distributional Continuous Latent Reasoning

    Oct 14, 2026Mingyeong Kim, Gyusang Cho, Juho Lee +1LLM ReasoningContinuous Latent Reasoning

  10. INTACT: Inducing Latent Reasoning on a Frozen Backbone

    Oct 14, 2026Kutay Tire, Atula Tejaswi, Haris Vikalo +1Efficient Language Model ReasoningImplicit Reasoning in Language Models

  11. Hybrid Reasoning Agents

    Oct 13, 2026Jiaru Zou, Yunzhe Qi, Sirui Chen +5LLM AgentsLLM Agent Training

  12. Input-Conditioned Search for Efficient Test-Time Scaling of Recursive Reasoners

    Oct 13, 2026Haochen Shi, Tianwen Fu, Qianggang Ding +7Inference-Time SearchInference-Time Scaling

  13. Efficient Safety Guardrails through Latent Dual-Hypothesis Reasoning with On-Demand Trace Reconstruction

    Oct 13, 2026Md Asiful Islam, Fahmida Alam, Mihai SurdeanuLLM GuardrailsLLM Safety

  14. Looped Reasoning Finishes Earlier Than You Think

    Oct 13, 2026Sumin Park, T. Konstantin RuschNeural Algorithmic ReasoningContinuous Latent Reasoning

  15. Dynamic K-Head: Difficulty-Supervised Budget Selection for Continuous Latent Reasoning

    Oct 13, 2026Ying Li, Yuqi Chen, Sixuan Li +1Efficient Language Model ReasoningInference-Time Compute Allocation

  16. Recompose and Refine Latent Reasoning Flows for Vision-Language-Action Models

    Oct 8, 2026Hongyu Shi, Sen Zhao, Zuyu Zhang +5Vision-Language-Action ModelsVLMs for Robotics

  17. From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped Transformers

    Oct 8, 2026Gerard Grau García, Arnau Padrés Masdemont, Niccolò Grillo +3Efficient Language Model ReasoningContinuous Latent Reasoning

  18. Lapras: Latent Reasoning for Time Series Language Models

    Oct 8, 2026Yuliang Chen, Yu Yvonne Wu, Patrick Langer +11Time Series Language ModelingTemporal Reasoning in Language Models

  19. Invariant-Measure Reasoners: Stable Representations for Latent Reasoning

    Oct 7, 2026Yuto Inui, Takuya Konishi, Yoshinobu KawaharaLatent ReasoningContinuous Latent Reasoning

  20. Judging in Latent Space: Efficient Generative Reward Modeling via Semantics-Preserving Compression

    Oct 7, 2026Mingqing Yuan, Xiaobo Liang, Junwei Yang +5Reward ModelingLLM-as-a-Judge

  21. Unrolled Flow Models for Reasoning

    Oct 7, 2026Faissal Izermine, Hanru Bai, Oscar Davis +1Flow-Based Generative ModelingFlow Matching

  22. Spatial Latent Reasoning for Embodied Reference Understanding

    Oct 7, 2026Ling Li, Jianhui Zhong, Wei Liu +3Vision-Language GroundingContinuous Latent Reasoning

  23. Efficient Reasoning with Flow Language Models

    Oct 7, 2026Hanru Bai, Faissal Izermine, Oscar Davis +1Efficient Language Model ReasoningLanguage Modeling

  24. CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression

    Oct 5, 2026Zhaoyang Wei, Bowen Jiang, Yanchao Hao +5Efficient Language Model ReasoningLatent Visual Reasoning

  25. What Matters for Latent Reasoning with Flow Matching

    Oct 5, 2026Yassine Ouali, Adrian Bulat, Georgios TzimiropoulosFlow MatchingEfficient Language Model Reasoning