Efficient Language Model Reasoning

Follow this topic Ask about this topic

Momentum

23 papers in the last four weeks, up 188% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 166

All topics

When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation
Oct 8, 2026Yiruo Cheng, Shen Huang, Xiaoshuai Song +5Agentic Reasoning Efficient Language Model Reasoning
Gaoling School of Artificial Intelligence, Renmin University of China · Alibaba Token Hub, Alibaba Group
Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals
Oct 8, 2026Pengxiang Li, Dilxat Muhtar, Di He +3Recurrent Transformers Attention Residual Connections
The Hong Kong Polytechnic University · Independent Researcher · Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences +6
From Chain-of-Thought to Loops: Non-Autoregressive Latent Reasoning via Looped Transformers
Oct 8, 2026Gerard Grau García, Arnau Padrés Masdemont, Niccolò Grillo +3Efficient Language Model Reasoning Continuous Latent Reasoning
Qualcomm AI Research · MIT · University of Cambridge +1
YANchor-4B: Effective Long-Horizon Reasoning in O(N) Time with O(1) Memory
Oct 7, 2026Huishan Ji, Hua Xu, Weiming Zhang +1Efficient Language Model Reasoning Memory-Augmented Language Models
Rocore Matrix
BoT-GRPO: Efficient Process-Reward RL for Reasoning via Bag-of-Token Aggregation
Oct 7, 2026Yingxiang Yang, Weihang Xiao, Zhunxuan Wang +2RL for Language Model Reasoning Group Relative Policy Optimization
Amazon AGI · Virginia Tech
Efficient Reasoning with Flow Language Models
Oct 7, 2026Hanru Bai, Faissal Izermine, Oscar Davis +1Efficient Language Model Reasoning Language Modeling
Max Planck Institute for Intelligent Systems · ETH Zurich · ELLIS Institute Tübingen +3
The Dichotomy Between Pattern Recognition and Step-by-Step Reasoning
Oct 6, 2026Amrut Nadgir, Pratik Chaudhari, Vijay BalasubramanianLLM Reasoning Efficient Language Model Reasoning
University of Pennsylvania
ThinkFuse: Trajectory-Aware Test-Time Fusion for Small Reasoning Models
Oct 6, 2026Myunghoon Kang, Jungseob Lee, Jaehyung Seo +1Efficient Language Model Reasoning LLM Reasoning
Department of Computer Science and Engineering, Korea University · Department of Computer Science and Engineering, Konkuk University · Human-inspired AI Research
SanSi: A Looped Typed Decision Model for System 1.5 Thinking
Oct 6, 2026Shuyu Gan, Young-Jun Lee, Dongyeop KangEfficient Language Model Reasoning Implicit Reasoning in Language Models
University of Minnesota
COMPASS: Finding Where Reasoning Lives in Language Models
Oct 5, 2026Pratyay Dutta, Kowshik Thopalli, Vivek NarayanaswamyEfficient Language Model Reasoning Activation Steering
University of California, Riverside, CA 92521. Work performed during a summer internship at Lawrence Livermore National Laboratory · Lawrence Livermore National Laboratory, Livermore, CA 94550.
CALR: Continuous Anchored Latent Reasoning via Render-of-Thought Compression
Oct 5, 2026Zhaoyang Wei, Bowen Jiang, Yanchao Hao +5Efficient Language Model Reasoning Latent Visual Reasoning
University of the Chinese Academy of Sciences · Tencent
Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution
Oct 5, 2026Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi +4Numerical Reasoning in Language Models Efficient Language Model Reasoning
University of Southern California, Los Angeles, USA · Intel AI, USA
What Matters for Latent Reasoning with Flow Matching
Oct 5, 2026Yassine Ouali, Adrian Bulat, Georgios TzimiropoulosFlow Matching Efficient Language Model Reasoning
Samsung AI Cambridge · Technical University of Iasi · Queen Mary University of London
Test-Time Adaptation of Reasoning Strategies with Bayesian Nonparametric Memory
Oct 5, 2026Keshav Ramji, Tahira Naseem, Ramón Fernandez AstudilloMemory-Augmented Language Models Bayesian Mixture Models
IBM Research AI
Quantifying the Stability of Multi-Step Reasoning via Error Amplification
Oct 5, 2026Dongyue Li, Ziniu Zhang, Minxuan Duan +1Efficient Language Model Reasoning CoT Compression
Northeastern University Boston, MA
Can Language Models Learn to Reject Their Own Bad Reasoning Steps?
Oct 5, 2026Siheng Xiong, Xiaoze Liu, Yiqiao Jin +2LLM Self-Correction Language Model Decoding
Georgia Institute of Technology · Purdue University
Expanding LLM Reasoning
Oct 4, 2026Rian Atri, Evan LuoLLM Inference Efficiency Inference-Time Scaling
Keiji AI · University of California, Berkeley
AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models
Oct 1, 2026Yuxiang Wang, Kunyu Feng, Yuancheng Wang +12RL for Language Model Reasoning Audio Reasoning
The Chinese University of Hong Kong, Shenzhen · Tencent Hunyuan · Tsinghua University +2
Learning to Ask: Information Acquisition for SLM-LLM Collaboration, under a budget
Oct 1, 2026Yongjun Kim, Xiaoxiao Li, Jaeho LeeRL for Language Model Reasoning Efficient Language Model Reasoning
Pohang University of Science and Technology (POSTECH) · Department of Electrical and Computer Engineering, University of British Columbia · Vector Institute
ReSolve: Reusing Candidate Reasoning through Selective Generative Moderation
Oct 1, 2026Bangji Yang, Jiajun Fan, Hongba Ma +6Efficient Language Model Reasoning Inference-Time Compute Allocation
University of Illinois at Urbana-Champaign · Tsinghua University · Rutgers University +2
Interpreting Reasoning of Large Language Models via Partial Information Decomposition
Sep 30, 2026Barproda Halder, Qiuyi Zhang, Sanghamitra DuttaLLM Interpretability Efficient Language Model Reasoning
University of Maryland, College Park · Elorian AI
LongHarness Bench: Stress-Testing Language Model Harnesses for Long-Context Reasoning
Sep 29, 2026Quang Hieu Pham, Thuy Duong Nguyen, Jocelyn Qiaochu Chen +1Long-Context Language Model Evaluation Long-Context Language Model Inference
University of Alberta · Alberta Machine Intelligence Institute (Amii)
HARISSA: Inference-Time Self-Checks for Efficient and Safe Local Language Model Deployment
Sep 29, 2026Kenan Alkiek, Moontae Lee, David Jurgens +1On-Device Language Model Inference Selective Prediction
School of Information University of Michigan Ann Arbor, MI 48109, USA · SNU-LG AI Research Center Seoul, South Korea
$S^3$ : Spectral Null-Space Swap Makes Reasoning Models Efficient
Sep 29, 2026Hongbo Ma, Sansheng Cao, Jiajun Fan +2Efficient Language Model Reasoning Model Merging
University of Illinois Urbana-Champaign · Tsinghua University · Dartmouth College +1
MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller
Sep 29, 2026Zhibin Wen, Tao Han, Lei Bai +2RL for Language Model Reasoning Efficient Language Model Reasoning
Southern University of Science and Technology · The Hong Kong University of Science and Technology · Shanghai Artificial Intelligence Laboratory +1
Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
Sep 28, 2026Chanuk Lee, Minki Kang, Sangwoo Park +3Cost-Aware Inference Efficient Language Model Reasoning
KAIST
Efficient Reasoning via Constrained Optimization in Latent Space
Sep 28, 2026Zhinan Hou, Xingchen Li, Keyou YouOverthinking in Language Models Efficient Language Model Reasoning
Tsinghua University
On the Token Value Inequality in Efficient Reasoning
Sep 27, 2026Runjia Zeng, Hang Hua, Yiyang Liu +5RL for Language Model Reasoning Efficient Language Model Reasoning
Rochester Institute of Technology · Purdue University · MIT-IBM Watson AI Lab +3
CounterRoute: Self-Routed Reasoning via Hierarchical Counterfactual Credit Assignment
Sep 24, 2026Ruochen Jiao, Besnik Fetahu, Zhenyu Shi +1RL for Language Model Reasoning Efficient Language Model Reasoning
Towards Efficient Reasoning: Learning Causal Shortcuts for Diffusion Language Models
Sep 23, 2026Dian Jin, Kairong Han, Baohong Li +5Efficient Language Model Reasoning Diffusion Language Models
Zhejiang University · Shanghai AI Laboratory

Oct 8, 2026, cs.AIJ/K move · Enter open · S save

When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation

Yiruo Cheng, Shen Huang, Xiaoshuai Song, Jiejun Tan+4

Gaoling School of Artificial Intelligence, Renmin University of China · Alibaba Token Hub, Alibaba Group

Agentic Reasoning Efficient Language Model Reasoning

Open paper AskPDF arXiv

Large language model (LLM)-based agents have demonstrated strong capabilities on complex tasks. They typically perform reasoning before each action throughout an interaction trajectory. However, reasoning may not be necessary at every turn, as reasoning produced earlier can continue to support subsequent actions. A key challenge is therefore to determine when existing reasoning remains sufficient and when a new reasoning step is needed, without relying on costly generation-based verification. We find that decreases in the likelihood of subsequent reference actions after removing additional reasoning closely track whether those actions remain recoverable given earlier reasoning, providing an effective and lightweight signal for estimating cross-turn action support. Based on this observation, we propose Reasoning Adaptation through Cross-Turn Estimation (RACE), a training approach for adaptive agent reasoning. RACE introduces a Likelihood-Guided Progressive Reasoning Cover Detection (LoGiC) procedure that progressively identifies reasoning turns whose removal has limited impact on the current and subsequent reference actions. The resulting removal signals are incorporated into both supervised fine-tuning and agentic reinforcement learning, enabling the policy to learn when to reason and when to act directly. Extensive experiments on four representative agent benchmarks show that RACE substantially reduces reasoning cost while maintaining or improving task performance.

Momentum

Related topics

Latest papers 166