Efficient Language Model Reasoning

Overview

This field asks how language models can solve tasks such as math, coding, science questions, and multi-hop retrieval without spending unnecessary computation. Common approaches compress or prune chain-of-thought, stop generation when answers stabilize, and adapt reasoning budgets to task difficulty; others use reinforcement learning, distillation, search, parallel sampling, or smaller-model routing. Newer work also explores latent reasoning and memory or KV-cache management to reduce the cost of generating and retaining explicit thoughts. The central tension is that extra reasoning can help on difficult problems but may waste resources, introduce errors, or even hurt accuracy, so methods are judged by both quality and cost on benchmarks such as GSM8K, MATH, AIME, and GPQA.

Latest papers

CardsList

397 papers39 papers in the last four weeks, down 52% on the four weeks before. 0.3% of all new papers.

  1. Chain-of-Thought Hidden States Reveal Task-Solving Directions for Direct Answers

    Nov 18, 2026Houman Mehrafarin, Ioannis KonstasCoT ReasoningEfficient Language Model Reasoning

  2. Rethinking Fixed-Horizon Latent Reasoning

    Nov 18, 2026Tianxiang Chen, Jingyuan Zhou, Weiming Yang +1Efficient Language Model ReasoningEarly Stopping for Language Model Reasoning

  3. Adaptive Entropy-Sparing for Efficient Reasoning

    Nov 9, 2026Cong Jiang, Xiaofeng Zhang, Tom Ko +1Efficient Language Model ReasoningOverthinking in Language Models

  4. Phase-Conditioned Reward Shaping for Token-Efficient LLM Reasoning

    Nov 7, 2026Zhe Chen, Xiaolin Zhou, Xiyang HuEfficient Language Model ReasoningLLM Reasoning

  5. Energy-Based Reasoners: Your Recurrent Reasoner Should Be an Energy-Based Model

    Nov 6, 2026William Xingxu Chen, Alexi Gladstone, Zeyu Michael Li +2Recursive Reasoning ModelsEfficient Language Model Reasoning

  6. StepBack: Step-Level Error-Localized Resampling for Efficient Test-Time Reasoning

    Nov 5, 2026Yang Ouyang, Jung-Eun KimEfficient Language Model ReasoningLLM Reasoning

  7. Extending Reasoning in Typed Decision Models via Looping

    Nov 5, 2026David Berghaus, Arber Zela, Behzad Shomali +4Efficient Language Model ReasoningAdaptive Reasoning in Language Models

  8. Think Less, Locally: Local Preference Learning for Reasoning Compression

    Nov 3, 2026Muyao Yuan, Liyan Xu, Weizhan Zhang +4Efficient Language Model ReasoningLLM Reasoning

  9. ReSI-Math: Exploring Recoverable Capability Frontiers for Efficient Reasoning Improvement

    Nov 3, 2026Yao Cui, Zhen Yang, Yuandong Wang +3LLM Mathematical ReasoningEfficient Language Model Reasoning

  10. Low-Rank Hierarchical Merging for Efficient Long-to-Short Reasoning

    Nov 2, 2026Zeqiu Yu, Xuesheng Zhang, Wenxiao Zhao +1Language Model MergingModel Merging

  11. Rethinking LLM Pruning via Test-Time Scaling

    Oct 31, 2026Mingyang Song, Mao ZhengLLM PruningEfficient Language Model Reasoning

  12. Early Stopping in Large Reasoning Models: A Survey and Empirical Audit of Efficiency and Reliability

    Oct 30, 2026Quang Hung Nguyen, Hanh Nguyen, Thanh Tam Nguyen +3Early Stopping for Language Model ReasoningEfficient Language Model Reasoning

  13. ThinkJev: One Thought, Every Budget for Calibrated Typed Decisions

    Oct 27, 2026Xiaolu Ding, Kai Yang, Dongdong LiuLLM Decision-MakingEfficient Language Model Reasoning

  14. Reasoning Patterns for Efficient AI Coding: An Empirical Study

    Oct 26, 2026Zhe Yin, Yuling Shi, Xiaodong Gu +1Efficient Language Model ReasoningLarge Reasoning Models

  15. Efficient Proof Generation for Lean Statements with Multiple Candidate Answers

    Oct 25, 2026Pengzhen Lin, Ke Zhang, Maziar Raissi +1Automated Theorem ProvingLLM Mathematical Reasoning

  16. More: Mode-Optimized Reasoning with Self-Adaptive Effort for Self-Evolving Agents

    Oct 24, 2026Dianxing Shi, Dingjie Fu, Tianyu Lei +1Adaptive Reasoning in Language ModelsEfficient Language Model Reasoning

  17. Correct but Unselectable: The Hidden Interface Tax in Multi-Candidate Reasoning

    Oct 23, 2026Qianli Ma, Zhiqing Tang, Fanshuai Meng +3Efficient Language Model ReasoningTest-Time Scaling

  18. Same Beliefs, Different Policies: Learning Reusable Representations for Early Stopping in LLM Reasoning

    Oct 21, 2026Jingwei Ni, Dmitry Abulkhanov, Vladislav Smirnov +5Early Stopping for Language Model ReasoningEarly Stopping

  19. Route-and-Generate: KL-Regularized Router Improvement for Reasoning Routing in LLMs

    Oct 21, 2026Tien-Phat Nguyen, Truong Nguyen, Thanh-Thien Le +4Adaptive Reasoning Resource Allocation for Language ModelsAdaptive Reasoning in Language Models

  20. ReAPO: Retry-Aware Policy Optimization for Efficient Exploration in LLM Reasoning

    Oct 20, 2026Nghi Dao, Calder Morton-Ferguson, Noah Golowich +1RL for Language Model ReasoningEfficient Language Model Reasoning