LLM Reasoning Strategies

Follow this topic Ask about this topic

Momentum

75 papers in the last four weeks, up 108% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 797

All topics

Learning When to Sample: Confidence-Aware Selective Sampling for Efficient Chain-of-Thought Reasoning
Mar 9, 2026Juming Xiong, Kevin Guo, Congning Ni +7LLM Reasoning Strategies Chain-of-Thought Reasoning
1Vanderbilt University · 2Vanderbilt University Medical Center · 3Intuit AI Research
Step-Level Sparse Autoencoder for Reasoning Process Interpretation
Mar 3, 2026Xuan Yang, Jiayu Liu, Yuhang Lai +3LLM Reasoning Strategies Improving Sparse Autoencoders
Department of Data Science, City University of Hong Kong · Hong Kong Institute of AI for Science, City University of Hong Kong · Li Auto Inc +1
HEARTS: Benchmarking LLM Reasoning on Health Time Series
Feb 25, 2026Sirui Li, Shuhan Xiao, Mihir Joshi +4Clinical Reasoning Training Large Language Model Benchmarks
University of California, Los Angeles, 2Google Research · 2Google Research
Tool Use Reduces Depth-Induced Collapse in OOD Reasoning
Feb 24, 2026David Koplow, Tomer Galanti, Tomaso PoggioLLM Reasoning Strategies Out-Of-Distribution
Massachusetts Institute of Technology · Texas A&M University
CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching
Feb 23, 2026Yuzhe Wang, Yaochen Zhu, Jundong LiCausal Reasoning LLM Reasoning Strategies
University of Virginia Charlottesville, Virginia, USA
Ontology-Guided Neuro-Symbolic Inference: Grounding Language Models with Mathematical Domain Knowledge
Feb 19, 2026Marcelo LabreNeuro-Symbolic Framework LLM Reasoning Strategies
Advanced Institute for Artificial Intelligence (AI2)
FloCA: Towards Faithful and Logically Consistent Flowchart Reasoning
Feb 15, 2026Jinzi Zou, Bolin Wang, Shuo Zhang +2Reasoning Graphs LLM Reasoning Strategies
MoE KLINNS Lab, Xi’an Jiaotong University, Xi’an 710049, P. R. China · China Mobile Group Shaanxi Co., Ltd.
Think Deep, Not Just Long: Measuring LLM Reasoning Effort via Deep-Thinking Tokens
Feb 13, 2026Wei-Lin Chen, Liqian Peng, Tian Tan +5LLM Reasoning Strategies Large Reasoning Models
University of Virginia · Google
To Mix or To Merge: Toward Multi-Domain Reinforcement Learning for Large Language Models
Feb 13, 2026Haoqing Wang, Xiang Long, Ziheng Li +3Reinforcement Learning With Verifiable Reward LLM Reasoning Strategies
Samsung Research, Beijing, China · Peking University
Neuro-Symbolic Synergy for World Modeling
Feb 11, 2026Hongyu Zhao, Siyu Zhou, Haolin Yang +2Neuro-Symbolic Framework LLM Reasoning Strategies
Department of Computer Science University of Maryland College Park, MD 20742, USA · Faculty of Engineering and IT Australian AI Institute University of Technology Sydney Sydney, Australia · Department of Statistics University of Chicago Chicago, IL 60637, USA +2
Reward Modeling for Reinforcement Learning-Based LLM Reasoning: Design, Challenges, and Evaluation
Feb 10, 2026Pei-Chi Pan, Yingbin Liang, Sen LinLLM Reasoning Strategies
Department of Computer Science University of Houston · The Ohio State University · University of Houston
rePIRL: Learn PRM with Inverse RL for LLM Reasoning
Feb 8, 2026Xian Wu, Kaijie Zhu, Ying Zhang +2Process Reward Model Large Language Model Reinforcement Learning
Meta AI · Department of Computer Science, University of California, Santa Barbara · Independent Researcher +1
IESR:Efficient MCTS-Based Modular Reasoning for Text-to-SQL with Large Language Models
Feb 5, 2026Tao Liu, Jiafan Lu, Bohan Yu +11Text-To-Sql LLM Reasoning Strategies
Zhengzhou University · Tianjin University · Zhongshan University
CoT is Not the Chain of Truth: An Empirical Internal Analysis of Reasoning LLMs for Fake News Generation
Feb 4, 2026Zhao Tong, Chunlin Gong, Yiping Zhang +5Large Language Model Safety LLM Reasoning Strategies
Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences · Shanghai AI Laboratory +3
Distilling LLM Reasoning into Graph of Concept Predictors
Feb 3, 2026Ziyang Yu, Liang ZhaoDataset Distillation LLM Reasoning Strategies
Department of Computer Science Emory University Atlanta, USA
Uncertainty Localization in LLM Reasoning via Embedding Perturbations
Feb 2, 2026Qihao Wen, Jiahao Wang, Yang Nan +3Large Language Model Uncertainty LLM Reasoning Strategies
University of Arizona · Michigan State University
Policy of Thoughts: Scaling Test-Time Training for LLM Reasoning via Online Policy Evolution
Jan 28, 2026Zhengbo Jiao, Hongyu Xian, Qinglong Wang +5LLM Reasoning Strategies Large Language Model Policy Optimization
Zhejiang University · South China Normal University · Shanghai University of Finance and Economics +2
Understanding LLM Failures: A Multi-Tape Turing Machine Analysis of Systematic Errors in Language Model Reasoning
Jan 27, 2026Magnus BomanLarge Language Models Fail LLM Reasoning Strategies
Karolinska Institutet, Stockholm, Sweden
LLMs versus the Halting Problem: Characterizing Program Termination Reasoning
Jan 26, 2026Oren Sultan, Jordi Armengol-Estape, Pascal Kesseli +4Formal Verification LLM Reasoning Strategies
1Meta FAIR · 3Bloomberg, New York, USA · 4Imperial College London, UK +2
A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
Jan 18, 2026Tianxin Wei, Ting-Wei Li, Zhining Liu +26Agentic Reasoning LLM Reasoning Strategies
University of Illinois Urbana-Champaign · Meta · UCSD +2
R $^2$ PO: Decoupling Rollout and Inference Policies for LLM Reasoning
Jan 17, 2026Jingchu Wang, Bingbing Xu, Yige Yuan +4LLM Reasoning Strategies Frictive Policy Optimization
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS · University of Chinese Academy of Sciences · National University of Singapore
Programming over Thinking: Efficient and Robust Multi-Constraint Planning
Jan 14, 2026Derrick Goh Xin Deik, Quanyu Long, Zhengyuan Liu +2Large Language Model Planning Classical Planning
Nanyang Technological University, Singapore · Agency for Science, Technology and Research (A*STAR), Singapore
Improving LLM Reasoning with Homophily-aware Structural and Semantic Text-Attributed Graph Compression
Jan 13, 2026Zijun Di, Bin Lu, Huquan Kang +5Text-Attributed Graph LLM Reasoning Strategies
Shanghai Jiao Tong University Shanghai, China
Triggering Chain-of-Thought via Latent Feature Interventions in Large Language Models
Jan 12, 2026Zhenghao He, Guangzhi Xiong, Bohan Liu +2LLM Reasoning Strategies Efficient Latent Reasoning
University of Virginia, USA
Do Language Models Reason Across Languages?
Jan 10, 2026Yan Meng, Wafaa Mohammed, Christof MonzMultilingual Language Models LLM Reasoning Strategies
Language Technology Lab · University of Amsterdam
Metaphors are a Source of Cross-Domain Misalignment of Large Reasoning Models
Jan 6, 2026Zhibo Hu, Chen Wang, Yanfeng Shu +2LLM Reasoning Strategies Large Reasoning Models
The University of New South Wales · CSIRO Data61
Alpha-R1: Alpha Screening with LLM Reasoning via Reinforcement Learning
Dec 29, 2025Zuoyou Jiang, Li Zhao, Rui Sun +6LLM Reasoning Strategies Screening
Shanghai Jiao Tong University Shanghai, China · FinStep, StepFun Shanghai, China · StepFun Shanghai, China
KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answering
Dec 10, 2025Xin Sun, Zhongqi Chen, Xing Zheng +6LLM Reasoning Strategies Knowledge Graphs
University of Science and Technology of China, Hefei, China · Independent · Institute of Automation, Chinese Academy of Sciences, Beijing, China.
Multilingual Medical Reasoning for Question Answering with Large Language Models
Dec 5, 2025Pietro Ferrazzi, Aitor Soroa, Rodrigo AgerriMultilingual Healthcare Q&A Clinical Reasoning Training
Fondazione Bruno Kessler, Trento, Italy · HiTZ Center - Ixa, University of the Basque Country EHU, Spain
ThreadWeaver: Adaptive Threading for Efficient Parallel Reasoning in Language Models
Nov 24, 2025Long Lian, Sida Wang, Felix Juefei-Xu +7LLM Reasoning Strategies Inference Latency
Meta Superintelligence Labs (MSL), Menlo Park, CA, United States · UC Berkeley, Berkeley, CA, United States · UCSF, San Francisco, CA, United States
A Neurosymbolic Approach to Natural Language Formalization and Verification
Nov 12, 2025Chenyang An, Sam Bayless, Stefano Buliani +27Formal Verification LLM Reasoning Strategies
Amazon Web Services · University College London · Queen Mary University of London +1
Evaluating Implicit Biases in LLM Reasoning through Logic Grid Puzzles
Nov 8, 2025Fatima Jahara, Mark Dredze, Sharon LevyLarge Language Model Bias LLM Reasoning Strategies
Rutgers University · Johns Hopkins University
Reinforcement Learning Improves Traversal of Parametric Knowledge in LLMs
Nov 8, 2025Renfei Zhang, Manasa Kaniselvan, Rylan Schaeffer abd Niloofar MireshghallahLLM Reasoning Strategies Factual Recall
Carnegie Mellon University · MIT · Stanford University
Multi-Step Knowledge Interaction Analysis via Rank-2 Subspace Disentanglement
Nov 3, 2025Sekh Mainul Islam, Pepa Atanasova, Isabelle AugensteinLLM Reasoning Strategies Contextual Grounding
University of Copenhagen
OpenSIR: Open-Ended Self-Improving Reasoner
Nov 1, 2025Wai-Chung Kwan, Joshua Ong Jun Leang, Pavlos Vougiouklis +3LLM Reasoning Strategies Self-Play
University of Edinburgh · Imperial College London · Huawei Technologies Research & Development (UK) Limited +1
Scaling Latent Reasoning via Looped Language Models
Oct 29, 2025Rui-Jie Zhu, Zixuan Wang, Kai Hua +30LLM Reasoning Strategies Efficient Latent Reasoning
1ByteDance Seed · 2UC Santa Cruz · 3Princeton University +8
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Oct 28, 2025Yihan Li, Xiyuan Fu, Ghanshyam Verma +2Hallucination Mitigation LLM Reasoning Strategies
Electronic Information School, Wuhan University, Wuhan, China · School of Computing, Dublin City University, Dublin, Ireland · School of Public Health, Wuhan University, Wuhan, China +2
RLIE: Rule Generation with Logistic Regression, Iterative Refinement, and Evaluation for Large Language Models
Oct 22, 2025Yang Yang, Hua XU, Zhangyi Hu +1LLM Reasoning Strategies Probabilistic Model
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511400, China · Institute of Deep Perception Technology, JITRI, Wuxi 214000, China
A Model Can Help Itself: Reward-Free Self-Training for LLM Reasoning
Oct 21, 2025Mengqi Li, Lei Zhao, Anthony Man-Cho So +2LLM Reasoning Strategies Mathematical Reasoning Benchmarks
The Chinese University of Hong Kong, Shenzhen · Shanghai Jiao Tong University · The Chinese University of Hong Kong
Demystifying Hybrid Thinking: Can LLMs Truly Switch Between Think and No-Think?
Oct 14, 2025Shouren Wang, Wang Yang, Xianxuan Long +4LLM Reasoning Strategies
Case Western Reserve University · Meta AI
Don't Tell the Answer, Truly Guide the Reasoning During RL Rollouts
Oct 10, 2025Xinyi Wang, Jinyi Han, Zishang Jiang +7LLM Reasoning Strategies Large Language Model Reinforcement Learning
School of Data Science, Fudan University · 2Shanghai Institute of Artificial Intelligence for Education, East China Normal University · College of Computer Science and Artificial Intelligence, Fudan University +1
Rethinking Reward Models for Multi-Domain Test-Time Scaling
Oct 1, 2025Dong Bok Lee, Seanie Lee, Sangwoo Park +12Process Reward Model LLM Reasoning Strategies
KAIST · TH Nürnberg · Microsoft Research Asia
Interactive Learning for LLM Reasoning
Sep 30, 2025Hehai Lin, Shilei Cao, Sudong Wang +5LLM Reasoning Strategies Interactive Learning
1The Hong Kong University of Science and Technology (Guangzhou) · 2Sun Yat-sen University · 4National University of Singapore +2
Reasoning or Rambling? Exploring the Effect of Thinking on Agent Persuasion
Sep 25, 2025Haodong Zhao, Jidong Li, Zhaomin Wu +4Persuasion LLM Reasoning Strategies
School of Computer Science, Shanghai Jiao Tong University · 2National University of Singapore · 3Inner Mongolia Research Institute, Shanghai Jiao Tong University
Predicting LLM Reasoning Performance with Small Proxy Model
Sep 25, 2025Woosung Koh, Juyoung Suk, Sungjun Han +2LLM Reasoning Strategies Bridge
Trillion Labs · KAIST AI · ▽Trillion Labs, ♠KAIST AI
Discovering New Theorems via LLMs with In-Context Proof Learning in Lean
Sep 16, 2025Kazumi Kasaura, Naoto Onda, Yuta Oriike +3Theorem Proving LLM Reasoning Strategies
OMRON SINIC X Corporation · RIKEN AIP · AutoRes +7
Vis-CoT: A Human-in-the-Loop Framework for Interactive Visualization and Intervention in LLM Chain-of-Thought Reasoning
Sep 1, 2025Kaviraj Pather, Elena Hadjigeorgiou, Arben Krasniqi +4LLM Reasoning Strategies Chain-of-Thought Reasoning
Department of Computer Science & Engineering University of Mauritius R´eduit 80837, Mauritius · Department of Electrical & Computer Engineering Cyprus University of Technology 3036 Limassol, Cyprus · Faculty of Electrical & Computer Engineering University of Prishtina ”Hasan Prishtina” 10000 Prishtina, Kosovo +4
ReST-RL: Reinforcing LLM Reasoning through Unified Self-Training and Value-Guided Search
Aug 27, 2025Sining Zhoubian, Dan Zhang, Jie TangLLM Reasoning Strategies Large Language Model Reinforcement Learning
Department of Computer Science and Technology, Tsinghua University · Work done when interned at Z.ai. · School of Electronics and Computer Scinence, Univeristy of Southampton
When Tools Hurt LLM Reasoning: State-Dependent Belief Revision under External Evidence
Aug 21, 2025Yufeng Zhao, Junnan Liu, Hongwei Liu +4LLM Reasoning Strategies
Shanghai Artificial Intelligence Laboratory · Department of Electronic Engineering, Tsinghua University · Beijing National Research Center for Information Science and Technology +2
Fast, Slow, and Tool-augmented Thinking for LLMs: A Review
Aug 17, 2025Xinda Jia, Jinpeng Li, Zezhong Wang +6LLM Reasoning Strategies Reasoning Skills
School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · Huawei Technologies Co., Ltd., Beijing 100084, China · Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong 999077, China +3
Beyond Scaling Law: A Data-Efficient Distillation Framework for Reasoning
Aug 13, 2025Xiaojun Wu, Xiaoguang Jiang, Huiyang Li +11LLM Reasoning Strategies Dataset Distillation
1Zhongxing Telecom Equipment(ZTE), China · 2China Mobile Communications Group Co Ltd
Rethinking Prospect Theory for LLMs: Revealing the Instability of Decision-Making under Epistemic Uncertainty
Aug 12, 2025Rui Wang, Qihan Lin, Jiayu Liu +7Large Language Model Uncertainty LLM Reasoning Strategies
Hong Kong University of Science and Technology · Huazhong University of Science and Technology · University of Illinois Urbana-Champaign
FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
Aug 7, 2025Chuan Li, Qianyi Zhao, Fengran Mo +1LLM Reasoning Strategies
East China Normal University, China · University of Montreal, Canada
The Bidirectional Process Reward Model
Aug 3, 2025Lingyin Zhang, Jun Gao, Xiaoxue Ren +1Process Reward Model LLM Reasoning Strategies
School of Computer Science and Technology, Soochow University · Biomedical Basic Research Center of Jiangsu, Soochow University, Suzhou, Jiangsu 215123, China · School of Software Technology, Zhejiang University +1
Disentangling Reasoning Logic to Resolve Explicit Knowledge Conflicts
Aug 2, 2025Xianda Zheng, Zijian Huang, Meng-Fen Chiang +4LLM Reasoning Strategies Reasoning Skills
School of Computer Science, University of Auckland · Department of Electronics and Electrical Engineering, National Yang Ming Chiao Tung University · School of Computing and Information Systems, Singapore Management University +1
Medical Reasoning in the Era of LLMs: A Systematic Review of Enhancement Techniques and Applications
Aug 1, 2025Zizhan Ma, Wenxuan Wang, Meidan Ding +7Clinical Reasoning Training LLM Reasoning Strategies
The Chinese University of Hong Kong · Renmin University of China · Shenzhen University +3
Post-Training Large Language Models via Reinforcement Learning from Self-Feedback
Jul 29, 2025Carel van Niekerk, Renato Vukovic, Benjamin Ruppik +3Large Language Model Reinforcement Learning LLM Reasoning Strategies
Heinrich Heine University Düsseldorf, Germany
Knowing When to Critique: Task-Adaptive Metacognitive Regulation for Reliable LLM Reasoning
Jul 20, 2025Xinmeng Hou, Ziting Chang, Zhouquan Lu +5LLM Reasoning Strategies Critique
Nanyang Technological University · Unicorn Verse · Shanghai Jiao Tong University +3
LLM Bidders Preserve the Mechanism-Level Orderings of Human Bidders
Jul 12, 2025Anand Shah, Kehang Zhu, Yanchen Jiang +4Bidding LLM Reasoning Strategies
MIT & NBER
PERK: Long-Context Reasoning as Test-Time Learning
Jul 8, 2025Zeming Chen, Angelika Romanou, Gail Weiss +1Efficient Long-Context Inference Long-Context Reasoning
EPFL

Mar 9, 2026, cs.CLJ/K move · Enter open · S save

Learning When to Sample: Confidence-Aware Selective Sampling for Efficient Chain-of-Thought Reasoning

Juming Xiong, Kevin Guo, Congning Ni, Weixin Liu+6

1Vanderbilt University · 2Vanderbilt University Medical Center · 3Intuit AI Research

LLM Reasoning Strategies Chain-of-Thought Reasoning

Open paper AskPDF arXiv

Large language models (LLMs) can achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet they often generate unnecessarily long reasoning paths that incur high inference cost. Self-consistency-based approaches push accuracy higher still, but they require sampling and aggregating multiple reasoning trajectories, leading to substantial computational overhead. In this paper, we introduce a confidence-aware selective sampling framework that, at inference time, analyzes a single reasoning trajectory to adaptively determine whether to rely on that trajectory alone or trigger multi-path sampling. The framework uses trajectory-level numeric features and sentence-level linguistic features extracted from reasoning states to guide selective multi-path reasoning. We train it on MedQA and evaluate it in-domain on MedQA and under calibration-only transfer on MathQA, MedMCQA, and MMLU, without further fine-tuning. Experimental results show that the proposed framework maintains comparable performance to full and efficient multi-path reasoning baselines, with accuracy changes of

-0.41 \pm 0.58

and

-0.31 \pm 0.58

percentage points, respectively, while reducing token usage by

71.7 \pm 5.0%

and

36.6 \pm 9.1%

. These findings demonstrate that reasoning trajectories contain rich signals for uncertainty estimation, enabling a simple, transferable mechanism to balance accuracy and efficiency in LLM reasoning.

Momentum

Related topics

Latest papers 797