LLM Reasoning

LLM: Large Language Model

Overview

This field asks how language models can carry out multi-step inference across mathematics, coding, logic, science, and real-world tasks, and how to tell robust reasoning from pattern matching. Common approaches include chain-of-thought prompting, self-consistency and tree search at inference time, tool use and symbolic verification, and post-training with supervised traces, reinforcement learning from verifiable rewards, or process feedback. Researchers are also exploring latent and recurrent computation to reduce reliance on long written traces, alongside benchmarks that test compositionality, robustness, and long-horizon execution. A central tension is that more computation can improve accuracy but raise cost, while plausible explanations and correct final answers do not by themselves establish faithful, reliable reasoning.

Latest papers

CardsList

931 papers105 papers in the last four weeks, up 27% on the four weeks before. 0.6% of all new papers.

  1. ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs

    Mar 3, 2026Wicaksono Leksono Muhamad, Joanito Agili Lopo, Tack Hwa Wong +2LLM ReasoningSymbolic Reasoning

  2. Recursive Models for Long-Horizon Reasoning

    Mar 2, 2026Chenxiao Yang, Nathan Srebro, Zhiyuan LiRecursive Language ModelsLanguage Modeling

  3. Learning Structured Reasoning via Tractable Trajectory Control

    Mar 2, 2026Po-Nien Kung, Zhen Yang, Jeffrey Luo +7Structured Reasoning in Language ModelsRL for Language Model Reasoning

  4. Provable and Practical In-Context Policy Optimization for Self-Improvement

    Mar 2, 2026Tianrun Yu, Yuxiao Yang, Zhaoyang Wang +6Language Model Self-ImprovementTest-Time Scaling

  5. One-Token Verification for Reasoning Correctness Estimation

    Mar 1, 2026Zhan Zhuang, Xiequn Wang, Zebin Chen +4Reasoning VerificationLLM Reasoning

  6. CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoning

    Mar 1, 2026Xinyu Zhu, Yihao Feng, Yanchao Sun +5LLM ReasoningSynthetic Data Generation for Language Models

  7. When does Chain-of-Thought Help: A Markovian Perspective

    Feb 27, 2026Zihan Wang, Yijun Dong, Qi LeiMarkov ChainsCoT Reasoning

  8. LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning

    Feb 27, 2026Yu Zhu, Kai YangSynthetic Benchmark GenerationLLM Reasoning

  9. Humans and LLMs Diverge on Probabilistic Inferences

    Feb 26, 2026Gaurav Kamath, Sreenath Madathil, Sebastian Schuster +2LLM Reasoning

  10. Perfect score on IPhO 2025 theory by Gemini agent

    Feb 26, 2026Yichen HuangAI Agent EvaluationAI Agent Benchmarks

  11. Why Diffusion Language Models Struggle with Truly Parallel (Non-Autoregressive) Decoding?

    Feb 26, 2026Pengxiang Li, Dilxat Muhtar, Tianlong Chen +2Parallel Decoding for Diffusion Language ModelsDiffusion Language Model Decoding

  12. RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format

    Feb 26, 2026Zhehao Huang, Yuhang Liu, Baijiong Lin +5Instruction FollowingLanguage Model Merging

  13. Interleaved Head Attention

    Feb 24, 2026Sai Surya Duvvuri, Chanakya Ekbote, Rachit Bansal +6Multi-Head AttentionLLM Reasoning

  14. To Reason or Not to: Selective Chain-of-Thought in Medical Question Answering

    Feb 23, 2026Zaifu Zhan, Min Zeng, Shuang Zhou +6CoT ReasoningEfficient Language Model Reasoning

  15. LLMs Can Learn to Reason Via Off-Policy RL

    Feb 22, 2026Daniel Ritter, Owen Oertell, Bradley Guo +3RL for Language Model ReasoningRL Post-Training

  16. Reasoning Capabilities of Large Language Models. Lessons Learned from General Game Playing

    Feb 22, 2026Maciej Świechowski, Adam Żychowski, Jacek MańdziukLLM ReasoningLLM Evaluation

  17. Asking the Right Questions: Improving Reasoning with Generated Stepping Stones

    Feb 22, 2026Hengyuan Hu, Tingchen Fu, Minqi Jiang +3LLM Reasoning

  18. Evaluating Chain-of-Thought Reasoning through Reusability and Verifiability

    Feb 19, 2026Shashank Aggarwal, Ram Vikas Mishra, Amit AwekarCoT EvaluationLLM Reasoning

  19. Training Large Reasoning Models Efficiently via Progressive Thought Encoding

    Feb 18, 2026Zeliang Zhang, Xiaodong Liu, Hao Cheng +3Efficient Language Model ReasoningLLM Reasoning

  20. Framework of Thoughts: A Foundation Framework for Dynamic and Optimized Reasoning based on Chains, Trees, and Graphs

    Feb 18, 2026Felix Fricke, Simon Malberg, Georg GrohInference-Time OptimizationTree of Thoughts

  21. From Growing to Looping: A Unified View of Iterative Computation in LLMs

    Feb 18, 2026Ferdinand Kapl, Emmanouil Angelis, Kaitlin Maile +2LLM Reasoning

  22. Balancing Faithfulness and Performance in Reasoning via Multi-Listener Soft Execution

    Feb 18, 2026Nithin Sivakumaran, Shoubin Yu, Hyunji Lee +4CoT FaithfulnessFaithfulness of Language Model Explanations

  23. The Potential of CoT for Reasoning: A Closer Look at Trace Dynamics

    Feb 16, 2026Gregor Bachmann, Yichen Jiang, Seyed Mohsen Moosavi Dezfooli +1CoT ReasoningLLM Reasoning

  24. Physical Commonsense Reasoning for Lower-Resourced Languages and Dialects: a Study on Basque

    Feb 16, 2026Jaione Bengoetxea, Itziar Gonzalez-Dios, Rodrigo AgerriLLM ReasoningLow-Resource Language Processing