LLM Reasoning

LLM: Large Language Model

Overview

This field asks how language models can carry out multi-step inference across mathematics, coding, logic, science, and real-world tasks, and how to tell robust reasoning from pattern matching. Common approaches include chain-of-thought prompting, self-consistency and tree search at inference time, tool use and symbolic verification, and post-training with supervised traces, reinforcement learning from verifiable rewards, or process feedback. Researchers are also exploring latent and recurrent computation to reduce reliance on long written traces, alongside benchmarks that test compositionality, robustness, and long-horizon execution. A central tension is that more computation can improve accuracy but raise cost, while plausible explanations and correct final answers do not by themselves establish faithful, reliable reasoning.

Latest papers

CardsList

968 papers39 papers in the last four weeks, down 67% on the four weeks before. 0.3% of all new papers.

  1. Synergizing Large Language Models and Theory for Human-like Causal Reasoning

    May 13, 2025Yanxi Zhang, Xin Cong, Zhong Zhang +3Causal Reasoning in Language ModelsCausal Reasoning

  2. Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

    Mar 31, 2025Rui Wang, Hongru Wang, Boyang Xue +9LLM Inference EfficiencyCost-Aware Inference

  3. Thinking beyond the anthropomorphic paradigm benefits LLM research

    Feb 13, 2025Lujain Ibrahim, Myra ChengAnthropomorphism in AILLM Reasoning

  4. Foundations of Large Language Models

    Jan 16, 2025Tong Xiao, Jingbo ZhuLanguage Model PretrainingLLM Alignment

  5. RL-STaR: Theoretical Analysis of Reinforcement Learning Frameworks for Self-Taught Reasoner

    Oct 31, 2024Fu-Chieh Chang, Yu-Ting Lee, Hui-Ying Shih +2Reinforcement LearningRL for Language Model Reasoning

  6. An Incomplete Loop: Deductive, Inductive, and Abductive Reasoning in Language Models

    Apr 3, 2024Emmy Liu, Graham Neubig, Jacob AndreasDeductive Reasoning in Language ModelsLLM Prompting

  7. ThinkSum: Probabilistic reasoning over sets using large language models

    Oct 4, 2022Batu Ozturkler, Esmeralda S. Whitammer, Zhen Wang +1LLM ReasoningStructured Reasoning in Language Models