LLM Reasoning

LLM: Large Language Model

Overview

This field asks how language models can carry out multi-step inference across mathematics, coding, logic, science, and real-world tasks, and how to tell robust reasoning from pattern matching. Common approaches include chain-of-thought prompting, self-consistency and tree search at inference time, tool use and symbolic verification, and post-training with supervised traces, reinforcement learning from verifiable rewards, or process feedback. Researchers are also exploring latent and recurrent computation to reduce reliance on long written traces, alongside benchmarks that test compositionality, robustness, and long-horizon execution. A central tension is that more computation can improve accuracy but raise cost, while plausible explanations and correct final answers do not by themselves establish faithful, reliable reasoning.

Latest papers

CardsList

931 papers105 papers in the last four weeks, up 27% on the four weeks before. 0.6% of all new papers.

  1. An Incomplete Loop: Deductive, Inductive, and Abductive Reasoning in Language Models

    Apr 3, 2024Emmy Liu, Graham Neubig, Jacob AndreasLLM PromptingAbductive Reasoning in Language Models