CoT Reasoning

CoT: Chain-of-Thought

Overview

Chain-of-thought reasoning studies how language models break complex problems into steps, use intermediate information, and produce answers that can be checked or acted on. Approaches include prompting models to show their work, training on reasoning traces with supervised learning or reinforcement learning, and using structured methods such as code, symbolic rules, trees, or latent reasoning states. Researchers test these methods on tasks including mathematics, multi-hop question answering, coding, clinical decisions, and visual or spatial understanding, while developing verification and adaptive-compute methods to control cost. A central tension is that longer or more detailed traces do not reliably improve accuracy or explain how a model reached its answer; they can also amplify errors, bias, or unsupported claims.

Latest papers

CardsList

244 papers18 papers in the last four weeks, down 25% on the four weeks before. 0.1% of all new papers.

  1. The relationship between reasoning and performance in large language models--o3 (mini) thinks harder, not longer

    Feb 21, 2025Marthe Ballon, Andres Algaba, Vincent GinisCoT ReasoningEfficient Language Model Reasoning

  2. Thought-Like-Pro: Enhancing Reasoning of Large Language Models through Self-Bootstrapped Prolog-based Chain-of-Thought

    Jul 18, 2024Xihe Qiu, Yongxin Deng, Xiaoyu Tan +2Symbolic Reasoning in Language ModelsLLM Training

  3. Few shot chain-of-thought driven reasoning to prompt LLMs for open ended medical question answering

    Mar 7, 2024Saeel Sandeep Nachane, Ojas Gramopadhye, Prateek Chanda +5HealthcareMedical Diagnosis

  4. Amortizing intractable inference in large language models

    Oct 6, 2023Edward J. Hu, Moksh Jain, Eric Elmoznino +4Amortized InferenceLLM Fine-Tuning