LLM Reasoning

LLM: Large Language Model

Overview

This field asks how language models can carry out multi-step inference across mathematics, coding, logic, science, and real-world tasks, and how to tell robust reasoning from pattern matching. Common approaches include chain-of-thought prompting, self-consistency and tree search at inference time, tool use and symbolic verification, and post-training with supervised traces, reinforcement learning from verifiable rewards, or process feedback. Researchers are also exploring latent and recurrent computation to reduce reliance on long written traces, alongside benchmarks that test compositionality, robustness, and long-horizon execution. A central tension is that more computation can improve accuracy but raise cost, while plausible explanations and correct final answers do not by themselves establish faithful, reliable reasoning.

Latest papers

CardsList

968 papers39 papers in the last four weeks, down 67% on the four weeks before. 0.3% of all new papers.

  1. Training LLMs to Follow Reasoning Instructions with Minimal Edits

    Nov 19, 2026Alexandra Yakovleva, Luat Gia Khoi Nguyen, Juho Kannala +2LLM Reasoning

  2. Budget Internalization: Fixed-Budget RLVR Trades Test-Time Scaling for In-Budget Accuracy

    Nov 19, 2026Ilia Zavidnyi, Alexander Kovrigin, Arina Puchkova +2Test-Time ScalingLLM Reasoning

  3. RoCoKV: Accelerating LLM Inference Serving through Uncertainty and Redundancy Aware KV Cache Compression

    Nov 19, 2026Payman Behnam, Elaheh Sobhani, Saad Amin +6KV-Cache CompressionLLM Inference Acceleration

  4. Modeling LLM Reasoning Dynamics with Structural Representations

    Nov 18, 2026Ilia Karpov, Andrey Atamanyuk, Dmitry Ilvovsky +4Structured Reasoning in Language ModelsLLM Reasoning

  5. Get Hint-Augmented GRPO Done Right Through Activation Steering

    Nov 17, 2026Khiem Le, Ting Hua, Nitesh V. ChawlaReinforcement LearningRL for Language Model Reasoning

  6. OAK-Mind: Zero-Training Mental Health Change Inference from Passive Sensing via Knowledge-Grounded Multi-Agent LLMs

    Nov 17, 2026Yishu Ji, Zhihan Jiang, Will Ke Wang +3Clinical PredictionMulti-Agent LLMs

  7. Simplify, Agree, Distill: Label-Free Self-Distillation with Stepping Stones

    Nov 13, 2026Dingyang Chen, Jinfeng Xiao, Zhenyu Zhang +8Self-DistillationLLM Reasoning

  8. ARCHER: From Rationale Imitation to Executable Reasoning in Small Language Models

    Nov 13, 2026Dhruv Dixit, Khushi Patel, Congcong Xu +1LLM ReasoningStructured Reasoning in Language Models

  9. MuSeToM: Multi-Sensory Evaluation of Belief Revision with Textual Cues Across Six Senses

    Nov 12, 2026Chunkit Chan, Kawai Chung, Sze Heng Douglas Kwok +13Theory of MindBelief Updating in LLMs

  10. Orbit: An Evidence-Grounded Benchmark for Evaluating LLMs on IT Operations Reasoning

    Nov 11, 2026Sathwik Narkedimilli, Rakshit Verma, Rahul Soni +5Language Model Reasoning EvaluationLLM Reasoning

  11. Same Task, Different Statement: When and How Reformulation Helps LLM Problem Solving

    Nov 11, 2026Wentao Zhang, Xiaoyu Zhang, Chengwei Liu +5Query ReformulationLLM Reasoning

  12. Tree-Ising: Repairing Language Models with Bit-Level Ising Edits

    Nov 10, 2026Hadi Salloum, Ammar AliLanguage Model EditingLLM Reasoning

  13. Phase-Conditioned Reward Shaping for Token-Efficient LLM Reasoning

    Nov 7, 2026Zhe Chen, Xiaolin Zhou, Xiyang HuEfficient Language Model ReasoningLLM Reasoning

  14. Enhancing Mathematical Reasoning in Turkish Large Language Models with Search-Based Inference and Model Merging

    Nov 7, 2026Ahmed Zeer, Osama Shbib, Muzaffer Kaan Yuce +2LLM ReasoningLLM Fine-Tuning

  15. Failure Profiling and Reachable Trajectory Selection for Reasoning Distillation

    Nov 6, 2026Yijun Zhu, Jianxin Wang, Chengchao ShenReasoning DistillationLanguage Model Distillation

  16. StepBack: Step-Level Error-Localized Resampling for Efficient Test-Time Reasoning

    Nov 5, 2026Yang Ouyang, Jung-Eun KimEfficient Language Model ReasoningLLM Reasoning

  17. Rules, Traces and Routing Statistics: Training and Calibration Data for Open Models on ARC-AGI-2

    Nov 4, 2026Nguyen Minh Thang, Trinh Thi PhuongARC-AGIFine-Tuning Language Models

  18. Reward Budgeting Reduces Premature Convergence in Reinforcement Learning for LLM Reasoning

    Nov 4, 2026Mengni Jia, Mengyu Zhou, Xiaoxi Jiang +1RL for Language Model ReasoningReward Design for RL

  19. Think Less, Locally: Local Preference Learning for Reasoning Compression

    Nov 3, 2026Muyao Yuan, Liyan Xu, Weizhan Zhang +4Efficient Language Model ReasoningLLM Reasoning

  20. Self-Privileged Fine-Tuning

    Nov 3, 2026Yangrong Hu, Xueyu Zhou, Yue Wu +1Token-Level Loss WeightingSupervised Fine-Tuning

  21. When Strong Reasoners Join the Pool: Small Union Premiums and Costly Runaway Generations in LLM Routing

    Nov 3, 2026Teng-Ruei ChenLLM RoutingLanguage Model Reasoning Evaluation

  22. What Drives the Zero-to-One Jump? Diagnosing and Steering Hard-Prompt Learning in RLVR

    Nov 2, 2026Rui Zhu, Yumou Liu, Zhenzhe Zheng +1Reinforcement LearningLLM Reasoning

  23. RLVR Sharpens the Pencil, Not the Mind

    Nov 2, 2026Shreeyam Bangera, Manya GuptaRL for Language Model ReasoningReinforcement Learning with Verifiable Rewards

  24. Steer, Don't Tell: Breaking Reasoning Plateaus with Reachability-Aligned Self-Distillation

    Oct 31, 2026Zijian Wu, Lingkai Kong, Lin Yang +5LLM ReasoningLarge Reasoning Models

  25. From Weeks to Hours: Fast and Principled SFT Data Generation for Reasoning LLMs

    Oct 31, 2026Hongyi Henry Jin, Wenhan Yang, Meysam Ghaffari +2Training Data SelectionSynthetic Data Generation for Language Models