LLM Reasoning

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

68 papers in the last four weeks, up 143% on the four weeks before. 0.7% of all new papers.

Jul 13Week of Sep 28

Latest papers 650

All topics

BPPO: Binary Prefix Policy Optimization for Efficient GRPO-Style Reasoning RL with Concise Responses
May 27, 2026Qingfei Zhao, Huan Song, Shuyu Tian +2RL for Language Model Reasoning Group Relative Policy Optimization
1TeleAI · 2Shanghai Jiao Tong University
Beyond Imitation: Reflective On-Policy Self-Distillation for LLM Reasoning
May 27, 2026Ziqi Zhao, Xinyu Ma, Liu Yang +6On-Policy Self-Distillation Language Model Distillation
The Hong Kong Polytechnic University · Baidu Inc. · Shandong University +1
Integrated and Cross-Architecture Interpretation of LLM Reasoning
May 27, 2026Leonardo Matthew Yauw, Wei-Bin Kou, Yujiu YangTransformer Interpretability LLM Interpretability
Tsinghua Shenzhen International Graduate School · Harbin Institute of Technology, Shenzhen
The Shape of Overthinking: Backtracking Bursts in Long Reasoning Traces
May 27, 2026Navid Rezazadeh, Arash Gholami DavoodiReasoning Evaluation Efficient Language Model Inference
University of California, Irvine · Carnegie Mellon University
GeneralThinker: Domain-General Reasoning through Likelihood-Guided Answer-Conditioned Optimization
May 27, 2026Shengmin Piao, Sanghyun ParkToken-Level Credit Assignment RL for Language Model Reasoning
Yonsei University Seoul, South Korea
Revealing Algorithmic Deductive Circuits for Logical Reasoning
May 27, 2026Phuong Minh Nguyen, Tien Huu Dang, Naoya InoueAttention Head Analysis LLM Interpretability
Japan Advanced Institute of Science and Technology
In LLM Reasoning, there is Irrationality on top of Value Misalignment
May 26, 2026Kejiang Qian, Fengxiang HeLLM Alignment LLM Reasoning
University of Edinburgh
ReasonOps: A Unified Operational Paradigm for Trustworthy Verified LLM Reasoning
May 26, 2026Adnan RashidLLM Safety LLM Reasoning
School of Electrical Engineering and Computer Science (SEECS) National University of Sciences and Technology (NUST) Islamabad, Pakistan
Recon: Reconstruction-Guided Reasoning Synthesis for User Modeling
May 26, 2026Alan Zhu, Mihran Miroyan, Carolyn Wang +4CoT Reasoning User Modeling
University of California, Berkeley
GeoFaith: A Spatio-Temporal Dual View of Faithful Chain-of-Thought
May 26, 2026Weijiang Lv, Wentong Zhao, Jiayu Wang +3CoT Faithfulness RL for Language Model Reasoning
1Xidian University · 2Xi’an Jiaotong University · 3Mohamed bin Zayed University of Artificial Intelligence +2
Uncertainty-Aware Budget Allocation for Adaptive Test-Time Reasoning
May 26, 2026Manh Nguyen, Sunil Gupta, Hung LeEfficient Language Model Reasoning Adaptive Sampling
Applied Artificial Intelligence Initiative Deakin University, Australia
Evaluating Interactive Reasoning in Large Language Models: A Hierarchical Benchmark with Executable Games
May 26, 2026Mingyuan Fan, Weiguang Han, Daixin Wang +3LLM Evaluation AI Agent Benchmarks
East China Normal University · Ant Group
Why Prompt Optimization Works, and Why It Sometimes Doesn't: A Causal-Inspired Edit-Level Analysis
May 26, 2026Shuzhi Gong, Hechuan WenAutomatic Prompt Optimization LLM Reasoning
The University of Melbourne, Melbourne, Victoria, Australia · The University of Queensland, Brisbane, Queensland, Australia
Explaining Too Much? Understanding How Large Language Model Reasoning Traces Influence Performance and Metacognition
May 25, 2026Daniela Fernandes, Daniel Buschek, Lev Tankelevitch +2CoT Reasoning Human-AI Interaction
Aalto University, Espoo, Finland · University of Bayreuth, Bayreuth, Germany · Microsoft Research Cambridge, Cambridge, United Kingdom +1
Selective Latent Thinking: Adaptive Compression of LLM Reasoning Chains
May 25, 2026Hui Xie, Jie Liu, Ziyue Qiao +1Efficient Language Model Reasoning LLM Inference Acceleration
Eindhoven University of Technology, Netherlands · School of Computing and Information Technology, Great Bay University, China
RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations
May 25, 2026Hanyu Li, Yichi Zhang, Speed Zhu +3AI Coding Agents Software Engineering Benchmarks
Beijing University of Posts and Telecommunications · Tsinghua University · Tencent
ARBITER: Reasoning Trajectory Basins and Majority Vote Failures in Test-Time Sampling
May 25, 2026Meng Cai, Lars Kulik, Farhana ChoudhurySelf-Consistency Decoding Test-Time Scaling
School of Computing and Information Systems University of Melbourne
Context-CoT: Enhancing Context Learning via High-Quality Reasoning Synthesis
May 25, 2026Hongbo Jin, Mingnan Zhu, Jingqi Tian +6CoT Reasoning In-Context Learning
Peking University · Xiamen University · Tsinghua University
Inference Time Optimization with Confidence Dynamics
May 24, 2026Yu Wang, Minghao Liu, Jiayun Wang +3Inference-Time Optimization Confidence Estimation in Language Models
Center for Advanced AI, Accenture.
Better, Faster: Harnessing Self-Improvement in Large Reasoning Models
May 24, 2026Qihuang Zhong, Liang Ding, Juhua Liu +3Overthinking in Language Models RL for Language Model Reasoning
1Nanyang Technological University, Singapore · 2Alibaba Group · School of Computer Science, Wuhan University, China +1
When Reasoning Hurts: Source-Aware Evaluation of Frontier LLMs for Clinical SOAP Note Generation
May 24, 2026Faizan FaisalRetrieval-Augmented Generation Medical Report Generation
University of California, Davis
Measuring Reasoning Quality in LLMs: A Multi-Dimensional Behavioral Framework
May 23, 2026Ali Şenol, Garima Agrawal, Huan LiuLLM Evaluation Language Model Robustness
Department of Computer Engineering, Tarsus University, Takba¸s M. Kartaltepe S., Tarsus 33400, Mersin, Türkiye · School of Computing and Augmented Intelligence (SCAI), Arizona State University (ASU), Tempe, AZ 85281, USA · HumaConn AI Consulting, Queen Creek, AZ 85140, USA
Learning to Reason Efficiently with A* Post-Training
May 23, 2026Andreas Opedal, Francesco Ignazio Re, Abulhair Saparov +3Process Reward Models RL for Language Model Reasoning
αETH Zürich · γPurdue University · βMPI for Intelligent Systems, Tübingen
Hypothesis Generation and Inductive Inference in Children and Language Models
May 23, 2026Jeffrey Qin, Wasu Top Piriyakulkij, Zhuangfei Gao +4Bayesian Inference Scientific Hypothesis Generation
Computer Science University of Waterloo · Department of Computer Science Cornell University · Department of Computer Science Dalhousie University +1
Understanding and Mitigating Premature Confidence for Better LLM Reasoning
May 23, 2026Jingchu Gai, Guanning Zeng, Christina Baek +4Confidence Estimation in Language Models RL for Language Model Reasoning
1Carnegie Mellon University · 2Tsinghua University
ChaosBench-Logic v2: Evaluating LLM Logical Reasoning over Dynamical Systems at Scale
May 23, 2026Noel ThomasLLM Evaluation Language Model Robustness
Mohamed bin Zayed University of Artificial Intelligence · Abu Dhabi, UAE
DRInQ: Evaluating Conversational Implicature with Controlled Context Variation
May 22, 2026Hirona Jacqueline Arai, Xiang RenLLM Evaluation Pragmatic Reasoning in Language Models
University of Southern California
HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models
May 22, 2026Yuyu Liu, Haotian Xu, Yanan He +3LLM Fine-Tuning Efficient Language Model Reasoning
Department of Computer Science Stony Brook University · Department of Applied Mathematics and Statistics Stony Brook University · Department of Computer Science Yale University +2
Convergence Without Understanding: When Language Models Agree on Representations but Disagree on Reasoning
May 22, 2026Muhammad Usama, Dong Eui ChangRepresentational Similarity Analysis LLM Interpretability
Control Laboratory, School of Electrical Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon 34141, Republic of Korea · Control Laboratory, School of Electrical Engineering Korea Advanced Institute of Science and Technology (KAIST)2026 Daejeon 34141, Republic of Korea
GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
May 22, 2026Vartan Shadarevian, Kia Ghods, Alex Kenich +1LLM Evaluation Imperfect-Information Games
Princeton University · Google

May 27, 2026, cs.LGJ/K move · Enter open · S save

BPPO: Binary Prefix Policy Optimization for Efficient GRPO-Style Reasoning RL with Concise Responses

Qingfei Zhao, Huan Song, Shuyu Tian, Jiawei Shao+1

1TeleAI · 2Shanghai Jiao Tong University

RL for Language Model Reasoning Group Relative Policy Optimization Efficient Language Model Training LLM Reasoning

Open paper AskPDF arXiv

Group Relative Policy Optimization (GRPO) is widely used for training reasoning models, but updating all sampled completions in each group incurs substantial cost and can reinforce verbose reasoning trajectories. In this paper, we study whether all completions provide equally useful update signals in GRPO-style reasoning RL. Our gradient-similarity analysis shows that, within the same prompt group, same-class completions often induce highly similar update directions, whereas correct-incorrect pairs provide more distinct contrastive signals. Motivated by this observation, we propose Binary Prefix Policy Optimization (BPPO), which uses the shortest correct completion and the shortest incorrect completion as a compact update unit while preserving full-group advantage normalization. BPPO further improves efficiency with adaptive completion scheduling and prefix-focused optimization; by updating only response prefixes, it avoids reinforcing redundant suffixes and encourages more concise responses. Experiments on GSM8K, MATH, and Geo3K show that BPPO achieves up to 6.08x speedup over GRPO while maintaining competitive accuracy, and reduces mean response length by approximately 30-50% without modifying the reward with an explicit length penalty.

Momentum

Related topics

Latest papers 650