Large Language Model Reinforcement Learning

Ask about this topic

Momentum

17 papers in the last four weeks, up 42% on the four weeks before. 0.2% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 194

All topics
CardsList

  1. CARM: Cancellation-Aware Response Masking for LLM Reinforcement Learning

    Oct 1, 2026Yafei Zhang, Songshuo Lu, Sicong Liao +2Large Language Model Reinforcement LearningLLM Reasoning Strategies

    Moore Threads AI

  2. On Language Drift during RLVR Post-Training

    Oct 1, 2026Michael Sullivan, Alexander KollerLarge Language Model Reinforcement LearningLLM Reasoning Strategies

    Department of Language Science and Technology, Saarland University, Saarbrücken, Germany.

  3. Probe with Participation Trophies: Random-Reward RL as a Probe of LLM Capability

    Oct 1, 2026Yu Mao, Lei Yu, Zining Zhu +6Large Language Model Reinforcement LearningLLM Reasoning Strategies

    University of Toronto · Stevens Institute of Technology · University of California, Santa Cruz +3

  4. Exploring More, Reasoning Better: Stepwise Risk-Sensitive GRPO for Diffusion Language Models

    Sep 30, 2026Yue YU, Bowen Zuo, David Crandall +2Diffusion Language ModelsLarge Language Model Reinforcement Learning

    Indiana University · University of California, Riverside

  5. GrammarRL: Effective Grammar-Constrained Decoding via Reinforcement Learning

    Sep 30, 2026Gabriele Tuccio, Antonino Furnari, Aldo Gangemi +1Language ModelingConstrained Decoding

    University of Catania · ISTC - National Research Council, Italy · University of Bologna

  6. Trust the Critic More

    Sep 30, 2026Kaiyue Wen, Luke Bailey, Arvind Mahankali +1Critic-Free Reinforcement LearningLarge Language Model Reinforcement Learning

    Stanford University

  7. Jailbreaks for Black-Box Uncertainty Quantification in Large Reasoning Models

    Sep 28, 2026Lucas Biechy, Cédric Eichler, Adrien Boiret +1Large Language Model UncertaintyLarge Reasoning Models

    Petscraft, Inria · Université Paris-Saclay · INSA CVL +2

  8. LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization

    Sep 28, 2026Shihao Zhang, Weiting Liu, Siyu Shao +4Optimization ModelingLarge Language Model Reinforcement Learning

    East China Normal University · Alibaba Group · Fudan University +4

  9. QwenGyre: An Elastic Reinforcement Learning Framework for Training xLong-Horizon Agents

    Sep 27, 2026Weiqi Wang, Yuxin Zhou, Mouxiang Chen +9Large Language Model Reinforcement LearningOffline Reinforcement Learning

    Alibaba Token Hub, Alibaba Group · University of Science and Technology of China · Tsinghua University

  10. TGRL: Temperature-Grouped Reinforcement Learning for Efficient Exploration in LLMs

    Sep 27, 2026Zihan Lin, Xiaohan Wang, Jie Cao +4Large Language Model Reinforcement LearningGroup-Based Reinforcement Learning

    University of Chinese Academy of Sciences · Meituan · MAIS&NLPR, Institute of Automation, Chinese Academy of Sciences

  11. DEEPO: Dual-Entropy Enhanced Policy Optimization for Hallucination in MLLMs

    Sep 23, 2026Yingxuan Zhuang, Miao Pan, Wangjie Gan +6Large Language Model Reinforcement LearningLarge Language Model Hallucination

    Zhejiang University · Shanghai Artificial Intelligence Laboratory

  12. DCRL: Decoupling and Coupling Reinforcement Learning via Policy-Reward Manifold Alignment

    Sep 23, 2026Henan Sun, Zehua Li, Haitao Hu +4Large Language Model Reinforcement LearningOffline Reinforcement Learning

    The Hong Kong University of Science and Technology (Guangzhou) · Huawei Noah’s Ark Lab · Tencent HY +1

  13. Informed Masking: Structure-Aware Perturbation for Reinforcement Learning in Diffusion Large Language Models

    Sep 22, 2026Xiaoyi Yu, Enver Sangineto, Pei Fu +6Diffusion Language ModelsLarge Language Model Reinforcement Learning

    Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China · MiLM Plus, Xiaomi Inc., Beijing, China · University of Modena and Reggio Emilia, Italy +1

  14. Rollout Efficiency in Reinforcement Learning for Reasoning Large Language Models: A Taxonomy and Future Directions

    Sep 21, 2026Niloofar Gholipour, Marcos Assuncao, Gursimran Singh +8Large Language Model Reinforcement LearningRollout

    École de technologie supérieure, Univ. of Québec, Canada · Huawei Technologies, Canada · The Univ. of Melbourne, Australia +1

  15. Learning to Coach for Experiential Learning

    Sep 14, 2026Guanheng Chen, Tianzhu Ye, Li Dong +3Coaching SystemsAgentic Learning

    Microsoft Research

  16. What Does an LLM Learn from Reinforcement Learning? A Mechanistic Interpretability Perspective with Fixed-SAE Track

    Sep 14, 2026Lingheng Du, Yiming Tang, Xufeng Duan +1Large Language Model Reinforcement LearningImproving Sparse Autoencoders

    Peking University · National University of Singapore · The Chinese University of Hong Kong

  17. Not All Prompts Are Equal: Exploration-Guided Prompt Scaffolding for Multimodal Reinforcement Post-Training

    Sep 14, 2026Yuanhao Yue, Qianli Ma, Chengyu Wang +3Large Language Model Reinforcement LearningOffline Reinforcement Learning

    Alibaba Cloud Computing · Shanghai Jiao Tong University · Fudan University +1

  18. Expert-Space Exploration in MoE Reinforcement Learning

    Sep 14, 2026Hongyi He, Zhenghao Lin, Xiao Liu +3Mixture-Of-ExpertsLarge Language Model Reinforcement Learning

    Tsinghua University · Microsoft Research

  19. CanvasAnneal: Curriculum Reinforcement Learning for Diffusion Language Models

    Sep 14, 2026Blake Olson, Yuhang Song, Emmett McQuinn +1Diffusion Language ModelsDiffusion-Based Reinforcement Learning Methods

    Google DeepMind

  20. Negative Self-Distillation: Learning to Reason by Avoiding Flaws

    Sep 10, 2026Rongcan Pei, Zhepei Wei, Shuyao Xu +3Unsupervised On-Policy Self-DistillationSelf-Distillation Framework

    Department of Computer Science, University of Virginia · Stanford University

  21. Long-Horizon Language Model Reinforcement Learning via Progressive Point Matching

    Sep 7, 2026Preston Fu, Kevin Frans, Oleh Rybkin +2Large Language Model Reinforcement LearningLong-Horizon Task Planning

    UC Berkeley · Carnegie Mellon University

  22. Stable-MM-R1: Anchoring Multimodal Reasoning Dynamics via Entropy-Guided Stratification

    Sep 7, 2026Yimeng Ye, Shuang Chen, Wenxuan Huang +8Large Language Model Reinforcement LearningMultimodal Reasoning

    Columbia University · CUHK · THU +1

  23. CaRL-EM: Cost-Aware Reinforcement Learning for Entity Matching with LLMs

    Sep 1, 2026Chaohui Guo, Michel Klein, Zhisheng HuangLarge Language Model Reinforcement Learning

    Department of Computer Science, Vrije Universiteit Amsterdam, Netherlands

  24. CARE: Contrastive Anchor-based Rubric Evolution for Large Language Model Post-Training

    Sep 1, 2026Siyuan Li, Xinxin Song, Chen Ruinian +5Large Language Model Reinforcement LearningLarge Language Model Evaluation

    Department of Automation, Tsinghua University · Meituan

  25. Controlling Refusal Behavior of LLMs via Stiefel-Constrained Rotation Steering

    Aug 31, 2026Kirill Bunin, Dmitry Bylinkin, Vladimir Aletov +3Linear Activation SteeringSteering

    1Basic Research of Artificial Intelligence Laboratory (BRAIn Lab) · 2Kandinsky Lab · 3Innopolis University

  26. Parameter Exploration for RLVR via Variational Learning

    Aug 10, 2026Vatsal Venkatkrishna, Nico Daheim, Iryna GurevychLarge Language Model Reinforcement LearningReinforcement Learning With Verifiable Reward

    INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science, Technical University of Darmstadt and National Research Center for Applied Cybersecurity ATHENE, Germany

  27. RISE-RL: Rubric-Informed Selective Exploration for Open-Ended Reinforcement Learning

    Aug 10, 2026Jinkun Hou, Zhuo Liu, Huimin Ren +3Large Language Model Reinforcement LearningIcr-Rl

    1Peking University · 2Beijing Institute of Technology · 3Li Auto Inc.

  28. A MARL Centered Reference Architecture for Large Language Model Augmentation in Smart Manufacturing

    Aug 7, 2026Fouad Bahrpeyma, Dirk ReicheltMulti-Agent Reinforcement LearningLarge Language Model Reinforcement Learning

    Smart Production Systems, HTW Dresden, Saxony, Germany

  29. Progressive Content Refinement with Decaying Reward Joint LinUCB

    Aug 7, 2026Shion Ishikawa, Pablo Loyola, Young-joo Chung +1Contextual Bandit FrameworkLarge Language Model Reinforcement Learning

    Rakuten Group, Inc. Tokyo, Japan · Rakuten Group, Inc. San Mateo, USA

  30. RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction

    Aug 6, 2026Chenglong Wang, Ziming Zhu, Yifu Huo +9Large Language Model Reinforcement Learning

    School of Computer Science and Engineering, Northeastern University, Shenyang, China · 2NiuTrans Research, Shenyang, China · 3Independent Researcher, Beijing, China +1

  31. On-Policy Delta Distillation for Multilingual Math Reasoning

    Aug 6, 2026Byeongho Heo, Jaehui Hwang, Sangdoo Yun +1LLM Reasoning StrategiesLarge Language Model Reinforcement Learning

    NAVER AI Lab

  32. SpecRoll: Fast-Slow Verifier-Feedback Adaptation for Speculative Reinforcement Learning Rollouts

    Aug 5, 2026Nhat Minh Pham, Duy Tung Doan, Thi Duyen Ngo +2Autoregressive RolloutLarge Language Model Reinforcement Learning

    VNU University of Engineering and Technology, Vietnam National University, Hanoi, Vietnam · Viettel AI, Viettel Group, Hanoi, Vietnam

  33. ReflectRL: Learning from Golden Negative Trajectories via Reflective-to-Direct Reasoning

    Aug 4, 2026Jinhe Bi, Chennan Zhou, Zengjie Jin +10Reasoning TrajectoryLarge Language Model Reinforcement Learning

    National University of Singapore · Ludwig Maximilian University of Munich · Huawei Heisenberg Research Center +6

  34. CVPO: Enhancing LLM Reinforcement Learning Reasoning via Value-Variance Adaptation and Dynamic Curriculum Learning

    Aug 4, 2026Ziqi Jia, Yalu Ouyang, Bo Pang +5Large Language Model Reinforcement LearningFrictive Policy Optimization

    AI Cloud Group, Baidu · Tsinghua University · University of California, San Diego

  35. Start Classifying: Categorical Critics for LLM Reinforcement Learning

    Aug 3, 2026Zhijian Zhou, Long Li, Xuan Zhang +7Large Language Model Reinforcement LearningCritic-Free Reinforcement Learning

    Fudan University · Shanghai Innovation Institute · Tencent YoutuLab +2

  36. Instruction-Conditioned Exploration for Reinforcement Learning with Self-Distillation to an Unconditioned Policy

    Aug 3, 2026Jim Dilkes, Vahid Yazdanpanah, Sebastian SteinLarge Language Model Reinforcement LearningUnsupervised On-Policy Self-Distillation

    University of Southampton Southampton United Kingdom

  37. Beyond On-Policy Exploration: Integrating External Policy Rollouts for Reinforcement Learning in Diffusion Language Models

    Aug 3, 2026Wonseok Lee, Jimyeong Kim, Jungmin Ko +1Large Language Model Reinforcement LearningAutoregressive Rollout

    Interdisciplinary Program in Artificial Intelligence, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea · Artificial Intelligence Institute, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea · Department of Intelligence and Information, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea

  38. Reusing Rollouts under Policy Lag: Prefix-Normalized Policy Optimization for LLM Reinforcement Learning

    Aug 2, 2026Wenhao Zhang, Yibo Xie, Rui Wang +9Autoregressive RolloutLarge Language Model Reinforcement Learning

    1Tencent · 2Harbin Institute of Technology · 3Jinan University +1

  39. DHRCL:Training Code LLMs with Dense Hierarchical Rewards and Curriculum Learning

    Jul 29, 2026Shuhang Wang, Ziming Li, Hui ChengLarge Language Model Reinforcement LearningLarge Language Model Training

  40. Towards Robust Reinforcement Learning for Small-Scale Language Model Agents

    Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarrayLarge Language Model Reinforcement LearningSmall Large Language Models

    Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo, N2L 3G1, Ontario, Canada · Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, Bangladesh · Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  41. ACRL: Adaptive Control of Training-Inference Discrepancy for Stable Reinforcement Learning

    Jul 27, 2026Wenwu Fan, Qihong Lin, Zhijie Xia +4Large Language Model Reinforcement LearningOffline Reinforcement Learning

    Computing Product Line, Huawei

  42. Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs

    Jul 24, 2026Zixuan Ren, Jinliang Lu, Junhong Wu +5Large Language Model Reinforcement LearningSubspace

    State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, CAS, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · Baidu Inc., Beijing, China

  43. Training Large Language Models for Self-Explanation Faithfulness

    Jul 23, 2026Yeoktatt Cheah, María Pérez-Ortiz, Noah Y. Siegel +1LLM Reasoning StrategiesLarge Language Model Reinforcement Learning

    Centre for AI, Department of Computer Science University College London · Imperial College London

  44. Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel Reasoning via Reinforcement Learning

    Jul 21, 2026Wentao Zhang, Haoyu Zhang, Xinke Jiang +7LLM Reasoning StrategiesLarge Language Model Reinforcement Learning

    ShanghaiTech University · City University of Hong Kong · Peking University +2

  45. MADA-RL: Multi-Agent Debate-Aware Reinforcement Learning for Parameter-Efficient Reasoning in Compact Models

    Jul 20, 2026Martino M. L. Pulici, Cuong Xuan Chu, Evgeny Kharlamov +3Large Language Model Reinforcement LearningIcr-Rl

    Bosch Center for Artificial Intelligence, Germany · LMU Munich, Germany · University of Oslo, Norway +2

  46. Trace-Based On-Policy Distillation for Masked Diffusion Language Models

    Jul 18, 2026Haolin Ren, Ziyang Huang, Chenhao Yuan +2Diffusion Language ModelsMasked Diffusion Language Models

    Institute of Automation, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China

  47. Mask-Aware Policy Gradients for Diffusion Language Models

    Jul 16, 2026Haran Raajesh, Kulin Shah, Adam Klivans +1Masked Diffusion Language ModelsLarge Language Model Reinforcement Learning

    Department of Computer Science The University of Texas at Austin

  48. GFlowRL: Scaling Distribution-Matching RL to Large Language Models

    Jul 15, 2026Xiaodong Liu, Michael Xu, Jack W. Stokes +3Large Language Model Reinforcement LearningGenerative Flow Networks

    Microsoft Research

  49. From Critic to Confidence: PPO for Language-Based Quantitative Prediction with Confidence Estimation

    Jul 14, 2026Mehak Dhaliwal, Rasta Tadayon, Andong Hua +2Large Language Model UncertaintyLarge Language Model Reinforcement Learning

    University of California, Santa Barbara

  50. Predictive Divergence Masks for LLM RL

    Jul 12, 2026Xiangxin Zhou, Jiarui Yao, Penghui Qi +4Large Language Model Reinforcement LearningDivergence

    1Tencent Hunyuan · 2UIUC · 3NUS

  51. ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples

    Jul 11, 2026Kexin Huang, Junkang Wu, Jinda Lu +7Large Language Model Reinforcement LearningReasoning Benchmark

    University of Science and Technology of China · Peking University · Dartmouth College

  52. Beyond Euclidean Clipping: Overcoming Exploration Collapse in LLM RL via Riemannian Isometric Policy Optimization

    Jul 11, 2026Zhicheng Cai, Xinyuan Guo, Hanlin Wu +4Large Language Model Reinforcement LearningGradient Clipping

    Institute for AI Industry Research (AIR), Tsinghua University · 2ByteDance Seed 3SIA-Lab of Tsinghua AIR and ByteDance Seed.

  53. Multimodal Reward Hacking in Reinforcement Learning

    Jul 10, 2026Jiayu Yao, Yiwei Wang, Anmeng Zhang +5Large Language Model Reinforcement Learning

    Institute of Computing Technology, Chinese Academy of Sciences · University of California, Merced · Southeast University

  54. Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing

    Jul 10, 2026Ajay Narayanan Sridhar, Ronak Singh, Mehrdad Mahdavi +1Contextual Bandit FrameworkLarge Language Model Routing

    The Pennsylvania State University

  55. Prompt-Driven Exploration

    Jul 9, 2026Sunshine Jiang, John Marangola, David Zhang +6Large Language Model Reinforcement LearningRollout

    Massachusetts Institute of Technology · Improbable AI Lab · MIT-IBM Computing Research Lab

  56. When Implausible Tokens Get Reinforced: Tail-Aware Credit Calibration for LLM Reinforcement Learning

    Jul 8, 2026Xiuyi Lou, Zicheng Xu, Yu-Neng Chuang +4Large Language Model Reinforcement Learning

    Johns Hopkins University · Rice University · Workato +1

  57. Large Behavior Model: A Promptable Digital Twin of the Retail Customer

    Jul 8, 2026Wachiravit Modecrua, Krittin Pachtrachai, Touchapon KraisingkornBehavioral Foundation ModelsLarge Language Model Reinforcement Learning

    Amity Research and Application Center (ARAC), Amity AI Holdings Co., Ltd.

  58. UP: Unbounded Positive Asymmetric Optimization for Breaking the Exploration-Stability Dilemma

    Jul 8, 2026Chongyu Fan, Pengfei Liu, Jingjia Huang +2Large Language Model Reinforcement LearningFrictive Policy Optimization

    ByteDance Seed · Michigan State University

  59. Improving LLM-Generated Process Model Quality Through Reinforcement Learning: The Role of Reward Function Design

    Jul 7, 2026Alexander Rombach, Chantale Lauer, Nijat MehdiyevProcess Reward ModelLarge Language Model Reinforcement Learning

    German Research Center for Artificial Intelligence (DFKI), Campus D3 2, Saarbrücken, 66123, Saarland, Germany · Saarland University, Campus D3 2, Saarbrücken, 66123, Saarland, Germany

  60. CARL: Constraint-Aware Reinforcement Learning for Planning with LLMs

    Jul 6, 2026Qiuyi Qi, Jinjian Zhang, Mutian Bao +9Large Language Model PlanningLarge Language Model Reinforcement Learning

    Zhejiang University · Ant Group · City University of Hong Kong