RL Post-Training

RL: Reinforcement Learning

Overview

Reinforcement learning post-training studies how to adapt pretrained language, multimodal, and action models using rewards from people, verifiers, evaluators, or environments. Common approaches include reinforcement learning from human feedback and verifiable rewards, with policy-gradient methods such as PPO and GRPO, alongside preference optimization, self-distillation, offline replay, and adaptive curricula. Work also develops critics and step-level credit assignment for long-horizon agents, as well as systems that make rollout generation and training more efficient. A central tension is improving task performance while preserving exploration, concise outputs, prior capabilities, and reliable generalization when feedback is sparse or imperfect.

Latest papers

CardsList

464 papers42 papers in the last four weeks, down 53% on the four weeks before. 0.3% of all new papers.

  1. Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting

    Oct 21, 2025Howard Chen, Noam Razin, Karthik Narasimhan +1Continual Learning for LLMsRL Post-Training

  2. Representation-Based Exploration for Language Models: From Test-Time to Post-Training

    Oct 13, 2025Jens Tuyls, Dylan J. Foster, Akshay Krishnamurthy +1RL for Language Model ReasoningTest-Time Scaling

  3. Stabilizing MoE Reinforcement Learning by Aligning Training and Inference Routers

    Oct 13, 2025Wenhan Ma, Hailin Zhang, Liang Zhao +4RL StabilityRL for Language Models

  4. Don't Tell the Answer, Truly Guide the Reasoning During RL Rollouts

    Oct 10, 2025Xinyi Wang, Jinyi Han, Zishang Jiang +7Reinforcement LearningRL for Language Model Reasoning

  5. TripScore: Aligning LLMs for Real-World Travel Planning via Expert-Calibrated Reward

    Oct 10, 2025Yincen Qu, Huan Xiao, Feng Li +5Reward ModelingLLM Planning

  6. SCOPE-RL: Stable and Quantitative Control of Policy Entropy in RL Post-Training

    Oct 9, 2025Chen Wang, Zhaochun Li, Jionghao Bai +4Entropy Collapse in RLReinforcement Learning

  7. Think Right: Learning to Mitigate Under-Over Thinking via Adaptive, Attentive Compression

    Oct 2, 2025Joykirat Singh, Justin Chih-Yao Chen, Archiki Prasad +3RL for Language Model ReasoningLLM Inference Acceleration

  8. Reinforcement Learning with Verifiable yet Noisy Rewards under Imperfect Verifiers

    Oct 1, 2025Xin-Qiang Cai, Wei Wang, Feng Liu +3Reinforcement LearningRL for Language Model Reasoning

  9. ReST-RL: Reinforcing LLM Reasoning through Unified Self-Training and Value-Guided Search

    Aug 27, 2025Sining Zhoubian, Dan Zhang, Jie TangRL for Code GenerationRL for Language Model Reasoning

  10. Post-Training Large Language Models via Reinforcement Learning from Self-Feedback

    Jul 29, 2025Carel van Niekerk, Renato Vukovic, Benjamin Ruppik +3RL for Language ModelsRL for Language Model Reasoning

  11. AsyncFlow: An Asynchronous Streaming RL Framework for Efficient LLM Post-Training

    Jul 2, 2025Zhenyu Han, Ansheng You, Haibo Wang +16RL for Language ModelsAsynchronous RL

  12. GVPO: Group Variance Policy Optimization for Large Language Model Post-Training

    Apr 28, 2025Kaichen Zhang, Yuzhong Hong, Junwei Bao +4LLM Post-TrainingLLM Alignment