RL Post-Training

RL: Reinforcement Learning

Overview

Reinforcement learning post-training studies how to adapt pretrained language, multimodal, and action models using rewards from people, verifiers, evaluators, or environments. Common approaches include reinforcement learning from human feedback and verifiable rewards, with policy-gradient methods such as PPO and GRPO, alongside preference optimization, self-distillation, offline replay, and adaptive curricula. Work also develops critics and step-level credit assignment for long-horizon agents, as well as systems that make rollout generation and training more efficient. A central tension is improving task performance while preserving exploration, concise outputs, prior capabilities, and reliable generalization when feedback is sparse or imperfect.

Latest papers

CardsList

464 papers42 papers in the last four weeks, down 53% on the four weeks before. 0.3% of all new papers.

  1. RL Post-Training in Diffusion Transformers Is Activation Steering

    Nov 19, 2026Tuna Han Salih Meral, Kaan Oktay, Alec Helbling +3RL Post-TrainingRL for Diffusion Models

  2. Better Rankers, Worse Retrievers: The Hidden Cost of RL Post-Training in Generative Recommendation

    Nov 17, 2026Yuheng Chen, Fan Zhang, Yixuan Xu +3Recommender SystemsRL for Recommendation

  3. A Survey on RLOps for Large Language Models

    Nov 17, 2026Lingzhe Zhang, Tong Jia, Chiming Duan +7Reinforcement LearningLLM Training

  4. TIDE: Reclaiming Lost Performance In On-Policy Reinforcement Learning

    Nov 13, 2026Mathew Jacob, Morgan Borjigin-Wang, Kan Zhu +10RL Post-TrainingLLM Inference Scheduling

  5. Outside the Purview of the Reward: Capability Drift in Multilingual Post-Training

    Nov 11, 2026Sutanshu Saksena Raj, Purusharth Malik, Pasunuti Prasanjith +3RL Post-TrainingReward Hacking

  6. Trait Hitchhiking in LLM Post-Training

    Nov 10, 2026Adil Soubki, Elizabeth S. Z. Tan, Miles CranmerLanguage Model Post-TrainingRL Post-Training

  7. A Theory of Policy Optimization in Post-Training: Coverage Collapse and Reference Resets

    Nov 10, 2026Audrey Huang, Nan Jiang, Sham M. Kakade +3Policy OptimizationRL Post-Training

  8. Train High, Ship Low: Efficient LoRA Synchronization for Distributed On-Policy Post-Training

    Nov 9, 2026Shenghui Li, Li Ju, Thiemo VoigtCommunication-Efficient Distributed TrainingGradient Compression

  9. Reframe: Observation-Aligned Multi-Teacher On-Policy Distillation for Agentic Visual Reasoning

    Nov 9, 2026Haozhi Yuan, Handong Li, Yifan Zhang +1Multi-Teacher On-Policy DistillationRL Post-Training

  10. Agentic-OPD: Recovering Forgotten Agent Capabilities via On-Policy Distillation for Agentic Tasks

    Nov 9, 2026Tingcheng Bian, Kangye Gong, Jinchang Luo +6On-Policy DistillationRL Post-Training

  11. Spectral Rank and Step-Direction Dynamics in Language-Model Post-Training

    Nov 9, 2026Khurram Khalil, Khaza Anuarul HoqueTransformer Training DynamicsRL Post-Training

  12. BRAT: Bounded Residual-Aligned Training for Stable Multi-Pass LLM Post-Training

    Nov 7, 2026Xunlan Zhou, Yuzhe Zhao, Xuhong Huang +4RL for Language ModelsReinforcement Learning

  13. AdaFloor: Adaptive Floor Planning and Rank-Time Reuse for Long-Tail MoE RL Rollouts

    Nov 4, 2026Jia Wei, Ziyi Qiu, Yi Xu +1RL Post-TrainingReinforcement Learning

  14. The Cost of Mismatch: Noise Amplification in Zeroth-Order Reinforcement Learning

    Nov 2, 2026Lianmin Chen, Junbin Qiu, Chenxing Wei +2Zeroth-Order OptimizationRL Post-Training

  15. Forecasting How RLHF Responds to Reward-Model Edits Before Training

    Nov 2, 2026Zixiao Wang, Duzhen Zhang, Xingbo Du +2Reinforcement LearningRL Post-Training

  16. Controlling Sharpening in LLM Post-Training

    Nov 2, 2026Simon Matrenok, Nicolas Menet, Nicolas Flammarion +1RL Post-TrainingKL-Regularized RL

  17. Beyond Validation Loss: Coverage and Reliability Dynamics in Robot Policy Pretraining

    Nov 1, 2026Zhanyi Sun, Max Simchowitz, Shuran SongRobot LearningRobotic Policy Evaluation

  18. Subliminal Reinforcement Learning: traits travel through a judge's scores

    Oct 30, 2026Keuntae Kim, Yong Suk ChoiSubliminal LearningReinforcement Learning

  19. Steering Vectors as a Training Signal in LLM Post-Training

    Oct 29, 2026Tiejin Chen, Maunil Vyas, Huaiyuan Yao +1LLM Post-TrainingActivation Steering