Diffusion-Based Reinforcement Learning Methods

Ask about this topic

Momentum

5 papers in the last four weeks, up 25% on the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 49

All topics
CardsList

  1. ExploreNet: Learning Where to Explore in Diffusion GRPO

    Sep 29, 2026Shuyue Stella Li, Xiaochuang Han, Yulia Tsvetkov +1Diffusion-Based Reinforcement Learning MethodsDiffusion Models

    University of Washington

  2. Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL

    Sep 29, 2026Songlin Yang, Xiaotong Zhao, Jiacheng Zhang +5Diffusion-Based Reinforcement Learning MethodsDiffusion Alignment

    Tencent Video · The University of Hong Kong

  3. Diffusion Policy Improvement with Proposal-Conditioned Refinement Flows

    Sep 29, 2026Junhyun Ha, Juho Lee, Byoungwoo ParkFlow PoliciesDiffusion-Based Reinforcement Learning Methods

    KAIST

  4. Elucidating the Design Space of Regression-based Diffusion Reinforcement Learning

    Sep 27, 2026Toyota Li, David Zhao, Alan ZhaoDiffusion-Based Reinforcement Learning MethodsReward Gradients

    Tencent

  5. AV-GRPO: Modality-Anchored Decoupling Diffusion Reinforcement Learning for Joint Audio-Video Generation

    Sep 24, 2026Zhiyu Xu, Weilong Yan, Yufei Shi +4Audio-Video GenerationDiffusion-Based Reinforcement Learning Methods

    Shanghai AI Laboratory · The Hong Kong Polytechnic University · National University of Singapore +2

  6. Performance-Preserving Online Adaptation in Social Navigation via Diffusion Steering

    Sep 21, 2026Haruto Nagahisa, Kohei Matsumoto, Yuki Hyodo +1Diffusion-Based Reinforcement Learning MethodsRobot Navigation

    Graduate School of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan · Faculty of Information Science and Electrical Engineering, Kyushu University, Fukuoka, Japan

  7. CanvasAnneal: Curriculum Reinforcement Learning for Diffusion Language Models

    Sep 14, 2026Blake Olson, Yuhang Song, Emmett McQuinn +1Diffusion Language ModelsDiffusion-Based Reinforcement Learning Methods

    Google DeepMind

  8. LeanGRPO: Eliminating Redundant Recomputation in Diffusion RL

    Sep 3, 2026Sijie Wang, Zhiqiang Tan, Xinrui Yang +1Diffusion-Based Reinforcement Learning MethodsReward Gradients

    School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen

  9. Multi-AUV Ad-hoc network-based Target Tracking: A Value Gradient Guidance Multi-Agent Diffusion Reinforcement Learning Approach

    Aug 12, 2026Jiaao Ma, Chuan Lin, Guangjie Han +4Multi-Agent Reinforcement LearningMulti-Uav

    Software College, Northeastern University, Shenyang, China · Key Laboratory of Maritime Intelligent Network Information Technology, Ministry of Education, Hohai University, Changzhou, China · College of Computer Science and Software Engineering, Hohai University, Nanjing, 210013, China

  10. RL-Native Distillation: Exploiting Scored Trajectories for Few-Step Image Generation

    Aug 10, 2026Yuhan Li, Fangao Zeng, Sicong Kang +7Diffusion-Based Reinforcement Learning MethodsImage Generation

    Shanghai Jiao Tong University · Taobao & Tmall group of Alibaba

  11. PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Diffusion-Based Reinforcement Learning MethodsDiffusion Models

    Peking University Beijing, China

  12. Beyond On-Policy Exploration: Integrating External Policy Rollouts for Reinforcement Learning in Diffusion Language Models

    Aug 3, 2026Wonseok Lee, Jimyeong Kim, Jungmin Ko +1Large Language Model Reinforcement LearningAutoregressive Rollout

    Interdisciplinary Program in Artificial Intelligence, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea · Artificial Intelligence Institute, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea · Department of Intelligence and Information, Seoul National University, 1 Gwanak-ro, Gwanak-gu, Seoul, 08826, South Korea

  13. X-NavDP: Generalizing Navigation Diffusion Policy to Novel Behavior and Embodiments with Group Q-score Reweighted Matching

    Jul 30, 2026Tianyu Yang, Yiming Zeng, Wenzhe Cai +5Diffusion-Based Reinforcement Learning MethodsDiffusion Policies

    1Fudan University · 3Sun Yat-sen University · 2Shanghai AI Laboratory +1

  14. A Continuous-Time Reinforcement Learning Framework for Fine-Tuning Discrete Diffusion Models

    Jul 16, 2026Zikun Zhang, Jiayuan Sheng, David D. Yao +1Diffusion-Based Reinforcement Learning MethodsScore-Based Diffusion Model

    Department of Industrial Engineering and Operations Research, Columbia University, New York, NY 10027

  15. Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF

    Jul 8, 2026Eric Zhu, Abhinav Shrivastava, Soumik MukhopadhyayDiffusion-Based Reinforcement Learning MethodsReinforcement Learning From Human Feedback

    Carnegie Mellon University · University of Maryland, College Park

  16. SLIM-RL: Risk-Budgeted Random-Masking RL for Diffusion LLMs Without Trajectory Slicing

    Jun 30, 2026Ruikang Zhao, Zhenting Wang, Han Gao +1Diffusion Language ModelsLarge Language Model Reinforcement Learning

    Technical University of Denmark · MBZUAI Institute of Foundation Models · Iowa State University +1

  17. RS-Diffuser: Risk-Sensitive Diffusion Planning with Distributional Value Guidance

    Jun 26, 2026Shiqiang GongDiffusion-Based Reinforcement Learning MethodsModel-Based Reinforcement Learning

    Northwestern Polytechnical University

  18. Accelerating Disaggregated RL for Visual Generative LLMs with Diffusion-Based Parallelism and Trainer-Assisted Generation

    Jun 23, 2026Sijie Wang, Zhengyu Qing, Zhiqiang Tan +6Diffusion-Based Reinforcement Learning MethodsDiffusion Language Models

    School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen · Data Science and Analytics Thrust, The Hong Kong University of Science and Technology (Guangzhou) · Huawei Technologies Ltd.

  19. Scalable Maximum Entropy Reinforcement Learning for Diffusion Policies via Adjoint Matching

    Jun 21, 2026Serge Thilges, Onur Celik, Denis Blessing +2Diffusion-Based Reinforcement Learning MethodsDiffusion Policies

    Autonomous Learning Robots, Karlsruhe Institute of Technology

  20. Spotlight: Synergizing Seed Exploration and Spot GPUs for DiT RL Post-Training

    Jun 17, 2026Ruiqi Lai, Dakai An, Wei Gao +6Diffusion-Based Reinforcement Learning MethodsReinforcement Learning Post-Training

    NTU Singapore · Hong Kong University of Science and Technology · Alibaba Group

  21. Diffusion Offline Reinforcement Learning for Fair and Energy-Efficient UAV-Assisted Wireless Networks

    Jun 15, 2026Eslam Eldeeb, Hirley AlvesDiffusion-Based Reinforcement Learning MethodsOffline Reinforcement Learning

    Centre for Wireless Communications (CWC), University of Oulu, Finland

  22. Trust-Region Diffusion Policies for Massively Parallel On-Policy RL

    Jun 13, 2026Huy Le, Onur Celik, Denis Blessing +6Diffusion-Based Reinforcement Learning MethodsDiffusion Policies

    Bosch Center for Artificial Intelligence · Autonomous Learning Robots, KIT · University of Texas at Austin +1

  23. Test-Time Gradient Guidance of Flow Policies in Reinforcement Learning

    Jun 9, 2026Zhiyuan Zhou, Andy Peng, Charles Xu +4Flow PoliciesDiffusion-Based Reinforcement Learning Methods

    UC Berkeley · Physical Intelligence

  24. Fast and Highly Expressive Policy Learning for Offline Reinforcement Learning via Bootstrapped Flow Q-Learning

    Jun 9, 2026Thanh Nguyen, Tri Ton, Hongbin Choe +2Diffusion-Based Reinforcement Learning MethodsFlow Policies

    Department of Electrical Engineering, KAIST, Daejeon, Korea.

  25. Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Models

    Jun 7, 2026Yawen Shao, Jie Xiao, Kai Zhu +6Large Language Model Reinforcement LearningDiffusion Language Models

    University of Science and Technology of China · Tongyi Lab · Northeastern University

  26. Read the Trace, Steer the Path: Trajectory-Aware Reinforcement Learning for Diffusion Language Models

    Jun 3, 2026Anant Khandelwal, Manish GuptaLarge Language Model Reinforcement LearningDiffusion Language Models

    Microsoft AI, India

  27. Drift Q-Learning

    May 29, 2026Anas Houssaini, Mohamad H. Danesh, Amin Abyaneh +3Diffusion-Based Reinforcement Learning MethodsFlow Policies

    McGill University · Mila - Quebec AI Institute

  28. Sample-Efficient Diffusion-based Reinforcement Learning with Critic Guidance

    May 28, 2026Shutong Ding, Zejia Zhong, Zhongyi Wang +4Diffusion-Based Reinforcement Learning MethodsAction Generation

    1ShanghaiTech University.

  29. Explicit Critic Guidance for Aligning Diffusion Models

    May 26, 2026Zhengyang Liang, Qihang Zhang, Ceyuan YangDiffusion AlignmentDiffusion-Based Reinforcement Learning Methods

    University of Toronto · Vector Institute · The Chinese University of Hong Kong

  30. Reinforcement Learning from Denoising Feedback

    May 25, 2026Qi He, Huan Chen, Ya Guo +3Large Language Model Reinforcement LearningDiffusion-Based Reinforcement Learning Methods

    Fudan University · Ant Group · Hong Kong University of Science and Technology

  31. Cross-Domain Energy-Guided Diffusion Generation for Off-Dynamics Reinforcement Learning

    May 24, 2026Yu Yang, Yihong Guo, Anqi Liu +1Diffusion-Based Reinforcement Learning MethodsOffline Reinforcement Learning

    Duke University · Johns Hopkins University

  32. Score-Based One-step MeanFlow Policy Optimization

    May 22, 2026Kyungyoon Kim, Donghyeon Ki, Hee-Jun Ahn +1Flow PoliciesMeanflow

    Korea University, Decision Making Lab · Gauss Labs Inc.

  33. Beyond Execution: Static-Analysis Rewards and Hint-Conditioned Diffusion RL for Code Generation

    May 16, 2026Shuyin Ouyang, Zhaozhi Qian, Faroq AL-Tam +2Code GenerationDiffusion-Based Reinforcement Learning Methods

    King’s College London · Elm Europe

  34. Do Less, Achieve More: Do We Need Every-Step Optimization for RL Fine-tuning of Diffusion Models?

    May 15, 2026Renye Yan, Jikang Cheng, Shikun Sun +7Diffusion-Based Reinforcement Learning MethodsReinforcement Fine-Tuning

    1Peking University · 2Tsinghua University · 3Nanjing University +1

  35. OmniNFT: Modality-wise Omni Diffusion Reinforcement for Joint Audio-Video Generation

    May 12, 2026Guohui Zhang, XiaoXiao Ma, Jie Huang +9Audio-Video GenerationDiffusion-Based Reinforcement Learning Methods

    University of Science and Technology of China · JD Explore Academy · Peking University

  36. dFlowGRPO: Rate-Aware Policy Optimization for Discrete Flow Models

    May 10, 2026Zhengyan Wan, Yidong Ouyang, Panwen Hu +1Flow ModelsDiffusion-Based Reinforcement Learning Methods

    Mohamed bin Zayed University of Artificial Intelligence · East China Normal University · University of California, Los Angeles +1

  37. TMPO: Trajectory Matching Policy Optimization for Diverse and Efficient Diffusion Alignment

    May 9, 2026Jiaming Li, Chenyu Zhu, Nanxi Yi +9Diffusion AlignmentDiffusion-Based Reinforcement Learning Methods

    1MAIR Lab, Huazhong University of Science and Technology · 2Kuaishou Technology · 3Nanyang Technological University +2

  38. Diffusion-APO: Trajectory-Aware Direct Preference Alignment for Video Diffusion Transformers

    May 8, 2026Jingyuan Zhu, Biaolong Chen, Le Zhang +3Diffusion AlignmentVideo Diffusion Models

    Alibaba Group

  39. DACA-GRPO: Denoising-Aware Credit Assignment for Reinforcement Learning in Diffusion Language Models

    May 8, 2026Amin Karimi Monsefi, Dominic Culver, Nikhil Bhendawade +4Diffusion-Based Reinforcement Learning MethodsDiffusion Language Models

    The Ohio State University · Apple

  40. MARBLE: Multi-Aspect Reward Balance for Diffusion RL

    May 7, 2026Canyu Zhao, Hao Chen, Yunze Tong +3Diffusion-Based Reinforcement Learning MethodsDiffusion Alignment

    Zhejiang University · Work done during an internship at HiThink. · HiThink +1

  41. Arena as Offline Reward: Efficient Fine-Grained Preference Optimization for Diffusion Models

    May 7, 2026Zhikai Li, Yue Zhao, Edward Zhongwei Zhang +4Diffusion-Based Reinforcement Learning MethodsDiffusion Models

    Institute of Automation, Chinese Academy of Sciences · University of California, Berkeley · University of California, Santa Barbara

  42. FASTER: Value-Guided Sampling for Fast RL

    Apr 21, 2026Perry Dong, Alexander Swerdlow, Dorsa Sadigh +1Diffusion-Based Reinforcement Learning MethodsOffline Reinforcement Learning

    Stanford University

  43. UDM-GRPO: Stable and Efficient Group Relative Policy Optimization for Uniform Discrete Diffusion Models

    Apr 20, 2026Jiaqi Wang, Haoge Deng, Ting Pan +5Diffusion-Based Reinforcement Learning MethodsDiffusion Models

    Beijing University of Posts and Telecommunications · Beijing Academy of Artificial Intelligence

  44. Mean Flow Policy Optimization

    Apr 16, 2026Xiaoyi Dong, Xi Sheryl Zhang, Jian ChengFlow PoliciesDiffusion-Based Reinforcement Learning Methods

    C2DL, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · AiRiA +1

  45. Rethinking the Design Space of Reinforcement Learning for Diffusion Models: On the Importance of Likelihood Estimation Beyond Loss Design

    Feb 4, 2026Jaemoo Choi, Yuchen Zhu, Wei Guo +6Diffusion-Based Reinforcement Learning MethodsReward Gradients

    Georgia Institute of Technology · National University of Singapore · Nanjing university.

  46. ReDiF: Resource-Efficient Few-Step Diffusion Distillation via Reinforcement Learning

    Dec 28, 2025Amirhossein Tighkhorshid, Zahra Dehghanian, Hamid R. RabieeDiffusion-Based Reinforcement Learning MethodsDiffusion Sampling

    Computer Engineering Sharif University of Technology

  47. Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning

    Dec 1, 2025Sebastian Sanokowski, Kaustubh Patil, Majid KhadivDiffusion-Based Reinforcement Learning MethodsMarkov Decision Processes

    Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University Munich · Practical Project Student Exchange Program, Technical University Munich · MIT World Peace University

  48. Enhancing Reasoning for Diffusion LLMs via Distribution Matching Policy Optimization

    Oct 9, 2025Yuchen Zhu, Wei Guo, Jaemoo Choi +4Large Language Model Reinforcement LearningDiffusion Language Models

    Georgia Institute of Technology.

  49. DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models

    Date pendingQuanhao Li, Junqiu Yu, Kaixun Jiang +7Diffusion-Based Reinforcement Learning MethodsOnline-Policy Distillation

    Fudan University, China · Alibaba Group, China