Proximal Policy Optimization

Ask about this topic

Momentum

12 papers in the last four weeks, up 71% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 68

All topics
CardsList

  1. Reinforcement Learning to Accelerate Primal-Dual Hybrid Gradient for Linear Programming

    Oct 1, 2026Jinhwan Sul, Alex Oshin, Evangelos A. TheodorouLinear ProgrammingPrimal-Dual Methods

    Georgia Institute of Technology, USA

  2. Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?

    Oct 1, 2026Alessandro Montenegro, Riccardo Venturelli, Marco Mussi +2Proximal Policy OptimizationOff-Policy Learning

    Politecnico di Milano, Milan, Italy · Università degli Studi di Milano, Milan, Italy

  3. PPO-HRAP: Proximal Policy Optimization with a Hybrid Regime-Aware Policy for Risk-Controlled Trading

    Oct 1, 2026Duong Hien Chi Kien, Thanh Trung HuynhProximal Policy OptimizationTrading

    College of Engineering and Computer Science, VinUniversity Ha Noi, Viet Nam

  4. DashVMC: Real-Time Discrete World Model Control in Geometry Dash

    Sep 30, 2026Florent Tariolle, Florian YgerEfficient World-Action ModelBehavior Cloning

    INSA Rouen Normandy

  5. Advancing Entropy-Level Credit Assignment in RLVR via Proximal Entropy Policy Optimization

    Sep 30, 2026Yun Kim, Nojun KwakReinforcement Learning With Verifiable RewardToken-Level Entropy

    Seoul National University

  6. Action Chunking Proximal Policy Optimization with Feedback Correction

    Sep 28, 2026Sanghyun Hahn, Jonghyun ChoiAction ChunksProximal Policy Optimization

    Cornell University · Seoul National University

  7. Spiking Neural Network Actor-Critic Proximal Policy Optimization Control for Autonomous UAV Navigation Through Constrained Openings in Civil Infrastructure and Buildings

    Sep 20, 2026Francis Noah Walugembe, Maciej Wielgosz, Tomaž Goričan +1Unmanned Aerial VehiclesAutonomous Navigation

    Applied Intelligence PhD Programme, Alma Mater Europaea University, Maribor, Slovenia · Faculty of Computer Science, Electrical and Telecommunications, AGH University of Krakow, 30-059 Krakow, Poland · Alma Mater Europaea University, Maribor, Slovenia

  8. Cost-Aware Reinforcement Learning with Action Masking and Projection for Battery Energy Storage Dispatch under Suppressed-Spread Market Shifts

    Sep 20, 2026Kuanlin Chen, Chen-Wei Kuo, Cheng-En OuBattery Energy Storage SystemsProximal Policy Optimization

    Independent Researcher Taoyuan, Taiwan · National Tsing Hua University Hsinchu, Taiwan · Independent Researcher

  9. Rethinking Critic Learning in PPO: Understanding and Mitigating Value Flattening

    Sep 16, 2026Yizhuo Li, Jianhao Yan, Yun Luo +9Proximal Policy OptimizationCritic Learning

    Shanghai Jiao Tong University · Shanghai AI Laboratory · Westlake University +4

  10. Fast-Convergent Meta-RL via Gradient-Clustered BS Sampling for Edge Caching

    Sep 14, 2026Farnaz Niknia, Ping WangProximal Policy OptimizationOffline Reinforcement Learning

    Lassonde School of Engineering at York University, Toronto, ON, M3J 1P3, Canada

  11. Learning to Exploit Passive Dynamics for Energy-Efficient Target Hopping of a Spring-Legged Quadcopter

    Sep 14, 2026Ruigang Chen, Qi Zhang, Zhicheng Zhong +3QuadrotorBidirectional Thrust

    Department of Mechanical Engineering and Robotics, Guangdong Technion - Israel Institute of Technology, Shantou, 515063, Guangdong, China. · Department of Mechanical Engineering, Technion-Israel Institute of Technology, Haifa, 3200003, Israel.

  12. Train What You Deploy:Token-Faithful Post-Training of a Production Coding

    Sep 7, 2026Cheng Li, Jiexiong Liu, Yixuan Chen +1Post-TrainingSingle-Token Output Distributions

    KunlunMeta

  13. EF1-Constrained Nash Social Welfare with Identical Additive Valuations: Complexity, Guarantees, and Experiments

    Sep 3, 2026Zih-Sian Yang, Yi-Hao Chen, Yu-Te Kuan +3WelfareNash Equilibrium

    National Taiwan Ocean University, Keelung City 202301, Taiwan · National Yang Ming Chiao Tung University, Hsinchu City 300, Taiwan

  14. Multi-step Proximal Policy Improvement in Offline Reinforcement Learning

    Sep 3, 2026Soohyun Choi, Seonvin Cho, Songnam HongProximal Policy OptimizationOffline Reinforcement Learning

    Department of Electronic Engineering, Hanyang University, Seoul, Republic of Korea

  15. PPO-STGNN: A Proximal Policy Optimization Approach with Spatio-Temporal Graph Neural Networks for DAG Task Scheduling in Cloud-Edge-End Computing

    Sep 3, 2026Yangshuo Qi, Chenwei Wang, Zihan Shen +1SchedulersEdge Platforms

    Beijing University of Posts and Telecommunications, Beijing, China · Google, Mountain View, USA · NanJing University, NanJing, China

  16. ProxPI: Proximal Prior Injection for Sampling-Based MPC under Learned-Prior Mismatch

    Sep 1, 2026Euncheol Im, Myotaeg Lim, Yisoo LeeModel Predictive Path IntegralProximal Policy Optimization

    Center for Humanoid Research, Korea Institute of Science and Technology (KIST), 02792 Seoul, South Korea · School of Electrical Engineering, Korea University, 02841 Seoul, South Korea

  17. A Closed-Loop Evaluation of Capability Loss and Recovery in Compressed Driving Policies

    Sep 1, 2026Ahmad Alfan Alfian Irfan, Nur Ahmad Khatim, Mansur AriefProximal Policy OptimizationClosed Loop

    Information Technology, Universitas Muhammadiyah Yogyakarta, Indonesia · Division of Information Science, Nara Institute of Science and Technology (NAIST), Japan · Industrial and Systems Engineering (ISE) Department and IRC for Smart Mobility and Logistics (IRC-SML), King Fahd University of Petroleum and Minerals (KFUPM), Saudi Arabia

  18. BCPPO: Bachelier-Inspired Constrained Proximal Policy Optimization for Tail-Risk-Aware Safe Reinforcement Learning

    Aug 31, 2026Dongsheng Hou, Yanqiao Chen, Yuhan RuiConditional-Value-At-RiskProximal Policy Optimization

    Southern University of Science and Technology

  19. Satellite Trajectory Optimization via Proximal Policy Optimization for Space Debris Avoidance

    Aug 10, 2026Logan Luna, Juan Ortiz Couder, Raul Alejandro Vargas-AcostaCollision AvoidanceIntent-Aligned Autonomous Spacecraft Guidance

    Georgia Institute of Technology · Department of Electrical Engineering and Computer Science, Embry-Riddle Aeronautical University, Daytona Beach, FL 32114 USA · Present address: School of Computer Science, College of Computing, Georgia Institute of Technology, Atlanta, GA 30332 USA +1

  20. SP3O: Reinforcement Learning from Segment Preferences without Reward Modeling

    Aug 3, 2026Evan Assmus, Qining Zhang, Lei YingReward-Only Policy Optimization VariantsProximal Policy Optimization

    University of Michigan, Ann Arbor

  21. Start Classifying: Categorical Critics for LLM Reinforcement Learning

    Aug 3, 2026Zhijian Zhou, Long Li, Xuan Zhang +7Large Language Model Reinforcement LearningCritic-Free Reinforcement Learning

    Fudan University · Shanghai Innovation Institute · Tencent YoutuLab +2

  22. P3: Probabilistic Policy Propagation for Stable VAE-Based Robot Learning

    Jul 28, 2026Liyun Yan, Jianming Ma, Yang Zhang +5Proximal Policy OptimizationRobot Policies

    Shanghai Jiao Tong University, Shanghai, China · Shanghai Innovation Institute, Shanghai, China · Tongji University, Shanghai, China +1

  23. Towards Robust Reinforcement Learning for Small-Scale Language Model Agents

    Jul 27, 2026Md Rezwanul Haque, Md. Milon Islam, Fakhri KarrayLarge Language Model Reinforcement LearningSmall Large Language Models

    Centre for Pattern Analysis and Machine Intelligence, Department of Electrical and Computer Engineering, University of Waterloo, N2L 3G1, Ontario, Canada · Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, Bangladesh · Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates

  24. Approximate Quantum State Preparation Through Proximal Policy Optimization

    Jul 23, 2026Marco Mordacci, Michele AmorettiQubitProximal Policy Optimization

    Quantum Software Laboratory, University of Parma, Parco Area delle Scienze, 181/A, Parma, 43124, Italy.

  25. Safe and Scalable Multi-Drone Payload Transport via CBF-based Reinforcement Learning with Zero-Shot Sim-to-Real Transfer

    Jul 22, 2026Jaeyoun Choi, Oswin So, Songyuan Zhang +2Multi-Drone CoordinationMulti-Robot Systems

    Reliable Autonomous Systems Lab, Massachusetts Institute of Technology, Cambridge, MA, USA

  26. SafeExplorer: An Unbiased Policy Gradient for Reinforcement Learning with Recovery Interventions

    Jul 9, 2026Elham Daneshmand, Majid Khadiv, Glen Berseth +1Proximal Policy OptimizationPolicy Gradient

    McGill University · Mila · Technical University of Munich +1

  27. MPFlow: Learning Budgeted Max-Flow Optimization on the Lightning Network with Deep Graph Reinforcement Learning

    Jul 9, 2026Harrison Rush, Vincent Davis, Simone Antonelli +3Bringing Network CodingFlow Policies

    Amboss Technologies, Green Cove Springs, USA · CISPA Helmholtz Center for Information Security · Stillmark, San Francisco, USA +1

  28. Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF

    Jul 8, 2026Eric Zhu, Abhinav Shrivastava, Soumik MukhopadhyayDiffusion-Based Reinforcement Learning MethodsReinforcement Learning From Human Feedback

    Carnegie Mellon University · University of Maryland, College Park

  29. Anticipatory Reinforcement Learning for Trajectory Tracking

    Jul 3, 2026Georg Schäfer, Jakob Rehrl, Stefan Huber +1Reinforcement Learning ControlOffline Reinforcement Learning

    Josef Ressel Centre for Intelligent and Secure Industrial Automation, Salzburg University of Applied Sciences, Salzburg, Austria · Paris Lodron University of Salzburg, Salzburg, Austria

  30. Integrating Physics-Informed Neural Networks for Safe Reinforcement Learning in a 1-DoF Helicopter System

    Jul 3, 2026Georg Schäfer, Jakob Rehrl, Stefan HuberSafety ConstraintsProximal Policy Optimization

    Josef Ressel Centre for Intelligent and Secure Industrial Automation, Salzburg University of Applied Sciences, Salzburg, Austria · Paris Lodron University of Salzburg, Salzburg, Austria

  31. PS-PPO: Prefix-Sampling PPO for Critic-Free RLHF

    Jun 29, 2026Doo Hwan Hwang, Kee-Eung KimReinforcement Learning From Human FeedbackCritic-Free Reinforcement Learning

    Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea.

  32. PPO-EAL: Exact Augmented Lagrangian Proximal Policy Optimization for Safe Robotic Control

    Jun 26, 2026Jiatao Ding, Songqun Gao, Andrea Del Prete +1Safety ConstraintsProximal Policy Optimization

    Department of Industrial Engineering, University of Trento, Via Sommarive 9, 38123, Trento, Italy

  33. EVOM: Agentic Meta-Evolution of Actor-Critic Architectures for Reinforcement Learning

    Jun 24, 2026Boyun Zhang, Chao Wang, Kai WuOn-Policy Self-EvolutionSoft Actor-Critic

    Xidian University

  34. KLip-PPO: A per-sample KL perspective on PPO-Clip

    Jun 22, 2026Riccardo Colletti, Robin HolzingerProximal Policy OptimizationKullback-Leibler Divergence

    University of California, Berkeley

  35. Zone of Proximal Policy Optimization: Teacher in Prompts, Not Gradients

    Jun 16, 2026Byung-Kwan Lee, Ximing Lu, Shizhe Diao +6Proximal Policy OptimizationTeacher

    NVIDIA

  36. Proximal Policy Optimization for Amortized Discrete Sampling

    Jun 14, 2026Anna Zykova-Myzina, Timofei Gritsaev, Daniil Tiapkin +1Generative Flow NetworksProximal Policy Optimization

    HSE University · Constructor University · CMAP, CNRS, École polytechnique, IPP

  37. Flow-DPPO: Divergence Proximal Policy Optimization for Flow Matching Models

    Jun 9, 2026Bowen Ping, Xiangxin Zhou, Penghui Qi +3Proximal Policy OptimizationOffline Reinforcement Learning

    Xi’an Jiaotong University · Tencent Hunyuan · National University of Singapore

  38. A Unified Multi-Modal Framework for Intelligent Financial Systems: Integrating Reinforcement Learning, High-Frequency Trading, and Game-Theoretic Approaches with Cross-Modal Sentiment Analysis

    Jun 9, 2026Fanrong Liu, Zhang Yuwei, Mingni LuoFinancial Sentiment AnalysisMultimodal Sentiment Analysis

    Henan University, International Eurasia College, Kaifeng, Henan, China · City University of Hong Kong, College of Business, Hong Kong, China · Northeastern University, School of Electronic and Information Engineering, Seattle, United States

  39. Variational Proximal Policy Optimization

    Jun 6, 2026Ousmane Amadou DiaProximal Policy OptimizationVariational Inference

  40. Local Guidance, Global Impact: Gaussian-Reshaped Trust Region Unlocks Behavior Transitions

    Jun 2, 2026Bingxu Liu, Jiashun Liu, Johan Obando-Ceron +5Proximal Policy OptimizationTrust Region

    Hong Kong University of Science and Technology · Fudan University · Mila - Québec AI Institute +2

  41. Interpretable Policy Distillation for Power Grid Topology Control

    May 30, 2026Aleksandra Dmitruka, Karlis FreivaldsProximal Policy OptimizationPower Systems

    University of Latvia, Faculty of Exact Sciences and Technology, Riga, Latvia

  42. ESPO: Early-Stopping Proximal Policy Optimization

    May 28, 2026Zihang Li, Rui Zhou, Yingcheng Shi +8Large Language Model Reinforcement LearningProximal Policy Optimization

    1Tongyi Lab , Alibaba Group · 2Peking University

  43. Bridging the Gap: Enabling Soft Actor Critic for High Performance Legged Locomotion

    May 24, 2026Gianluca Sabatini, Chenhao Li, Marco HutterProximal Policy OptimizationSoft Actor-Critic

    ETH Zurich, Switzerland

  44. Concept Drift Adaptation Using Self-Supervised and Reinforcement Learning In Android Malware Detection

    May 22, 2026Ahmed Sabbah, Mohammad Kharma, Mohammad Alkhanafseh +3MalwareParameter-Efficient Adaptation

    Birzeit University · University of Central Florida

  45. Deep Reinforcement Learning for Flexible Job Shop Scheduling with Random Job Arrivals

    May 21, 2026Yu Tang, Muhammad Zakwan, Efe Balta +2Job Shop SchedulingQueue Control

    Centre for Artificial Intelligence, Zurich University of Applied Sciences, Switzerland · Inspire AG, Zurich, Switzerland · Automatic Control Laboratory, ETH Zurich, Switzerland

  46. Proximal State Nudging: Reducing Skill Atrophy from AI Assistance

    May 19, 2026Megha Srivastava, Jonathan Ouyang, Eric Zhou +6Unsupervised Skill DiscoveryProximal Policy Optimization

    Stanford University, Stanford, CA, USA. · University of California Los Angeles, Los Angeles, CA, USA. · Toyota Research Institute, Los Altos, CA, USA.

  47. GAE Falls Short in Imperfect-Information Self-Play Reinforcement Learning

    May 19, 2026Zhiyuan Fan, Gabriele FarinaProximal Policy OptimizationSoft Actor-Critic

    MIT

  48. Shared Backbone PPO for Multi-UAV Communication Coverage with Connection Preservation

    May 18, 2026Z. JiangMulti-UavProximal Policy Optimization

    Zhejiang University

  49. Self-Supervised On-Policy Reinforcement Learning via Contrastive Proximal Policy Optimisation

    May 13, 2026Asim Osman, Sasha Abramowitz, Mark Bergh +13Proximal Policy OptimizationGoal-Conditioned Value Function

    InstaDeep, AIMS · InstaDeep, University of Stellenbosch

  50. ERPPO: Entropy Regularization-based Proximal Policy Optimization

    May 13, 2026Changha Lee, Gyusang ChoProximal Policy OptimizationMulti-Agent Reinforcement Learning

    Korea Advanced Institute of Science and Technology, Daejeon, South Korea

  51. TOPPO: Rethinking PPO for Multi-Task Reinforcement Learning with Critic Balancing

    May 12, 2026Yuanpeng Li, Gefei Lin, Annie Qu +1Multi-Turn Reinforcement LearningProximal Policy Optimization

    UC Irvine · George Washington University · UC Santa Barbara +1

  52. Robust Multi-Agent Path Finding under Observation Attacks: A Principled Adversarial-Plus-Smoothing Training Recipe

    May 12, 2026Riad AhmedMulti-Agent Path FindingProximal Policy Optimization

    University of New Hampshire

  53. PISTO: Proximal Inference for Stochastic Trajectory Optimization

    May 8, 2026Hongzhe Yu, Zinuo Chang, Yongxin ChenRobust TrajectoryStochastic Optimization

    School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA · School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA

  54. Beyond Negative Rollouts: Positive-Only Policy Optimization with Implicit Negative Gradients

    May 7, 2026Mingwei Xu, Hao FangProximal Policy OptimizationVerifiable Rewards

    University of Washington, Seattle, USA

  55. Listwise Policy Optimization: Group-based RLVR as Target-Projection on the LLM Response Simplex

    May 7, 2026Yun Qu, Qi Wang, Yixiu Mao +11Reinforcement Learning With Verifiable RewardProximal Policy Optimization

    Department of Automation, Tsinghua University · 2LLM Department, Tencent

  56. ANO: Robust Policy Optimization via Bounded, Redescending Gain Fields

    May 4, 2026Yiheng Zhang, Yiming Wang, Kaiyan Zhao +3Proximal Policy OptimizationCollapse

    University of Macau · Wuhan University · National University of Singapore +1

  57. PPO guided Agentic Pipeline for Adaptive Prompt Selection and Test Case Generation

    May 1, 2026Gourisetty Venkata Sai Koushik, Dama Aditya, Mahankali Harish Sai +3Test GenerationAutomatic Prompt Optimization

    Department of Computer Science and Engineering, SRM University AP

  58. Sample-efficient Neuro-symbolic Proximal Policy Optimization

    Apr 28, 2026Simone Murari, Celeste Veronese, Daniele MeliProximal Policy OptimizationNeuro-Symbolic Framework

    Dept. of Computer Science, University of Verona, Italy

  59. Bounded Ratio Reinforcement Learning

    Apr 20, 2026Yunke Ao, Le Chen, Bruce D. Lee +5Proximal Policy OptimizationOffline Reinforcement Learning

    ETH Zurich · MPI for Intelligent Systems · University of Alberta +2

  60. CycleRL: Sim-to-Real Deep Reinforcement Learning for Robust Autonomous Bicycle Control

    Mar 16, 2026Gelu Liu, Teng Wang, Zhijie Wu +3Autonomous Driving SimulationSim-To-Real Reinforcement Learning

    School of Electronics and Communication Engineering and Shenzhen Key Laboratory of Navigation and Communication Integration, Sun Yat-sen University, Shenzhen 518107, China