Overview

Residual policy learning studies how to improve an existing controller or learned policy by adding a smaller corrective policy, rather than replacing the whole system. Common approaches use reinforcement learning, imitation or human feedback to train bounded action corrections, often on top of frozen vision-language-action policies, classical controllers, or simulation-trained skills. These methods are applied to settings such as robot locomotion, contact-rich manipulation, and adaptation to faults or changing dynamics, with evaluation spanning simulation benchmarks and real-robot trials. A central challenge is giving corrections enough authority to handle unfamiliar conditions while preserving the base policy’s competence, safety, and stability.

Latest papers

CardsList

73 papers10 papers in the last four weeks, down 29% on the four weeks before. 0.1% of all new papers.

  1. Residual-Guided Lightweight Reinforcement Learning for Risk-Aware Trajectory Selection with a Frozen World Model

    Nov 17, 2026Jiaqi Wu, Yongqi Dong, Yijie Zhong +6Autonomous Driving PlanningRL for Autonomous Driving

  2. Residual Reinforcement Learning for Visual Servo Control with Zero-Shot Sim-to-Real Transfer

    Nov 14, 2026Mahdi Nobar, Alisa Rupenyan, John Lygeros +1Robot Trajectory TrackingVision-Based Robot Control

  3. BRACE: Belief-guided Residual Adaptive Control for Safe Navigation under Unknown Disturbances

    Nov 7, 2026Jaeyoun Choi, Niklas Schmid, Oswin So +2Adaptive ControlRobust RL

  4. CANDO: Conservative Action-Noise Directional Optimization for Residual Reinforcement Learning

    Nov 3, 2026Zeyu Gao, Chengkai Hou, Chaoyue Li +6Robotic RLResidual Policy Learning

  5. When, Where, and What to Correct: Human-Guided Adaptive Residual Correction for Robot Policies

    Oct 27, 2026Anukriti Singh, Maxime Caniot, Pratap Tokekar +1Robot Policy AdaptationResidual Policy Learning

  6. GRAFT: Geometry-Aware Residual Adaptation for Foundation Trackers

    Oct 27, 2026Liang Li, Guoyao Zhang, Xingyu Chen +6Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  7. Tilt-Rotor Quadcopter with Learned Residual Control and Mode-Dependent State Estimation

    Oct 22, 2026Ninad Joshi, Prabhat KumarQuadrotor ControlFeedback Control

  8. OmniInteract: Towards Unified Whole-Body Interaction Control for Dual Humanoids

    Oct 19, 2026Yinghao Li, Tianyu Zhang, Zhuohao Li +4Humanoid Robot ControlHuman-Robot Collaboration

  9. Learning When to Adapt: Reactivity-Conditioned Residual Adaptation under Human-Robot Distribution Shift

    Oct 18, 2026Immanuel R. Santjoko, Benedictus C. G. Cinun, Jing Chen +1Robot Policy AdaptationSocial Robot Navigation

  10. Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance

    Oct 14, 2026Zhefei Gong, Hefeifei Jiang, Zehao Wang +1Mobile ManipulationRobotic RL

  11. Beyond Kinematic Tracking: Preserving Expressive Characteristics in Humanoid Whole-Body Control

    Oct 14, 2026Lingfan Bao, Hanshang Zhu, Yan Pan +6Whole-Body ControlHumanoid Motion Tracking

  12. OATH: Object-Agnostic Tracking for Dexterous Hands, Enabling Rapid Physics-based Retargeting

    Oct 9, 2026Solvin Sigurdson, Prasanna Sriganesh, Juan Borbon +3Motion RetargetingRobotic Manipulation

  13. LocoWM: High-Precision Locomotion through World-Model-Guided Residual Adaptation

    Sep 30, 2026Zijie Zhao, Shengqian Chen, Xiaoxu Wang +3Robot Policy AdaptationWorld Models for Robotics

  14. FailPatch: Failure Residual Patching for Vision-Language-Action Models

    Sep 28, 2026Peng Yu, Jiacheng Wang, Ziheng Zhang +6Robot Policy LearningRobot Policy Adaptation

  15. RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games

    Sep 27, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Distribution Shift RobustnessImperfect-Information Games

  16. SwingRL: Adaptive Observation Reinforcement Learning with World-Model Prediction for Cable-Suspended Hoisting Control

    Sep 27, 2026Guangming Wang, Xiaoyu Zhang, Yucheng Xin +8Robotic ControlFeedback Control

  17. Residual Denoising Enables Sample-Efficient Multi-Agent Coordination on Demand

    Sep 26, 2026Dayi Dong, Maulik Bhatt, Aayushi Shrivastava +2Multi-Agent CoordinationRobot Policy Adaptation

  18. Res-HIL: Human-Guided Residual Reinforcement Learning for Sample-Efficient Dexterous Manipulation

    Sep 24, 2026Mariia Iavorskaia, Christian Dietz, Sebastian Albrecht +1Contact-Rich Robotic ManipulationHuman-in-the-Loop AI

  19. CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Execution

    Sep 23, 2026Shuai Zeng, Yuxuan Liang, Hangmiao Hu +4Efficient VLA Model InferenceVision-Language-Action Models

  20. DynaForge: Planning-Guided Residual Learning for Dynamic Manipulation Demonstration Generation

    Sep 22, 2026Yiyang Jin, Yu Zheng, Xiao He +1Synthetic Data Generation for RoboticsRobot Motion Generation

  21. ForceRFT: Refining VLA Actions through Force-Guided Residual Reinforcement Learning

    Sep 19, 2026Yichen Wang, Chaoyang Zhang, Xuqi Su +3Robotic ManipulationVision-Language-Action Models

  22. Stability-aware Residual Reinforcement Learning Framework for Robotic Manipulator Disturbance Compensation

    Sep 18, 2026Jihong Kim, Joonhyuk Kwon, Hwa Soo Kim +2Input-to-State StabilityRobotic Control

  23. Hybrid Residual Reinforcement Learning for Contact-Rich Robotic Book Insertion

    Sep 17, 2026Tianyuan Liu, Rutherford Agbeshi Patamia, Benjamin Champion +2Contact-Rich Robotic ManipulationRobotic RL

  24. Gated Residual Body-Hand Coordination for Whole-Body Humanoid Teleoperation

    Sep 16, 2026Ruiming Wu, Shuang Li, Liding Zhang +2Bimanual Robotic ManipulationRobot Teleoperation