RL for Legged Locomotion

RL: Reinforcement Learning

Overview

This field studies how quadruped and humanoid robots can learn coordinated walking, running, jumping, and navigation while staying balanced and managing contact with the ground. Common approaches train actor–critic policies such as PPO in simulation, using reward shaping and curricula; others add motion-imitation priors, perception, learned dynamics, or model-predictive control. Researchers test policies in simulators and on hardware across settings such as stairs, gaps, rough or deformable terrain, payloads, and external pushes, often using teacher–student distillation to transfer privileged simulation training to real sensors. A central challenge is achieving reliable, safe sim-to-real transfer and broad terrain or morphology generalization without sacrificing efficiency, natural motion, or energy use.

Latest papers

CardsList

166 papers33 papers in the last four weeks, up 106% on the four weeks before. 0.2% of all new papers.

  1. HC2Robot: Hyper-Connection Transformers with Predicted Foresight for Multi-Terrain Humanoid Parkour

    Oct 27, 2026Wenhao Xu, Yanheng Mai, Yifei Fu +6Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  2. REACH: An RL-based Hierarchical Humanoid Crawling Framework for Adaptable Confined Space Traversal

    Oct 27, 2026Shengzhang Xu, Yuning Guo, Weiyi Hu +3Humanoid Robot LocomotionRL for Legged Locomotion

  3. Differentiable Contact Dynamics for Legged Locomotion: Policy Learning and Contact-Implicit Trajectory Optimization

    Oct 26, 2026Gijeong Kim, Seungbin Oh, Dongyun Kang +1Differentiable PhysicsTrajectory Optimization

  4. Humanoid Mobility via Attention-based Contacts

    Oct 22, 2026Junzhe He, Kehan Wen, Chong Zhang +7Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  5. Do Earth-Trained Humanoid Controllers Walk on the Moon? Gravity, Terrain, and Soil Transfer

    Oct 21, 2026Guillem Casadesus Vila, Sri Aditya Deevi, Grace X. GaoHumanoid Robot LocomotionLegged Robotics

  6. Watch Your Step: Anticipated Perception for Humanoid Locomotion

    Oct 21, 2026Matthias Heyrman, Chenhao Li, Ioannis Dadiotis +1Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  7. End-to-End Reinforcement Learning for Quadrupedal Jumping in Lunar Gravity

    Oct 21, 2026Levin Müller, Oliver Fischer, Marco Trentini +2RoboticsRL for Legged Locomotion

  8. SkateNav: Learning Energy-Efficient Navigation through Adaptive Skating on Passive-Wheel Quadrupedal Robots

    Oct 19, 2026Jeil Jeong, Taeyun Kim, Sangjin Kim +2Robot LocomotionQuadruped Robot Navigation

  9. Learning Structured Locomotion References for Optimization-Based Whole-Body Control

    Oct 17, 2026Ömer Tarık Banuş, Uluç Saranlı, M. Mert AnkaralıRobot LocomotionQuadruped Locomotion

  10. Towards Reinforcement Learning for Space Robotics: Fast Training and Reliable Real-World Transfer

    Oct 16, 2026Abhishek Naik, Michael Wu, Michael O'Sullivan +2RL for RoboticsRL for Legged Locomotion

  11. Reinforcement Learning Based Multi-Terrain Adaptive Whole-Body Control for a Quadruped Manipulator

    Oct 16, 2026Yanzhou Jin, Fei Suo, Chang Liu +5Legged RoboticsWhole-Body Control

  12. Efficient Test-Time Adaptation For Robot Policies

    Oct 14, 2026Motasem Alfarra, Pietro Mazzaglia, Markus Peschl +2Robot Policy AdaptationTest-Time RL

  13. Safe Reinforcement Learning with Receding-Horizon Safety Critic and Differentiable Action Shields

    Oct 14, 2026Siwei Ju, Jan Peters, Oleg ArenzSafe RLSafety Filtering

  14. E2DRL: End-to-End Differentiable Reinforcement Learning for 3D Obstacle Avoidance in Quadruped Robots

    Oct 14, 2026Cheng Fan, Bingyang Zhou, Gang Yang +7Reinforcement LearningRobot Collision Avoidance

  15. Locomotion with Online Awareness of Dynamics for Precision Footholds

    Oct 13, 2026Kunzhao Ren, Zhishuo Zhu, Xiaobin XiongRobot LocomotionRL for Legged Locomotion

  16. SHOES: Sim-to-real Hardware-adaptation via On-policy Expansion of Skills for Legged Robots

    Oct 12, 2026Kota Tsuruhara, Tsung-Yuan Chen, Kento KawaharazukaRobot Policy AdaptationRobot Locomotion

  17. PointWalker: Mapless Quadruped Locomotion Directly From Raw LiDAR Point Clouds

    Oct 11, 2026Sicen Li, Zhen Chu, Chao Li +3Quadruped LocomotionLegged Robotics

  18. A Balanced Data Diet: Addressing the Exploration Bottleneck in Mega-Scale RL for Robot Control

    Oct 8, 2026Octi Zhang, Mateo Guaman Castro, Patrick Yin +4Robotic RLData-Efficient Robot Learning

  19. A Geometric Approach to Soft Actor-Critic with Zonotopes for Locomotion Learning

    Oct 8, 2026Panagiotis Roditis, Panagiotis P. Filntisis, Petros MaragosReinforcement LearningSoft Actor-Critic

  20. Higher-Order Morphology Priors for Quadruped Reinforcement Learning Under Actuator Degradation

    Oct 7, 2026Derek You, Zafir Shamsi, Keqin Wang +1Higher-Order GNNsRL for Legged Locomotion

  21. HuMBLE: Human Motion-Driven Behavior Learning for Embodied Locomotion

    Oct 7, 2026Mike Zhang, Dongho Kang, Kevin Bergamin +19Human-to-Robot Motion ImitationHumanoid Robot Locomotion

  22. Teaching a Robot Dog New Tricks: Diverse Quadruped Skills via Combined Reinforcement and Imitation Learning with Adversarial Task Selection

    Oct 6, 2026Lemon Foxmere, Anthony Furman, Yizheng Du +3Robot Skill LearningMulti-Task RL

  23. QF3: Fast Flow RL with Filtered Q-Gradients

    Oct 6, 2026Chung Min Kim, Brent Yi, David McAllister +7Robotic RLRL for Legged Locomotion

  24. Hierarchical Reinforcement Learning for Collision-Free Locomotion of an Underactuated Biped

    Oct 5, 2026Jagannath Prasad Sahoo, Saurabh Kumar, Surya Prakash S. K. +3Legged RoboticsHierarchical RL

  25. ROOT: Discovering Rewards for User-Specified Embodied Behaviors

    Oct 3, 2026Eren Sadikoglu, Aditya Taparia, Xinyuan Liu +1Reward Design for RLRobotic RL

  26. Humanoid Rickshaw Pulling: Whole-Body Locomotion under Coupled Wheeled Loads

    Oct 3, 2026Yangzhi Yang, Xiansheng Lin, Zhaoming Xie +1Humanoid Robot ControlHumanoid Robot Locomotion