RL for Legged Locomotion

RL: Reinforcement Learning

Overview

This field studies how quadruped and humanoid robots can learn coordinated walking, running, jumping, and navigation while staying balanced and managing contact with the ground. Common approaches train actor–critic policies such as PPO in simulation, using reward shaping and curricula; others add motion-imitation priors, perception, learned dynamics, or model-predictive control. Researchers test policies in simulators and on hardware across settings such as stairs, gaps, rough or deformable terrain, payloads, and external pushes, often using teacher–student distillation to transfer privileged simulation training to real sensors. A central challenge is achieving reliable, safe sim-to-real transfer and broad terrain or morphology generalization without sacrificing efficiency, natural motion, or energy use.

Latest papers

CardsList

180 papers17 papers in the last four weeks, down 47% on the four weeks before. 0.1% of all new papers.

  1. CADENCE: Learning Acyclic Gaits for Model-Based Quadruped Locomotion

    Nov 17, 2026Owen Sullivan, Sourav Selvaraj, Mahdi AgheliQuadruped LocomotionRobot Motion Generation

  2. Autonomous Track Racing with a Commercially Available Humanoid: System Design and Real-World Deployment

    Nov 17, 2026Koki Inami, Takashi Sato, Hiroyuki Oka +7Autonomous RacingHumanoid Robot Locomotion

  3. From Temperature-Limited to Battery-Limited Legged Locomotion

    Nov 17, 2026Raphaël Ségas, Balázs Opra, Léo Ghafari +1Robot LocomotionRL for Legged Locomotion

  4. Driving the Style: Velocity-Conditioned Whole-Body Control from Motion Demonstrations

    Nov 16, 2026Murad Dawood, Oezge Drama Berkenkamp, Antonio Gonzales Marin +1Human-to-Robot Motion ImitationWhole-Body Humanoid Control

  5. XMimic and XSoma: Learning Humanoid Motion Tracking and Locomotion in Under a Minute

    Nov 16, 2026Nico Bohlinger, Jan PetersHumanoid Motion TrackingHumanoid Robot Locomotion

  6. Reusing Locomotion Training Recipes Across Humanoids via Body-Aligned Virtual Joints

    Nov 13, 2026Sol Choi, Mingon Kim, Seokin Seo +3Humanoid Robot LocomotionCross-Embodiment Robot Learning

  7. Memory-Efficient Parallel Policy Learning for Collapse-Reactive Retreat via Hybrid Terrain Modeling

    Nov 12, 2026Yuki Kadokawa, Ritsuki Matsunaga, Yuqi Yang +2Reinforcement LearningSimulation-Based RL

  8. Koopman Model-Based Reinforcement Learning

    Nov 10, 2026Wenjian Hao, Paulo C. Heredia, Shaoshuai MouModel-Based RLRobotic Control

  9. STRIDE: Learning Humanoid Locomotion in Minutes with Acceleration-Based Rewards

    Nov 6, 2026Nico Bohlinger, Jan PetersHumanoid Robot LocomotionRobot Locomotion

  10. PhySA: Decoupling Aesthetic and Physical Rewards for Humanoid Locomotion

    Nov 5, 2026Yunwan Fu, Sicheng He, Jiageng Mao +1Humanoid Robot LocomotionRobot Locomotion

  11. H^2MARL: Hierarchical Heterogeneous Multi-agent Reinforcement Learning for Humanoid Robot Control

    Nov 4, 2026Xuemin Hu, Kaixin Li, Qingqing Xia +4Humanoid Robot ControlMulti-Agent Reinforcement Learning

  12. FOCUS: First-Order Control Using Optimal Transport Supervision for Imitation from Observations

    Oct 30, 2026João A. Cândido Ramos, Lionel Blondé, Hugues Vinzant +2Imitation LearningRobot Imitation Learning

  13. Is It the Curriculum or Just the Easy Start? Benchmarking Unsupervised Environment Design on Quadrupeds

    Oct 29, 2026Jakub Gilewicz, Dominik Galus, Piotr WojdasRobot LearningCurriculum RL

  14. HC2Robot: Hyper-Connection Transformers with Predicted Foresight for Multi-Terrain Humanoid Parkour

    Oct 27, 2026Wenhao Xu, Yanheng Mai, Yifei Fu +6Robotic ParkourHumanoid Robot Locomotion

  15. REACH: An RL-based Hierarchical Humanoid Crawling Framework for Adaptable Confined Space Traversal

    Oct 27, 2026Shengzhang Xu, Yuning Guo, Weiyi Hu +3Humanoid Robot LocomotionRL for Legged Locomotion

  16. DiffContact: Differentiable Contact Dynamics for Policy Learning and Contact-Implicit Trajectory Optimization

    Oct 26, 2026Gijeong Kim, Seungbin Oh, Dongyun Kang +1Contact-Implicit Trajectory OptimizationDifferentiable Physics

  17. Humanoid Mobility via Attention-based Contacts

    Oct 22, 2026Junzhe He, Kehan Wen, Chong Zhang +7Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  18. Do Earth-Trained Humanoid Controllers Walk on the Moon? Gravity, Terrain, and Soil Transfer

    Oct 21, 2026Guillem Casadesus Vila, Sri Aditya Deevi, Grace X. GaoHumanoid Robot LocomotionLegged Robotics

  19. Watch Your Step: Anticipated Perception for Humanoid Locomotion

    Oct 21, 2026Matthias Heyrman, Chenhao Li, Ioannis Dadiotis +1Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  20. End-to-End Reinforcement Learning for Quadrupedal Jumping in Lunar Gravity

    Oct 21, 2026Levin Müller, Oliver Fischer, Marco Trentini +2Lunar RoboticsRobotics

  21. SkateNav: Learning Energy-Efficient Navigation through Adaptive Skating on Passive-Wheel Quadrupedal Robots

    Oct 19, 2026Jeil Jeong, Taeyun Kim, Sangjin Kim +2Robot LocomotionQuadruped Robot Navigation

  22. Learning Structured Locomotion References for Optimization-Based Whole-Body Control

    Oct 17, 2026Ömer Tarık Banuş, Uluç Saranlı, M. Mert AnkaralıRobot LocomotionQuadruped Locomotion

  23. Towards Reinforcement Learning for Space Robotics: Fast Training and Reliable Real-World Transfer

    Oct 16, 2026Abhishek Naik, Michael Wu, Michael O'Sullivan +2RL for RoboticsRL for Legged Locomotion

  24. Reinforcement Learning Based Multi-Terrain Adaptive Whole-Body Control for a Quadruped Manipulator

    Oct 16, 2026Yanzhou Jin, Fei Suo, Chang Liu +5Legged RoboticsWhole-Body Control

  25. Efficient Test-Time Adaptation For Robot Policies

    Oct 14, 2026Motasem Alfarra, Pietro Mazzaglia, Markus Peschl +2Robot Policy AdaptationTest-Time RL

  26. Safe Reinforcement Learning with Receding-Horizon Safety Critic and Differentiable Action Shields

    Oct 14, 2026Siwei Ju, Jan Peters, Oleg ArenzSafe RLSafety Filtering

  27. E2DRL: End-to-End Differentiable Reinforcement Learning for 3D Obstacle Avoidance in Quadruped Robots

    Oct 14, 2026Cheng Fan, Bingyang Zhou, Gang Yang +7Reinforcement LearningRobot Collision Avoidance

  28. Locomotion with Online Awareness of Dynamics for Precision Footholds

    Oct 13, 2026Kunzhao Ren, Zhishuo Zhu, Xiaobin XiongRobot LocomotionRL for Legged Locomotion