cs.RONov 12, 2026

Memory-Efficient Parallel Policy Learning for Collapse-Reactive Retreat via Hybrid Terrain Modeling

Authors: Yuki Kadokawa, Ritsuki Matsunaga, Yuqi Yang, Edgar Anarossi, Takamitsu Matsubara

Organizations: Fukushima Institute for Research, Education and Innovation, Namie, Fukushima 979-1521, Japan. · Nara Institute of Science and Technology, Ikoma, Nara 630-0192, Japan.

Abstract

At disaster sites and on unstable slopes, robot contact can collapse uninspected terrain, requiring retreat upon support loss. Massively parallel reinforcement learning of collapse-reactive retreat requires independent state--action experiences. However, on shared rigid-body collapsible terrain, one robot's collapse alters others' contacts without direct interaction. We call this indirect interference. Duplicating terrain objects prevents this but is memory-intensive, limiting parallel sampling. Our key insight is that policy learning does not necessarily require rigid-body collapse modeling, which is feasible but computationally expensive; collapse-induced contact responses can suffice. We therefore propose a memory-efficient parallel policy-learning framework for collapse-reactive retreat via hybrid terrain modeling. Hybrid terrain modeling combines rigid-body simulation of non-collapsible terrain with virtual contact forces for collapsible regions. A State-Multiplexed Contact Model shares terrain geometry and a contact-response law while maintaining environment-specific collapse states, enabling independent experiences without terrain objects for collapsible regions. The framework trains a proprioceptive policy for both normal locomotion and collapse-reactive retreat. It supports over 100 times as many parallel environments as fine-resolution rigid-block terrain within the same GPU memory limit. This scalability and improved sample efficiency enable over 50 times faster policy convergence with comparable retreat performance. Sim-to-sim and real-robot experiments demonstrate retreat under multiple collapse conditions. A supplementary video is available at: https://youtu.be/_RrhwjzEPE0

Figures & tables

Explore similar work

CardsList
  1. CLASH: Collision Learning via Augmented Sim-to-real Hybridization to Bridge the Reality Gap

    Feb 21, 2026Haotian He, Ning Guo, Siqi Shi +2Sim-to-Real TransferRobotics Simulation

  2. GM-Loco: Terrain-Adaptive Humanoid Locomotion on Granular Media

    Sep 9, 2026Junnosuke Kamohara, Feiyang Wu, Andy Ningan Zong +4Humanoid Robot LocomotionGranular Terrain Locomotion

  3. CG-MuTra: Continuously-Gated Multi-Terrain Adaptive Recovery for Unified Humanoid Fall Recovery and Locomotion

    Jun 8, 2026Xiaoyu Xu, Zhiming Chen, Yuenan Zhao +2Humanoid Robot LocomotionRobot Failure Recovery