cs.RONov 19, 2026

Demonstration-Free Skill Composition for Navigation and Manipulation

Authors: Madeleine Nouri, Gelareh Mohammadi, Francisco Cruz

Organizations: School of Computer Science and Engineering, University of New South Wales, Sydney, Australia · Escuela de Ingeniería, Universidad Central de Chile, Santiago, Chile

Abstract

Hierarchical reinforcement learning enables sequential tasks to be represented as compositions of separately trained skills. This paper evaluates demonstration-free hierarchical pipelines for MiniGrid navigation and robotic manipulation, comparing their training requirements and task performance with flat reinforcement learning baselines. The evaluation concerns complete pipelines with task-specific observation, reward and control structures. In navigation, two parameterised skills are reused across unseen FourRooms layouts under manually specified high-level plans. In manipulation, reaching, grasp alignment and lifting are trained separately, with downstream skills initialised from states collected during predecessor rollouts. Across unseen navigation layouts, the hierarchical pipeline substantially outperforms the evaluated flat DQN baselines while requiring fewer training interactions. In manipulation, the hierarchical chain requires fewer training steps than flat SAC and exhibits lower observed variation across seeds. The frozen Pick and Lift skills are further reused for stacking by training an additional Place skill.

Figures & tables

Explore similar work

CardsList
  1. Exploring the Limits of Combinatorial Generalization in Embodied Manipulation

    Oct 11, 2026Xupeng Zhang, Yantai Yang, Chang Guo +2Generalization in Robotic ManipulationLong-Horizon Robotic Manipulation

  2. Decompose and Recompose: Reasoning New Skills from Existing Abilities for Cross-Task Robotic Manipulation

    May 2, 2026Xitie Zhang, Aming Wu, Yahong HanICL for RoboticsZero-Shot Robotic Manipulation