Hierarchical RL

RL: Reinforcement Learning

Overview

Hierarchical reinforcement learning helps agents handle long tasks by grouping primitive actions into skills or planning through intermediate goals. Common approaches include options and manager-worker policies, learned subgoal selection, action chunking, offline skill reuse, and model-based planning. These methods are applied to sparse-reward control, robotics, multi-agent coordination, and language-model agents, where they can improve exploration, credit assignment, and transfer. A central challenge is learning abstractions that are useful and stable without hand-designed boundaries, while keeping high-level plans aligned with what low-level controllers can reliably execute.

Latest papers

CardsList

168 papers8 papers in the last four weeks, down 70% on the four weeks before. 0.1% of all new papers.

  1. VASR: Vector-Aware Assembly Planning with Equivalent Structures and Repair-Cost Feedback

    Nov 16, 2026Ruizhe Wang, Rui Liu, Hongliang Chen +3Robotic AssemblyHierarchical RL

  2. MARS: Dynamic Routing of Reinforcement-Learned Atomic Skills for Multi-Stage Robotic Manipulation

    Nov 14, 2026Zequan Zeng, Junqin Yang, Kai WangRobotic ManipulationMulti-Task Robotic Manipulation

  3. Opportunity-Cost Option-Critic: Adaptive Switching Costs for Robust Hierarchical Reinforcement Learning

    Nov 10, 2026Khaled Ammoura, Aya Kayal, Naseem DaherHierarchical RLNon-Stationary RL

  4. Intra-Option Fitted Q-Evaluation: Evaluating Hierarchical Policies from Non-Hierarchical Data

    Nov 7, 2026Yunfu Deng, Josiah P. HannaOff-Policy EvaluationHierarchical RL

  5. Interpretable Meta-Policies for Neural Decision Making

    Oct 27, 2026Raban Emunds, Jannis Blüml, Quentin Delfosse +1Interpretability in RLNeuro-Symbolic RL

  6. Intrinsic Goals for Autonomous Agents: Hierarchical Exploration Captures Future Volitional Action in Drosophila

    Oct 25, 2026Declan Kutscher, Reece Keller, Alyn Kirsch +2Intrinsic MotivationIntrinsic Reward Methods

  7. SpecMAGIC: Specification-Guided Multi-Task Generalization in Multi-Agent Reinforcement Learning

    Oct 21, 2026Zijian Guo, İlker Işık, H. M. Sabbir Ahmad +1Multi-Agent Reinforcement LearningMulti-Agent Coordination

  8. Non-asymptotic Convergence of Average-reward Q-learning with Options

    Oct 14, 2026Kintan Saha, Ahana Deb, Anders Jonsson +1Q-LearningAverage-Reward RL

  9. Learning Navigation from Multimodal Demonstrations with Geometric Candidate Modes

    Oct 14, 2026Chengyang Peng, Zhihao Zhang, Upama Pant +3Robot NavigationRobot Imitation Learning

  10. HiFun: a Hierarchical Framework for Efficient Functional Dexterous Manipulation Learning

    Oct 14, 2026Linyi Huang, Guowei Huai, Weibin Liu +5Robotic ManipulationRobot Skill Learning

  11. From Orbit Matching to Docking: A Hierarchical Reinforcement-Learning Approach to Multiphase Rendezvous Trajectory Design

    Oct 12, 2026Mariko Storey-Matsutani, Anatoly Zlotnik, Lee Holguin +2Spacecraft Rendezvous and Proximity OperationsRL Control

  12. Q-Shaped Options for Hierarchical Reinforcement Learning

    Oct 8, 2026Clarisse Wibault, Antoine Gorceix, Antonio Léon Villares +5Hierarchical RLRepresentation Learning for RL

  13. RoboAware: Learning to Coordinate Embodied Skills from Counterfactual Outcomes

    Oct 8, 2026Bohan Zhou, Xingbei Chen, Emily Huang +17Robot Policy LearningLarge Language Model-Based Robot Planning

  14. Energy-Efficient Gait Adaptation via Hierarchical Reinforcement Learning for Quadrupedal Locomotion Across Diverse Terrains

    Oct 7, 2026Ammar Issa, Anubhav Singh, Anton Tsaritsin +1Legged RoboticsEnergy-Efficient Robot Locomotion

  15. Hierarchical Reinforcement Learning for Collision-Free Locomotion of an Underactuated Biped

    Oct 5, 2026Jagannath Prasad Sahoo, Saurabh Kumar, Surya Prakash S. K. +3Legged RoboticsHierarchical RL

  16. Hierarchical Reinforcement Learning with Stable Temporal Abstraction for Language Model Agents

    Oct 4, 2026Shayan Mohajer Hamidi, Yize Cheng, Yuanda Xu +2Reinforcement LearningHierarchical RL

  17. Hierarchical Time-aware Bootstrapping for Off-Policy Subgoal Value Learning

    Oct 4, 2026Bingyun Liu, Yuheng JingHierarchical RLTemporal-Difference Learning

  18. On Semi-Markov Suboptimality in Hierarchical Reinforcement Learning

    Oct 4, 2026Bingyun Liu, Yuheng JingReinforcement LearningSequential Decision Making

  19. Learning Modular Policy for Multi-Floor Object Navigation:A Factorized Framework for Diagnostic Study

    Oct 3, 2026Shichao Zhai, Shuhao Ye, Rong Xiong +1Object-Goal NavigationEmbodied Navigation

  20. Mastering Atari 2600 Games with Discovered Options

    Oct 2, 2026Erik M. Lintunen, Marlos C. MachadoRL for Game AIHierarchical RL

  21. Learning Transferable Policies from Action-free Time Series Through Dynamical Embeddings

    Oct 2, 2026Niklas Emonds, Georgia KoppeTransfer Learning in RLReinforcement Learning

  22. Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research Agents

    Oct 1, 2026Ankur Samanta, Yonathan Efroni, Paul Sajda +2Autonomous Research AgentsLong-Horizon Agent Tasks

  23. Towards Hierarchical Cyber Defense with Large Language Models: From Planning to Execution

    Sep 30, 2026Harshith Doppalapudi, Nathaniel D. Bastian, Ankit ShahAutonomous Cyber DefenseLanguage Model-Based Control

  24. Game-Guided Skill Discovery through Self-Play for Playable Agent Control

    Sep 30, 2026Seungeun Rho, Jeonghwan Kim, Xue Bin Peng +1Robot Skill LearningHierarchical RL