cs.ROSep 6, 2026

Knowledge-Guided Hierarchical Policy Learning for High-Precision Cylindrical Assembly under Tight Tolerances

Authors: Binbin Lian, Xinyu Liu, Tao Sun

Organizations: Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, Tianjin University, Tianjin, 300350, China

Abstract

A hybrid hierarchical learning framework is proposed to achieve high-precision assembly of 170mm cylindrical components with tolerance of 0.1mm. The lower-level network integrates expert experience through Behavior Cloning (BC), giving the robot human-like intuition, and incorporates the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm to enhance training stability and robustness. The upper-level network dynamically adjusts the lower-level decisions based on heuristic rules, ensuring flexibility in operations. A simulated model is constructed to learn before transferring to real world. An efficient and safe training is allowed. Comparisons show that the reward curve converges within 500 episodes, indicating high learning efficiency. It also demonstrates better adaptability to initial conditions and pose errors, achieving satisfactory success rates even under extreme conditions. Moreover, the method exhibits good stability under Gaussian noise interference. In the real world, the assembly trajectory of the cylindrical segment shows smoother motion and less fluctuation.

Figures & tables

Explore similar work

CardsList
  1. Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?

    Jun 24, 2026Tyler Ga Wei Lum, Kushal Kedia, C. Karen Liu +1RL for RoboticsRobot Skill Learning

  2. SPARR: Simulation-based Policies with Asymmetric Real-world Residuals for Assembly

    Feb 26, 2026Yijie Guo, Iretiayo Akinola, Lars Johannsmeier +3Robotic AssemblySim-to-Real Transfer

  3. SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy

    May 12, 2026Yibo Liu, Stanko Oparnica, Simon Shewchun-Jakaitis +5Contact-Rich Robotic ManipulationDiffusion Policy