Learning-Based Strategy for Composite Robot Assembly Skill Adaptation

Khalil Abuibaid; Aleksandr Sidorenko; Achim Wagner; Martin Ruskowski

cs.ROApr 8, 2026

Learning-Based Strategy for Composite Robot Assembly Skill Adaptation

Authors: Khalil Abuibaid, Aleksandr Sidorenko, Achim Wagner, Martin Ruskowski

Organizations: Chair of Machine Tools and Control System, RPTU University Kaiserslautern-Landau, 67663 Kaiserslautern, Germany · Innovative Factory Systems, German Institute of Artificial Intelligence, 67663 Kaiserslautern, Germany · Chair of Machine Tools and Control Systems, RPTU University Kaiserslautern-Landau, 67663 Kaiserslautern, Germany

Abstract

Contact-rich robotic skills remain challenging for industrial robots due to tight geometric tolerances, frictional variability, and uncertain contact dynamics, particularly when using position-controlled manipulators. This paper presents a reusable and encapsulated skill-based strategy for peg-in-hole assembly, in which adaptation is achieved through Residual Reinforcement Learning (RRL). The assembly process is represented using composite skills with explicit pre-, post-, and invariant conditions, enabling modularity, reusability, and well-defined execution semantics across task variations. Safety and sample efficiency are promoted through RRL by restricting adaptation to residual refinements within each skill during contact-rich interactions, while the overall skill structure and execution flow remain invariant. The proposed approach is evaluated in MuJoCo simulation on a UR5e robot equipped with a Robotiq gripper and trained using SAC and JAX. Results demonstrate that the proposed formulation enables robust execution of assembly skills, highlighting its suitability for industrial automation.

Figures & tables

Figure 1: Encapsulated skill hierarchy for the assembly task.

Figure 2: Paradigm of Skill-based programming for assembly skill adaption by describing ( 1 ).

Figure 3: Activity Diagram of the Assembly Skill adaptation program.

Figure 4: Result of the assembly skill adaptation training and testing.

Explore similar work

Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly
Apr 22, 2026Yongqiang Zhao, Xuyang Zhang, Zhuo Chen +3RL for Robotics Contact-Rich Robotic Manipulation
Department of Engineering, King’s College London, Strand, London, WC2R 2LS, United Kingdom · Department of Informatics, King’s College London, Strand, London, WC2R 2LS, United Kingdom
InsertAnything: Generalizable Contact-Rich Precision Insertion from Simulation to Reality
Sep 21, 2026Zhenghua Ma, Xinpan Meng, Zeyu Liu +4RL for Robotics Contact-Rich Robotic Manipulation
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China, and the State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · PaXini AI Technology (Beijing) Co., Ltd., Beijing 100080, China
IROSA: Interactive Robot Skill Adaptation using Natural Language
Mar 4, 2026Markus Knauer, Samuel Bustamante, Thomas Eiband +3Robot Policy Adaptation Robot Skill Learning
All authors are with the German Aerospace Center (DLR), Institute of Robotics and Mechatronics (RMC), Münchener Str. 20, 82234 Weßling, Germany. · Markus Knauer, Alin Albu-Schäffer and Samuel Bustamante are also with the School of Computation, Information and Technology (CIT), Technical University of Munich (TUM), Arcisstr. 21, 80333 Munich, Germany.

Apr 22, 2026J/K move · Enter open · S save

Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly

Yongqiang Zhao, Xuyang Zhang, Zhuo Chen, Matteo Leonetti+2

Department of Engineering, King’s College London, Strand, London, WC2R 2LS, United Kingdom · Department of Informatics, King’s College London, Strand, London, WC2R 2LS, United Kingdom

RL for Robotics Contact-Rich Robotic Manipulation Robotic Manipulation Robot Imitation Learning Robotic Assembly

Open paper AskPDF arXiv

Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires extensive exploration. In this paper, we propose a novel visual-tactile skill learning framework for the PiH task that leverages its inverse task, i.e., peg-out-of-hole (PooH) disassembly, to facilitate PiH learning. Compared to PiH, PooH is inherently easier as it only needs to overcome existing friction without precise alignment, making data collection more efficient. To this end, we formulate both PooH and PiH as Partially Observable Markov Decision Processes (POMDPs) in a unified environment with shared visual-tactile observation space. A visual-tactile PooH policy is first trained; its trajectories, containing kinematic, visual and tactile information, are temporally reversed and action-randomized to provide expert data for PiH. In the policy learning, visual sensing facilitates the peg-hole approach, while tactile measurements compensate for peg-hole misalignment. Experiments across diverse peg-hole geometries show that the visual-tactile policy attains 6.4% lower contact forces than its single-modality counterparts, and that our framework achieves average success rates of 87.5% on seen objects and 77.1% on unseen objects, outperforming direct RL methods that train PiH policies from scratch by 18.1% in success rate. Demos, code, and datasets are available at https://sites.google.com/view/pooh2pih.

Abstract

Explore similar work

Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly

InsertAnything: Generalizable Contact-Rich Precision Insertion from Simulation to Reality

IROSA: Interactive Robot Skill Adaptation using Natural Language