Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need for continuous expert monitoring to recover from failures during execution. In this paper, we propose Trajectory Editing Residual Dataset Aggregation (TER-DAgger), a scalable and force-aware human-in-the-loop imitation learning framework that mitigates covariate shift by learning residual policies through optimization-based trajectory editing. This approach smoothly fuses policy rollouts with human corrective trajectories, providing consistent and stable supervision. Second, we introduce a force-aware failure anticipation mechanism that triggers human intervention only when discrepancies arise between predicted and measured end-effector forces, significantly reducing the requirement for continuous expert monitoring. Third, all learned policies are executed within a Cartesian impedance control framework, ensuring compliant and safe behavior during contact-rich interactions. Extensive experiments in both simulation and real-world precision insertion tasks show that TER-DAgger improves the average success rate by over 37% compared to behavior cloning, human-guided correction, retraining, and fine-tuning baselines, demonstrating its effectiveness in mitigating covariate shift and enabling scalable deployment in contact-rich manipulation.
Figures & tables
Fig. 1: (Left) TER-DAgger pipeline. The robot first executes the task using the base policy. When the error detector identifies a failure, execution is paused and a human provides a corrective insertion demonstration. To generate residual training data, we locate the nearest point on the base-policy trajectory to the start of the human demonstration as the editing endpoint. Together with its preceding N−1 points, this forms an editing segment, which is optimized to produce a smooth transition toward the human-corrected trajectory. Based on the optimized trajectory, we construct training data for the residual policy. (Right) Framework overview. The base policy (1 Hz) predicts future end-effector poses and forces from image observations, the current end-effector pose and force. The error detector (50 Hz) compares predicted and measured end-effector forces to detect failures. The residual policy (50 Hz) takes image observations, the current end-effector pose, and the next action predicted by the base policy as inputs, and predicts pose corrections. The corrected actions are executed via a Cartesian impedance controller (1 kHz).
Fig. 2: Simulation scene setup and insertion task process.
Fig. 3: Real scene setup and insertion task process.
Method
Simulation
Real
Average
USB
Two-pin Plug
USB
Two-pin Plug
Three-pin Plug
ACT [ 1 ]
26%
22%
2%
64%
24%
27.6%
FILIC [ 11 ]
20%
30%
10%
44%
24%
25.6%
HG-DAgger [ 13 ]
50%
44%
16%
36%
12%
31.6%
Retrain
48%
56%
0%
36%
22%
32.4%
Finetune
68%
54%
10%
28%
40%
40.0%
TABLE I: Success rates (%) of different methods
Task
Metric
KL Loss
Reconstruction Loss
Position Prediction Error
Force Prediction Error (Ours)
Two-pin Plug
Precision ↑ Recall ↑
90 100
98 100
76 100
100 100
USB
Precision ↑ Recall ↑
74 100
78 100
78 100
100 100
Two-pin Plug (Real)
Precision ↑ Recall ↑
50 100
40 100
36 100
100 100
USB (Real)
Precision ↑ Recall ↑
100 100
96 100
100 100
100 100
Three-pin Plug (Real)
Precision ↑ Recall ↑
64 100
64 100
76 100
94 100
Average
Precision ↑ Recall ↑
75.6 100.0
75.2 100.0
73.2 100.0
98.8 100.0
TABLE II: Comparison of error detection methods
Task
KL
Recon.
Pos.
Force (Ours)
Loss
Loss
Err.
Err.
USB
0.00056
0.00162
0.012
11.0
Two-pin Plug
0.0011
0.00086
0.012
13.0
USB (Real)
0.014
0.00078
0.018
16.0
Two-pin Plug (Real)
0.00109
0.005
0.024
15.0
Three-pin Plug (Real)
0.0015
0.0006
0.025
14.0
TABLE III: Thresholds of Error Detection Methods
Method
Simulation
Real
Average
USB
Two-pin Plug
USB
Two-pin Plug
Three-pin Plug
ACT [ 1 ]
26%
22%
2%
64%
24%
27.6%
Base Policy (Ours)
34%
28%
4%
68%
28%
32.4%
TABLE IV: Ablation studies of adding end-effector force
Residual Training Samples
Success Rate
Base Policy (Ours)
28%
Transition
32%
Demonstration
34%
Post-editing
66%
Transition + Demonstration
42%
Transition + Post-editing
56%
TABLE V: Ablation studies of three parts of residual samples
Number of Points
Success Rate
10
94%
20
96%
30
88%
40
80%
TABLE VI: Ablation studies of number of points for optimization
In robotic insertion under uncertain contact, the axial force limit and the appropriate controller gain vary across tasks. As a result, a single fixed gain is unlikely to remain suitable across different task conditions, making conventional impedance controllers reliant on manual retuning. To eliminate manual retuning, we propose Constraint-Grounded Reinforcement Learning (CG-RL), a variable impedance framework for online gain adaptation. Conditioned on the force limit and contact feedback, the policy outputs a residual motion, an insertion rate, and a requested gain. The controller projects this gain into the admissible range without exposing the range itself to the policy. This separation allows a single policy to operate under different force limits without retraining or manual retuning. We evaluate CG-RL on simulated oblique insertion across five training seeds. CG-RL achieves an 85.8±7.7% (mean ± SD) success rate of insertions without violating the force limit, while keeping the applied gain within the admissible range. As a comparison, a fixed-gain baseline using the midpoint gain achieves a success rate of 50.1%. The policy adapts its insertion rate continuously to the specified force limit and further generalizes to more permissive force limits above the training range. In contrast, the same actor without force-limit input does not exhibit this adaptation. The applied gain is guaranteed to remain within the admissible range, while force-limit satisfaction is validated empirically rather than guaranteed formally.
Lin He, Min Deng
Department of Civil and Environmental Engineering, The University of Tennessee, Knoxville, TN 37996 USA
Contact-rich manipulation requires robots to regulate force against surfaces whose geometry deviates unpredictably from training conditions. Trajectory-based imitation learning, which reproduces observable outputs, breaks down under such shifts. We propose Impedance Cloning, which instead imitates the biomechanical priors that generate motion -- the stiffness and equilibrium point -- and thereby passively absorbs contact uncertainty. Because these parameters encode intent rather than outcome, they generalize across surface geometries where trajectory reproduction does not. We extract them from bilateral teleoperation demonstrations via a particle filter without force/torque sensors and evaluate the framework on two CRANE-X7 manipulators. In a wiping task with joint-space actions, the trajectory-based baseline loses contact below -6 cm, whereas the proposed method maintains a consistent 4-5 N contact force above -6 cm, with a gradual decrease below; with Cartesian-space actions, its force-height slope over 0 to +8 cm is 0.13 +/- 0.03 N/cm, versus 0.34-0.83 N/cm for fixed-impedance baselines. In a pick-and-place task with 10 diverse cups (100 trials), the proposed method succeeds in 84 trials, outperforming the fixed-impedance baseline (74/100) and performing comparably to a variable impedance control baseline (82/100) with one demonstration instead of ten. In a grasping task, the representation reduces torque tracking error with both ILBiT and Mamba backbones, confirming its generality across architectures.
Hayato Takahashi, Ryoga Oishi, Yuki Kasuga +1
Graduate School of Science and Engineering, Saitama University, Saitama, Japan
Generalizable contact-rich manipulation requires robots to preserve intended task behavior while adapting its physical realization to changing contact conditions. However, interaction forces can vary substantially with small changes in surface geometry, orientation, and friction, making policies trained directly on raw force measurements difficult to transfer beyond demonstrated conditions. We introduce FACE, a contact-factorized imitation learning framework that separates intended task behavior from environment-dependent contact factors. Our representation expresses interaction forces in normalized, contact-relative coordinates, while a learned contact-normal estimator and an online friction estimator infer the local contact normal and effective friction scale. Together, these estimators enable force observations to be encoded and policy outputs to be decoded into physical motion and force commands during execution. In this way, FACE adapts execution to current contact conditions while preserving the intended task behavior, without updating the policy parameters. We evaluate FACE on real-robot contact-rich manipulation under unseen variations in surface properties and geometry, demonstrating robust generalization across contact conditions through controlled comparisons with variants that adapt prior approaches to our setting. Videos and additional materials can be found on the project page: https://rcilab.khu.ac.kr/face.
Jiho Hong, Daeun Song, Sanghyun Kim +1
Kyung Hee University · Ewha Womans University · University of Central Florida