DAWN: Diffusion-based Alignment and unfastening Workflow Network
Organizations: Department of Mechanical Engineering, University of Maryland, College Park, MD, USA
Abstract
We present DAWN (Diffusion-based Alignment and unfastening Workflow Network), a hierarchical robotic framework designed to perform real-world, unfastening tasks through multi-modal sensory integration. Autonomous robotic unfastening is crucial for improving recycling processes, enhancing safety, and reducing operational costs; yet, it remains predominantly manual due to inherent challenges in precise screwdriver engagement with fasteners, detailed force execution, and robustness to environmental variability. To address the complexity of learning long-horizon, contact-rich manipulation tasks, we subdivide the unfastening task procedure into two sequential stages: (1) alignment & insertion, and (2) unfastening. DAWN consists of three key components: AlignNet, a diffusion-based policy ensuring precise screwdriver tip engagement; LatchNet, a multi-modal classifier reliably detecting successful stage transitions; and UnfastNet, which achieves stable, force-controlled screw removal. Experimental validation on a Franka Emika robot demonstrates that DAWN achieves alignment & insertion success rates comparable to trained human operators, robustly transitions between stages, and attains an impressive success rate in unfastening across various unseen scenarios. Ablation studies further elucidate critical input modalities and effective training strategies, highlighting DAWN's scalability, robustness, and data efficiency.
Figures & tables
| Input Modalities | AlignNet | ||||||
|---|---|---|---|---|---|---|---|
| Mount Camera | Robot Proprio | Force | Front Camera | Alignment | Insertion | Proximity | Success Rate |
| Yes | Yes | No | No | ||||
| Yes | No | No | No | ||||
| Yes | Yes | Yes | No | ||||
| Yes | Yes | No | Yes | ||||
| Human Operator | Diffusion Policy | ResNet-18 | |||||
|---|---|---|---|---|---|---|---|
| Exp 1 | Exp 2 | Non-Exp 1 | W/O Obs-Trunk | Scratch | Finetuned | -Layer Finetuned | |
| Alignment | |||||||
| Insertion | |||||||
| Proximity | |||||||
| Success Rate | |||||||
| Avg. Time (sec) | - | - | - | ||||
| Type | Phillips | Security Torx | Slotted | Hex |
| Success | 5/5 | 5/5 | 5/5 | 5/5 |
Robotic Manipulation
Robotic manipulation studies how robots perceive, plan, and control physical interactions to grasp, move, assemble, and use objects.
See all 1,704 papers