Picking Bins Empty: A Hierarchical Hybrid Approach with Online Self-Learning of Grasp Points for Reliable Industrial Bin-Picking
Organizations: Mercedes-Benz AG, Sindelfingen, Germany · University of Stuttgart, Germany · Karlsruhe Institute of Technology (KIT), Germany · DLR Institute of Robotics and Mechatronics, Weßling, Germany ·
Abstract
Bin-picking is a cornerstone of modern manufacturing, yet achieving complete bin clearance without manual intervention remains a critical challenge. While model-based methods provide high precision, they frequently suffer from deadlocks when predefined grasps are occluded or perception fails. Labor-intensive fine-tuning of grasp points is commonly required to reach a satisfactory performance for new parts. Model-free algorithms offer a more flexible alternative with "out-of-the-box" versatility but lack the reliability and repeatability required for production. Unlike existing work, which treats the two techniques in isolation, we propose a fourtiered hierarchical hybrid approach to combine the best of both worlds. A model-based pipeline serves as a robust backbone, while a model-free "exploration agent" resolves deadlock situations and discovers new grasp points. This is supported by an online self-learning mechanism that uses gripper-stroke feedback and Wilson score intervals to autonomously rank grasp candidates, reducing manual commissioning effort. Validation on three automotive parts demonstrates that our method significantly outperforms a model-free baseline in grasp success rate while improving the bin clearance rate of the model-based baseline from 50.9% to 100% across all experiments. This transition to full bin clearance marks a significant step towards truly autonomous, intervention-free industrial operation.
Figures & tables
| Part | Model-based ( ) | Model-free ( ) |
|---|---|---|
| A | 33.3% (50/150) | 100.0% (150/150) |
| B | 34.7% (52/150) | 100.0% (150/150) |
| C | 84.7% (127/150) | 100.0% (150/150) |
| All | 50.9% (229/450) | 100.0% (450/450) |
| Part | Model-based ( ) | Model-free ( ) |
|---|---|---|
| A | 96.1% (50/52) | 71.4% (150/210) |
| B | 100.0% (52/52) | 29.8% (150/503) |
| C | 100.0% (127/127) | 55.0% (150/273) |
| All | 99.1% (229/231) | 45.6% (450/986) |
Robotic Grasping
Robotic grasping studies how robots perceive, plan, and execute stable, task-appropriate contacts with objects across varied shapes and conditions.
See all 311 papers