Paper ID: 2411.09623

Vision-based Manipulation of Transparent Plastic Bags in Industrial Setups

F. Adetunji (1 and 2), A. Karukayil (1 and 2), P. Samant (1 and 2), S. Shabana (1 and 2), F. Varghese (1 and 2), U. Upadhyay (1 and 2), R. A. Yadav (1 and 2), A. Partridge (2), E. Pendleton (2), R. Plant (2), Y. Petillot (1 and 2), M. Koskinopoulou (1 and 2) ((1) Heriot-Watt University, (2) The National Robotarium)

This paper addresses the challenges of vision-based manipulation for autonomous cutting and unpacking of transparent plastic bags in industrial setups, aligning with the Industry 4.0 paradigm. Industry 4.0, driven by data, connectivity, analytics, and robotics, promises enhanced accessibility and sustainability throughout the value chain. The integration of autonomous systems, including collaborative robots (cobots), into industrial processes is pivotal for efficiency and safety. The proposed solution employs advanced Machine Learning algorithms, particularly Convolutional Neural Networks (CNNs), to identify transparent plastic bags under varying lighting and background conditions. Tracking algorithms and depth sensing technologies are utilized for 3D spatial awareness during pick and placement. The system addresses challenges in grasping and manipulation, considering optimal points, compliance control with vacuum gripping technology, and real-time automation for safe interaction in dynamic environments. The system's successful testing and validation in the lab with the FRANKA robot arm, showcases its potential for widespread industrial applications, while demonstrating effectiveness in automating the unpacking and cutting of transparent plastic bags for an 8-stack bulk-loader based on specific requirements and rigorous testing.

Submitted: Nov 14, 2024