cs.RONov 11, 2026

Single-View RGB-D Force--Deformation Estimation for Robotic Manipulation of Elasto-Plastic Materials

Authors: Dezhi Sun, Marijn van Hilten, Kenan Niu

Organizations: Robotics and Mechatronics, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Enschede, The Netherlands.

Abstract

Persistent deformation complicates elasto-plastic manipulation by coupling physical interaction with spatially distributed shape changes. We investigate the force--deformation relationship using a standard robot, a single eye-in-hand RGB-D camera, and intrinsic force estimates. A 7-DoF Franka Emika FR3 performs normal indentations while an Intel RealSense L515 captures pre- and post-contact surfaces. Point-cloud processing localizes deformation and estimates displaced volume. Force--volume characterization includes 27 measurements over nine force levels. A compact multilayer perceptron (MLP), trained on 52 force--volume pairs at four levels, achieves a held-out RMSE of 1.857 N and R2=0.440R^2=0.440. A separate comparison shows lower error for a quadratic model at 16 N and for the MLP at 19 and 23.5 N. An eight-step experiment at 4 N per interaction demonstrates cumulative deformation localization from the second indentation onward. These results establish a practical measurement basis for deformation-aware manipulation using intrinsic force estimates and single-view geometry.

Figures & tables

Explore similar work

CardsList
  1. FORM: Robot Manipulation through Direct Material Law Identification

    Sep 29, 2026Stepan Tretiakov, Ruihan Zhao, Cheng-Hsi Hsiao +6Deformable Object ManipulationRobotic Manipulation

  2. Object-Centered Reconstruction for Vision-Based 3D Force Estimation

    Sep 20, 2026Zhonghao Zhang, Mingyeung Wu, Hao Yang +33D ReconstructionSurgical Robotics

  3. 3D-Force Estimation for Dual-arm Manipulation of Deformable Linear Objects via Factor Graphs

    Oct 26, 2026Annika Delucchi, Vincenzo Di Paola, Bruno Marco Quadrelli +1Contact Force EstimationDeformable Object Manipulation