Robotic Fruits with Tunable Stiffness and Sensing: Towards a Methodology for Developing Realistic Physical Twins of Fruits

The automation of fruit harvesting has gained increasing significance in response to rising labor shortages. A sensorized gripper is a key component of this process, which must be compact enough for confined spaces, able to stably grasp diverse fruits, and provide reliable feedback on fruit conditions for efficient harvesting. To address this need, we propose FruitTouch, a compact gripper that integrates high-resolution, vision-based tactile sensing through an optimized optical design. This configuration accommodates a wide range of fruit sizes while maintaining low cost and mechanical simplicity. Tactile images captured by an embedded camera provide rich information for real-time force estimation, slip detection, and softness prediction. We validate the gripper in real-world fruit harvesting experiments, demonstrating robust grasp stability and effective damage prevention.

Robotic harvesting of cherry tomatoes in greenhouses remains challenging due to dense fruit clusters, delicate skin, and the need for gentle yet effective detachment. This study presents a force-data-driven framework for autonomous cherry tomato harvesting that integrates six-axis force/torque sensing, a bio-inspired compliant gripper, and deployment on a mobile robotic platform. A wearable ATI six-axis force/torque sensor mounted on the index finger captured kinetic signatures of three elemental picking patterns (gripping, twisting, and lateral pulling) across 150 manual trials (50 per pattern) in laboratory and greenhouse settings. Gripping required a peak normal force of 3.92 and 0.45 N, twisting produced a dominant torque of 19.20 2.10 Nmm about the pedicel axis with minimal truss disturbance, and pure lateral pulling alone was insufficient for reliable detachment. These measurements informed a novel fingertip-localised Finray gripper, with compliant TPU 95A Finray geometry restricted to the fruit-contact region and a rigid PLA body, emulating the dual-stiffness human fingertip. A Dynamixel XM430-W350 servomotor under current-based torque control applies the measured gripping force and a 45° wrist twist. Finite element analysis showed a maximum von Mises stress of 0.24 MPa under the 3.92 N load, below the bruising threshold of cherry tomato skin. Integrated on a UR5 arm and Clearpath Husky A200 base, the system was validated in NVIDIA Isaac Sim and in 50 autonomous trials at the SILAL commercial greenhouse, Abu Dhabi, UAE. The hybrid grip-twist-pull strategy achieved an 86.0% picking success rate, 2.3% fruit damage, and an 8.4 s cycle time per fruit, outperforming vacuum (66.3%), rotating (70.1%), clamping (76.0%), and suction-cutting (52.4%) end-effectors. These results demonstrate preliminary feasibility under the tested facility and cultivar conditions

This paper presents a vision-informed grasp force prediction framework for robotic handling of date fruits. Addressing the dual challenge of high detachment forces and low bruise thresholds, we first conduct mechanical characterization on date samples to define a safe grasping envelope and quantify the relationship between fruit geometry and bioyield stress. In this work, we develop a Vision-to-Force (V2F) pipeline that combines computer vision-based segmentation, active-contour refinement, and geometric feature extraction with a physics-informed residual neural network that augments a Hertz contact equation. The resulting model maps non-contact visual descriptors and cultivar metadata to predict a safe grasp force with mean validation performance of $R^2 \approx 0.7$ across unseen cultivar groups, which is a good result given the inherent mechanical variability of biological tissue. Experimental validation using a gripper and load cell indicates that the predicted forces enable stable manipulation of different types of date fruits, with residual deformations below 1 mm and no observable damage. These results show that pre-emptive, vision-driven force estimation% can replace slow and potentially damaging tactile exploration , enabling safer robotic handling of fragile fruits.