Soft yet Effective Robots via Holistic Co-Design
Organizations: Laboratory for Information & Decision Systems, Massachusetts Institute of Technology, Cambridge, 02139, MA, USA. · Cognitive Robotics, Delft University of Technology, Mekelweg 2, Delft, 2628 CD, Netherlands. · Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, 02139, MA, USA. · The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, 56025, Italy. · Embodied AI AG, Lausanne, 1015, Switzerland. · CREATE Lab, EPFL, Lausanne, 1015, Switzerland. · Advanced Robotics Centre, Department of Mechanical Engineering, National University of Singapore, 117575, Singapore.
Abstract
Soft robots promise inherent safety via their material compliance for seamless interactions with humans or delicate environments. Despite progress, the field struggles to balance task-specific performance with broader factors like durability and manufacturability--a difficulty that we find is compounded by traditional sequential design processes with their lack of feedback loops. In this perspective, we review emerging co-design approaches that simultaneously optimize the soft robot's body and brain, enabling the discovery of unconventional designs highly tailored to the given tasks. Their adoption is limited by narrow objectives, gaps between simulated and real performance, and computational cost. To address these challenges, we propose a holistic co-design framework that incorporates a broader range of design values, integrates real-world prototyping to refine evaluations, and boosts efficiency through surrogate metrics and model-based control strategies. Finally, we outline research priorities in design priors and metrics, AI-assisted evaluation, and balancing computational refinement with physical testing and safety with performance.
Figures & tables
| Metric | Experimental protocol | Computational implementation |
|---|---|---|
| Pick success rate | Count successful picks over total attempts in greenhouse trials. | Simulate grasp dynamics and apply success probability models under domain-randomized variability. |
| Selectivity error (ripe vs. unripe) | Compare picked fruits with human-annotated ripeness ground truth. | Classifier accuracy on synthetic or augmented datasets representing different ripeness states. |
| Cycle time | Measure time per pick from actuation start to fruit release. | Model task scheduling with actuator and robot dynamics; stochastic timing models. |
| Throughput per hour | Number of fruits successfully harvested per hour in pilot trials. | Extrapolation from cycle time distributions under randomized task sequences. |
| Dropped fruit percentage | Ratio of fruits lost during transfer to total picked fruits. | Simulated grasp stability analysis with randomized external perturbations. |
| Bruise percentage (24/48h) | Visual inspection and pressure mapping after storage at 24/48 h. | Contact force simulation with tissue deformation models and probabilistic damage thresholds. |
| Sensor modality | Function | Example commercial sensors | Typical algorithms |
|---|---|---|---|
| Multi-view RGB-D / stereo | 3D fruit pose, occlusions, approach planning | Intel RealSense (e.g., D455); Stereolabs ZED2i; industrial RGB + structured light | Instance segmentation + tracking; depth fusion; 6D pose refinement |
| NIR / hyperspectral | Ripeness/defect cues under lighting variability | Specim FX10/FX17; multispectral cameras (agri/food) | Spectral features + classifier; domain adaptation; calibrated confidence |
| Close-up stem/peduncle vision | Detachment-point localization and cut/twist planning | Eye-in-hand RGB(-D); structured light | Keypoints/skeletonization; stem tracing; local surface normal estimation |
| Wrist force/torque | Contact monitoring, detachment detection, safety limits | ATI Mini45 (or similar); integrated F/T at flange | Contact-state estimation; impedance/admittance control; force thresholds |
| Tactile / fingertip sensing | Slip/contact patch; bruise-risk proxies | GelSight-type tactile; capacitive/optical tactile arrays | Slip detection; contact-area/pressure proxy; tactile servoing |
| Bin fill estimation | Packing density, drop/impact risk mitigation | Overhead RGB-D/stereo; depth camera | 3D occupancy/fill-level estimation; anomaly detection |