Embodiment-Aware Planning for Heterogeneous Bimanual Manipulation
Organizations: Sukhvansh Jain and Narendra Kumar Dhar are with the Indian Institute of Technology Mandi, Mandi, HP, India. · Anurag Maurya and Ravi Prakash are with the Indian Institute of Science, Bengaluru, Karnataka, India. · Shivam Vats is with Brown University, Providence, RI, USA.
Abstract
Many manipulation tasks that are effortless for dexterous human hands remain challenging for robotic systems equipped with simple, task-specialized grippers. Industrial platforms commonly rely on end-effectors such as suction cups or parallel-jaw grippers, yet no single mode can reliably satisfy the diverse constraints encountered across different phases of complex manipulation tasks, including pickup, reorientation, insertion, and constrained placement. In this work, we investigate whether complementary simple grippers within a heterogeneous bimanual setup can collectively realize tasks that exceed the capability of any individual gripper alone. Given a single human demonstration specifying the desired object motion, we formulate embodiment-aware execution as a finite-horizon optimization over arm-trajectory assignments. At each segment, the planner determines whether single-arm manipulation or a coordinated dual arm handover is required, jointly reasoning over heterogeneous grasp feasibility, motion constraints, manipulability, and cross-gripper compatibility. Exploiting this formulation, we compute globally consistent assignments with explicit switching regularization. Experiments on a dual Franka FR3 platform equipped with suction and parallel-jaw grippers demonstrate improved feasibility and reliability in tasks that are infeasible under single-gripper execution.
Figures & tables
| Method | Assign (%) | Task Success (%) | Handover (%) | Avg. Switches | Plan Time (s) | Exec Time (s) |
|---|---|---|---|---|---|---|
| Single-Arm Baseline | ||||||
| Single Robot | 0.0 | 0.0 | - | 0 | - | - |
| Bimanual Method | ||||||
| Greedy ( ) | 30.0 | 20.0 | 75.0 | 1.5 | 24.03 | 95.8 |
| No-Diversity | 75.0 | 67.5 | 100.0 | 1.3 | 1015.87 | 84.8 |
| No-Manipulability ( ) | 80.0 | 52.5 | 89.1 | 2.7 | 502.43 | 138.7 |
Bimanual Robotic Manipulation
Bimanual robotic manipulation coordinates two robot arms to handle objects, tools, and tasks that require collaboration.
See all 189 papers