BiCoord: A Bimanual Manipulation Benchmark towards Long-Horizon Spatial-Temporal Coordination
Organizations: Beihang University · Zhongguancun Academy · National University of Singapore
Abstract
Bimanual manipulation, i.e., the coordinated use of two robotic arms to complete tasks, is essential for achieving human-level dexterity in robotics. Recent simulation benchmarks, e.g., RoboTwin and RLBench2, have advanced data-driven learning for bimanual manipulation. However, existing tasks are short-horizon and only loosely coordinated, failing to capture the spatial-temporal coupling inherent in real-world bimanual behaviors. To address this gap, we introduce BiCoord, a benchmark for long-horizon and tightly coordinated bimanual manipulation. Specifically, BiCoord comprises diverse tasks that require continuous inter-arm dependency and dynamic role exchange across multiple sub-goals. Also, we propose a suite of quantitative metrics that evaluate coordination from temporal, spatial, and spatial-temporal perspectives, enabling systematic measurement of bimanual cooperation. Experimental results show that representative manipulation policies, e.g., DP, RDT, Pi0, and OpenVLA-OFT, struggle with long-duration and highly coupled tasks, revealing fundamental challenges in achieving long-horizon and tight coordination tasks. We hope BiCoord can serve as a foundation for studying long-horizon cooperative manipulation and inspire future research on coordination-aware robotic learning. All datasets, codes and supplements could be found at https://buaa-colalab.github.io/BiCoord/.
Figures & tables
| Spatial-Temporal Metrics | Long-Horizon Metrics | |||||||||
| Benchmark | Task Number | Stage-Wise Annotation & Evaluation | Simultaneous Movement Time (SMT) | Simultaneous Movement Percentage (SMP,%) | Minimum Relative Distance (MRD,%) | Average Relative Distance (ARD,%) | Spatial-Temporal Integral (STI,%) | Trajectory Length (TL) | Stage Number (SN) | Object Number (ON) |
| RLBench2 | 13 | ✗ | 179 | 97.10 | 54.57 | 114.93 | 11.20 | 186 | 1.61 | 2.23 |
| RoboTwin2.0 | 50 | ✗ | 60 | 26.10 | 63.83 | 82.37 | 8.13 | 221 | 1.64 | 2.02 |
| BiCoord (Ours) | 18 | ✓ | 329 | 92.81 | 29.59 | 55.77 | 42.16 | 361 | 4.27 | 3.66 |
| DP | RDT | OpenVLA-OFT | Pi0 | |||||||||
| Task | SR | SSR | TL | SR | SSR | TL | SR | SSR | TL | SR | SSR | TL |
| Balance Roller | 34.0 | 67.0 | 101 | 39.0 | 69.5 | 128 | 89.0 | 94.5 | 124 | 62.0 | 79.5 | 149 |
| Build Bridge | 68.0 | 69.5 | 243 | 76.0 | 78.5 | 275 | 66.0 | 67.8 | 282 | 64.0 | 65.0 | 291 |
| Build Tower With Blocks | 0.0 | 1.5 | - | 0.0 | 0.5 | - | 0.0 | 7.0 | - | 0.0 | 1.5 | - |
| Clean Table | 0.0 | 28.5 | - | 0.0 | 23.8 | - | 1.0 | 33.0 | 775 | 9.0 | 46.8 | 672 |
| Collect Pens | 1.0 | 46.8 | 378 | 57.0 | 87.8 | 487 | 35.0 | 75.8 | 456 | 68.0 | 85.8 | 414 |
| RDT | OpenVLA-OFT | Pi0 | |||||||
| Task | SR | SSR | TL | SR | SSR | TL | SR | SSR | TL |
| Balance Roller | 15.0 | 43.0 | 149 | 49.0 | 74.5 | 137 | 68.0 | 81.5 | 151 |
| Build Bridge | 47.0 | 50.2 | 370 | 2.0 | 2.0 | 312 | 44.0 | 47.0 | 289 |
| Build Tower With Blocks | 0.0 | 1.0 | - | 0.0 | 0.0 | - | 2.0 | 5.0 | 650 |
| Clean Table | 0.0 | 17.5 | - | 2.0 | 25.0 | 612 | 6.0 | 46.2 | 658 |
| Collect Pens | 15.0 | 68.8 | 495 | 5.0 | 46.2 | 795 | 47.0 | 81.8 | 457 |
Bimanual Robotic Manipulation
Bimanual robotic manipulation coordinates two robot arms to handle objects, tools, and tasks that require collaboration.
See all 178 papers