Modern industrial automation demands autonomous collaborative systems capable of coordinated manipulation in workspaces with heterogeneous object arrangements. Existing systems rely on predetermined trajectories and rigid allocation strategies, causing suboptimal workspace utilization and collision risks. This paper presents a distance-based competitive task allocation framework for dual-arm systems, integrating real-time vision perception with collision-free motion planning. A temporal window mechanism enables each arm to evaluate object detections over five consecutive vision frames before committing to optimal distance-based selection, featuring dynamic reallocation and spatial conflict resolution at 0.01m threshold accuracy. An improved Artificial Potential Field (iAPF) framework provides coordinated dual-arm movements through exponential goal attraction, inter-arm repulsion, home-seeking, and velocity damping forces. Simulation results validate superiority over market-based, round-robin, and fixed allocation strategies in distance efficiency, collision risk, and workspace coverage. Hardware experiments using two 6-DOF Kinova Gen3 Lite manipulators demonstrate approximately 47% average velocity improvement over fixed allocation in homogeneous scenarios with zero collisions, while mixed object scenarios confirm universal handling with approximately 11% time overhead offset by superior safety margins. The framework integrates YOLOv8 OBB detection at 30 FPS with 10 Hz control loops, demonstrating practical deployment capability for industrial assembly and sorting operations.
Figures & tables
Figure 1: Overall Methodology: Intelligent Task Allocation for Dual Arm Efficient Motion Planning to Handle Objects.
Figure 2: Dual-Arm setup for intelligent task allocation
Predicted
Bolt
Nut
Reference
Background
Bolt
0.99
0.02
0.00
0.75
Nut
0.00
0.97
0.00
0.25
Reference
0.01
0.02
0.42
0.00
Background
0.00
0.00
0.57
0.00
Table 1: Normalized Confusion Matrix for YOLOv8 OBB Model (250 epochs)
Parameter
Value
Description
YOLOv8 inference rate
> 70 FPS
RTX 3060 GPU
Camera acquisition rate
≈ 30 FPS
RSD415 hardware limit at (640 × 480)
Control loop rate
10 Hz
Dual-arm coordination frequency
Detection confidence
0.75
YOLOv8 threshold (configurable)
ROS queue size
1
Latest-frame synchronization
Batch Size
1
Real-time single-frame processing
Table 2: Vision-control integration and task allocation parameters
Figure 4: Three performance metrics quantify allocation quality. [(1) Distance Efficiency (1/m) computed as the inverse of mean object-to-arm distance, measuring workspace utilization where higher values indicate better proximity-based assignments; (2) Collision Risk, representing the number of detected trajectory intersections during simultaneous arm operation; and (3) Coverage (%), calculated as the percentage of successfully allocated objects relative to total objects.]
Figure 5: Force profile comparison showing iAPF advantages: Exponential attraction with adaptive gradient(left), Continuous repulsion eliminating traditional threshold discontinuity(right).
Figure 6: Dual-Arm Trajectories comparison with iAPF force(left) and with traditional APF(right).
Table 6: Implementation Parameters for the Improved Artificial Potential Field Framework
Figure 8: Dual-arm system sorting objects using dynamic task allocation. START: Both arms are at their home positions. (a) Both arms initiate simultaneous manipulation from home positions. (b-c) Coordinated motion planning—left arm (green trajectory) and right arm (red trajectory) execute independent pick-and-place operations. (d-e-f) Continued coordinated execution with iAPF collision avoidance maintaining safe inter-arm distances. END: Return to home positions. The sequence demonstrates zero collision events during compact object manipulation, validating the temporal proposal window mechanism and improved APF framework.
Figure 9: Dual-Arm system Analysis for Dynamic Task Allocation Single Object Type - Homogeneous
Figure 10: Dual-Arm system Analysis for Fixed Task Allocation Single Object Type - Homogeneous
Method
Scenario
Total Dist. (m)
Total Time (s)
Avg.Velocity (m/s)
Dynamic
Bolt-Only
7.60±0.082
65.134±2.01
0.116±0.003
Nut-Only
7.88±0.1431
67.87±1.06
0.116±0.0002
Fixed
Bolt-Only
6.61±0.016
84.65±0.132
0.078±0.0001
Nut-Only
6.42±0.0104
82.147±0.08
0.0781±0.0001
Table 7: Performance Comparison: Dynamic vs Fixed Task Allocation.
Multi-agent manipulation naturally produces multiple task-driven viewpoints: every arm carries a wrist camera and moves through the scene while acting. Yet these observations are typically underutilized, and active perception in manipulation is still often treated as requiring a dedicated sensing agent. We introduce MAAP (Multi-Agent Active Perception), in which every arm is dual-purpose: it executes manipulation actions and, through the wrist camera it carries, simultaneously serves as a moving viewpoint for the team. We pair this with RAIL (Role-Aware Imitation Learning), a controller that predicts each arm's current role alongside its action chunk and conditions action generation on it, representing role-dependent actions within one network. Across four simulated tasks, widening the perception regime lifts average success from 56.5% with a fixed camera to 62.5% with one active wrist view and 70.0% with all of them, while MAAP+RAIL reaches 79.2%. RAIL's additional gain is concentrated on the three-arm Microwave task, where success rises from 47% to 82% on identical multi-wrist inputs. On a dual-arm platform, MAAP+RAIL succeeds in 14 of 20 placement trials compared with 0 of 20 for fixed-view ACT. Collaborative manipulation can thus serve as an active perception mechanism in its own right.
Bruno N. Y. Chen, Li Kang, Heng Zhou +4
Carnegie Mellon University · Shanghai Jiao Tong University · University of Science and Technology of China +3
Multi-robot-arm motion planning is a key challenge in deploying multiple manipulators for industrial tasks such as manufacturing. Existing search-based and sampling-based solvers often require significant computation time to produce collision-free, high-quality motions suitable for safe real-world execution. In this work, we introduce a new suite of multi-robot-arm motion planners capable of near real-time motion generation, combining classical planning algorithms with state-of-the-art vectorized collision-checking techniques. Based on CPU SIMD instructions, our new planners accelerate their primary bottleneck, collision checking, and achieve up to two orders of magnitude speedup in both motion planning and execution postprocessing for multi-arm manipulation tasks. We also release our implementation to lower the barrier for research and development of multi-robot-arm planning and manipulation problems. Code is available at https://vamp-mr.github.io/vamp-mr
Philip Huang, Chenrui Gao, Jiaoyang Li
Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213, USA · University of Michigan, Ann Arbor
This paper proposes a task-oriented model predictive control (ToMPC) framework for safe and efficient robotic manipulation in open workspaces. The framework unifies collision-free motion and robot-environment interaction to address diverse scenarios. Additionally, it introduces task-oriented obstacle avoidance that leverages kinematic redundancy to enhance manipulation efficiency in obstructed environments. This complex optimization problem is solved by the alternating direction method of multipliers (ADMM), which decomposes the problem into two subproblems tackled by differential dynamic programming (DDP) and quadratic programming (QP), respectively. The effectiveness of this approach is validated in simulation and hardware experiments on a Franka Panda robotic manipulator. Results demonstrate that the framework can plan motion and/or force trajectories in real time, maximize the manipulation range while avoiding obstacles, and strictly adhere to safety-related hard constraints.
Xinyu Jia, Wenxin Wang, Jun Yang +2
Department of Biomedical Engineering, National University of Singapore, Singapore 117583 · Peng Cheng Laboratory, Shenzhen 518057, China · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798