Learning Contextual Motion Constraints for Object Rearrangement Exploration
Organizations: State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University. · State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI).
Abstract
The motion of an articulated part in cluttered surroundings is constrained not only by an object's intrinsic joint limits but also by extrinsic obstacles. However, existing approaches primarily consider object articulation properties alone. Here we present Motion Constraint Prediction Network (MoCo-Net), a two-stream neural network that jointly predicts the continuous motion ranges of articulated parts and obstacle heatmaps highlighting potential collision regions from partial-view point cloud observation. By capturing both internal and external motion constraints, MoCo-Net produces more accurate feasible motion range prediction and obstacles recognition, improves generalization for novel objects in new scenes, and enables robots to construct a scene configuration space for efficient exploration of rearrangement actions. Our experiments show that MoCo-Net's two-stream design enhances each other to deliver more accurate predictions, which subsequently form a compact configuration space for a customized planner to efficiently rearrange the scene.
Figures & tables
| Feasible Range Prediction | Obstacle Heatmap Prediction | |||||||
| Method | Range Accuracy | Range Error | Collision Detection Rate | Collision Distance Error | ||||
| Layout Var. | Unseen Obj. | Layout Var. | Unseen Obj. | Layout Var. | Unseen Obj. | Layout Var. | Unseen Obj. | |
| GT-Sim | 0.433 | 0.445 | 0.305 | 0.300 | 0.511 | 0.490 | 0.210 | 0.196 |
| Backbone-PointNet | 0.460 | 0.402 | 0.158 | 0.181 | 0.685 | 0.495 | 0.106 | 0.129 |
| Backbone-PointNet++ | 0.545 | 0.506 | 0.126 | 0.138 | 0.738 | 0.532 | 0.133 | 0.164 |
| FR-Only | 0.604 | 0.566 | 0.114 | 0.128 | - | - | - | - |
| Method | ctar | aan | acn |
| DirectManip | 0% | 6.055 | 2.525 |
| FR+Greedy | 80.0% | 6.185 | 0.235 |
| FR+OH (Ours) | 82.4% | 5.472 | 0.201 |
Constrained Motion Planning
Constrained motion planning finds robot paths and controls that satisfy geometric, dynamic, safety, and task-specific requirements.
See all 198 papers