Visibility-Aware Task and Motion Planning with Task-Centric Perception
Organizations: Massachusetts Institute of Technology, Cambridge, MA 02139, USA
Abstract
Long-horizon manipulation under uncertainty remains a challenging problem in robotics. We present \ourmethod{}, an algorithm for Visibility-Aware Task and Motion Planning. \ourmethod{} extends existing deterministic task and motion planning solvers to partially observable object rearrangement tasks, while still being able to take advantage of the efficiency and compositional generalization over long horizons of the base solver. This extension interleaves sensing actions into a plan skeleton that assumed full observability, and uses a novel persistent object-based memory to fuse observations into object mesh hypotheses and an observed occupancy map. We evaluate \ourmethod{} on real-world tabletop rearrangement tasks which feature heavy occlusion and partial visibility and demonstrate that it outperforms baselines that do not perform active perception or have persistent memory.
Figures & tables
| SR | |||
| Method | Cubes on Bread | Teacup on Plate | Supplies on Tray |
| TiPToP [ 4 ] | 2 / 10 | 3 / 10 | 0 / 10 |
| VUTAMP-UNIFORM | 8 / 10 | 3 / 10 | 2 / 10 |
| VUTAMP | 8 / 10 | 9 / 10 | 2 / 10 |
| VA-TAMP | 9 / 10 | 10 / 10 | 10 / 10 |
Robot Task Planning
Robot task planning turns goals and observations into executable actions while coordinating skills, motion, uncertainty, and safety.
See all 252 papers