cs.RONov 12, 2026

Visibility-Aware Task and Motion Planning with Task-Centric Perception

Authors: Sahit Chintalapudi, Xiaoyan Wang, Aryan Zoroufi, Aditya Agarwal, Nancy Kanwisher, Tomás Lozano-Pérez, Leslie Pack Kaelbling

Organizations: Massachusetts Institute of Technology, Cambridge, MA 02139, USA

Abstract

Long-horizon manipulation under uncertainty remains a challenging problem in robotics. We present \ourmethod{}, an algorithm for Visibility-Aware Task and Motion Planning. \ourmethod{} extends existing deterministic task and motion planning solvers to partially observable object rearrangement tasks, while still being able to take advantage of the efficiency and compositional generalization over long horizons of the base solver. This extension interleaves sensing actions into a plan skeleton that assumed full observability, and uses a novel persistent object-based memory to fuse observations into object mesh hypotheses and an observed occupancy map. We evaluate \ourmethod{} on real-world tabletop rearrangement tasks which feature heavy occlusion and partial visibility and demonstrate that it outperforms baselines that do not perform active perception or have persistent memory.

Figures & tables

Explore similar work

CardsList
  1. Imagine-TAMP: Imagination-Guided Task and Motion Planning in Partial Observability

    Sep 17, 2026Antareep Singha, Shivaram Kumar, Yoonwoo Kim +1Belief-Space PlanningActive Perception

  2. Object- and Task-Aware Active Perception for Safe Navigation of Mobile Manipulators in Semi-Static Environments

    Oct 21, 2026Jingxing Qian, Xintong Du, Jun Yang +3Safe Robot NavigationRobot Navigation