cs.RONov 9, 2026

Bridging Task Planning and Execution for Language-Conditioned Bimanual Manipulation

Authors: Emanuele Cuzzocrea, Giuseppina Iannotti, Luca Rossini, Arturo Laurenzi, Nikos Tsagarakis

Organizations: The authors are with the University of Genoa, DIBRIS, Genoa, Italy.

Abstract

Robots are increasingly expected to execute natural-language manipulation tasks in real-world environments. This is particularly relevant in household assistance and logistics, where clutter requires reasoning about both task objectives and execution feasibility. This challenge becomes even more pronounced for bimanual humanoid platforms, where coordinating two manipulators introduces additional interaction and kinematic constraints. We present a zero-shot vision-language framework for execution-aware bimanual manipulation that jointly reasons about task objectives and physical feasibility. Planning is grounded in a structured scene representation that combines semantic object relations with execution constraints, enabling the selection of obstacle relocations and execution choices while preserving task semantics. Compatible actions are organised into parallel bimanual stages with explicit pre- and post-conditions. A hierarchical validator evaluates these conditions under perceptual uncertainty and uses stage-level execution history to support local recovery or targeted replanning. Experiments on the CENTAURO hybrid wheeled-legged humanoid robot across nine language-conditioned manipulation scenarios show higher task success than a non-execution-aware baseline. In dedicated failure scenarios, hierarchical validation recovers from execution failures with fewer model queries than always replanning. These results demonstrate the benefits of combining execution reasoning directly into task planning. Videos and additional material are available on the Project Webpage: https://advrhumanoids.github.io/bridging-planning-execution/.

Figures & tables

Explore similar work

CardsList
  1. Embodied Zero-Shot Task Planning via Hardware-Aware LLM-VLM Integration for Grounded Robotic Manipulation

    Oct 8, 2026Lonnie Tankersley, Noorbakhsh Amiri Golilarz, Soroush KorivandRobotic ManipulationRobot Task Planning

  2. BiPOP: Partial-Order Planning for Long-Horizon Bimanual Robotic Manipulation

    Nov 11, 2026Kun Chu, Xufeng Zhao, Jan-Gerrit Habekost +2Bimanual Robotic ManipulationRobot Task Planning

  3. Task-Aware Bimanual Affordance Prediction via VLM-Guided Semantic-Geometric Reasoning

    Apr 9, 2026Fabian Hahne, Vignesh Prasad, Georgia Chalvatzaki +2Bimanual Robotic ManipulationRobotic Manipulation