cs.ROSep 24, 2026

Aerial Manipulation in the Wild with Onboard Perception, Policy Learning, and Whole-Body Control

Authors: Yuanzhu Zhan, Yufei Jiang, Zemu Zhang, Junyi Geng

Organizations: Department of Aerospace Engineering, Pennsylvania State University, University Park, PA, 16802, USA

Abstract

Aerial manipulation in outdoor environments remains challenging due to the simultaneous requirements of reliable state estimation, stable aerial motion, and precise manipulation under external disturbances. In this work, we present a real-world outdoor aerial manipulation framework that integrates imitation learning, onboard LiDAR-inertial state estimation, and whole-body model predictive control. A Diffusion Policy is trained from manipulation demonstrations to generate desired end-effector motions from onboard observations. These learned commands are executed by a whole-body MPC that jointly coordinates the aerial platform and manipulator to realize the desired end-effector trajectory. To eliminate reliance on external motion-capture infrastructure, the platform employs onboard LiDAR-inertial odometry for state estimation during outdoor operation. We validate the complete framework on a physical aerial manipulator and demonstrate successful execution of outdoor manipulation tasks. The experimental results show that demonstration-driven manipulation policies can be effectively integrated with onboard state estimation and model-based whole-body control to enable aerial manipulation beyond controlled indoor environments.

Figures & tables

Explore similar work

CardsList
  1. Reinforcement Learning with Inner-loop Dynamics Estimator for Aerial Manipulation under Uncertainty

    Jun 15, 2026Shivansh Pratap Singh, Samaksh Ujjwal, Ishita Chaudhary +3Robot Dynamics IdentificationRL for Robotics

  2. AdaptManip: Learning Adaptive Whole-Body Object Lifting and Delivery with Online Recurrent State Estimation

    Feb 16, 2026Morgan Byrd, Donghoon Baek, Kartik Garg +5RL for RoboticsRobotic Manipulation

  3. ππ, But Make It Fly: Physics-Guided Transfer of VLA Models to Aerial Manipulation

    Mar 26, 2026Johnathan Tucker, Denis Liu, Aiden Swann +7Aerial ManipulationVision-Language-Action Models