cs.ROAug 14, 2026

PILOT: Privileged Imitation Learning for End-to-End Motion Planning of Autonomous UAVs under Partial Observability

Authors: Qingrui Zhang, Feng Xue, Xiang Zhou, Chenghao Yu

Organizations: School of Aeronautics and Astronautics, Sun Yat-sen University (Shenzhen Campus), Shenzhen, China

Abstract

Autonomous navigation in cluttered environments is hampered by partial observability and dynamic constraints. This paper presents PILOT, a constraint-aware privileged imitation learning framework for vision-based end-to-end UAV motion planning under partial observability. The framework distills planning strategies from a computationally intensive optimal control expert into a student policy regularized toward safety and dynamic requirements via a dual-objective loss function. To mitigate partial observability, a spatiotemporal perception fusion module using a Temporal Convolutional Network (TCN) is developed to integrate historical depth images and odometry. This module infers task-relevant latent context from historical observations, enhancing spatial awareness beyond the instantaneous FOV without maintaining persistent map memory. A trajectory parameterization layer mapping network outputs to a structured trajectory, while enabling explicit continuity, dynamic-consistency, and obstacle soft penalties during training, encouraging constraint satisfaction for unseen observations without formal guarantees. Simulations on quadrotor and fixed-wing aircraft demonstrate that PILOT achieves performance comparable to the privileged expert while reducing computational overhead by over 80%. Successful indoor and outdoor zero-shot deployment confirms the practical feasibility and cross-domain generalization of the planner.

Figures & tables

Explore similar work

CardsList
  1. KIO-planner: Attention-Guided Single-Stage Motion Planning with Dual Mapping for UAV Navigation

    May 19, 2026Dexing Yao, Haochen Li, Junhao Wei +11Constrained Motion PlanningKinodynamic Motion Planning

  2. Unified Planning-Learning Framework for Robust UUV Navigation Under Partial Observability

    Aug 5, 2026Md Ether Deowan, Eleni KelasidiRL ControlPartially Observable RL

  3. FlowPilot: Real-Time World-Action Modeling for Agile UAV Navigation

    Aug 1, 2026Runqing Wang, Ding Yu, Pengyuan Min +6World Models for RoboticsUAV Navigation