cs.RONov 11, 2026

APG-Planner: Learning Vision-Based High-Speed Trajectory Planning via Analytic Policy Gradient

Authors: Jinwoo Lee, Geunsik Bae, Changseung Kim, Jiwoo Kim, Woojae Shin, Hyondong Oh

Abstract

Vision-based high-speed navigation requires a trajectory planner that can reactively generate smooth, collision-free trajectories from onboard visual observations. Deep reinforcement learning offers a promising approach to vision-based trajectory planning, as it enables the optimization of sequential decision-making policies in complex environments. However, model-free policy gradient methods rely on sample-based policy gradient estimation, which yields noisy gradient estimates and inefficient training. To this end, we propose a framework for learning trajectory planning policies using the analytic policy gradient (APG) method and use it to train APG-Planner, a vision-based high-speed trajectory planner. The proposed framework leverages differential flatness to analytically reconstruct vehicle states from planned trajectories, thereby enabling differentiable trajectory-level state transitions without requiring an explicit low-level dynamics model. By iteratively performing trajectory planning and differentiable state transitions, we construct a differentiable episode rollout and analytically compute policy gradients from episode-level losses, improving both training efficiency and policy performance. After approximately 30 minutes of training on a single GPU, APG-Planner demonstrates comparable or superior performance to existing baseline methods in simulation and achieves speeds of up to 11,m/s in real-world flight experiments. We further validate the proposed framework on a skid-steer ground robot, demonstrating its applicability to differentially flat robotic systems beyond quadrotors.

Figures & tables

Explore similar work

CardsList
  1. Learning Vision-Based Agile Gap Traversal: Differentiable Simulation with a Warm-Started Critic

    Sep 25, 2026Nuthasith Gerdpratoom, Tianchen Sun, Yichao Gao +1Visuomotor Policy LearningRobotic RL

  2. Simple but Stable, Fast and Safe: Achieve End-to-end Control by High-Fidelity Differentiable Simulation

    Apr 12, 2026Fanxing Li, Shengyang Wang, Yuxiang Huang +5Quadrotor ControlVision-Based Robot Control

  3. Path Planning Using Deep Deterministic Policy Gradient: A Reinforcement Learning Approach

    Jun 5, 2026Qiang Le, Yaguang Yang, Isaac E. WeintraubConstrained Motion PlanningSafe Motion Planning