TransNav: Transformer-Based End-to-End Navigation Method for Static and Dynamic Quadrotor Obstacle Avoidance

Jianghan Zhu; Zhuo Li; Yanjun Zhang; Jian Sun

cs.ROOct 16, 2026

TransNav: Transformer-Based End-to-End Navigation Method for Static and Dynamic Quadrotor Obstacle Avoidance

Authors: Jianghan Zhu, Zhuo Li, Yanjun Zhang, Jian Sun

Organizations: The authors are with the State Key Laboratory of Autonomous Intelligent Unmanned Systems, School of Automation, Beijing Institute of Technology, Beijing 100081, China

Abstract

Obstacle avoidance for autonomous quadrotors in cluttered environments remains challenging, especially when both dense static obstacles and moving obstacles are present. Existing methods are often tailored to either static or dynamic settings, which always limit their adaptability across diverse environments. This paper presents TransNav, a transformer-based end-to-end navigation method for quadrotor obstacle avoidance in both static and dynamic environments. TransNav employs a patch-based point-cloud encoding scheme that combines local feature extraction with global contextual modeling, enabling compact yet informative environment representation. The method integrates perception and navigation in a single architecture and directly predicts a finite-horizon action sequence, from which the first action is executed. Moreover, we develop an unsupervised learning strategy by incorporating a lightweight point-mass dynamics model, which directly optimizes trajectory-level costs over the predicted sequence through numerical gradient propagation. Thus, the policy can be efficiently trained without expert demonstrations. Simulation and real-world experiments show that the proposed method achieves strong performance in dense static environments and competitive obstacle-avoidance capability in dynamic scenarios, while maintaining low inference cost for onboard deployment.

Figures & tables

Fig. 1: Hardware platform of the quadrotor in real-world experiments.

Fig. 2: System architecture. Patches of the distance map and sampled states are encoded respectively and then concatenated into a token sequence to be input into the transformer encoder for predicting the acceleration sequence within a time horizon. ESDF map is obtained from the training dataset and is used only during training to evaluate the loss function and compute the gradients. The dataset is sampled from ten randomly generated training environments. In real-world deployment, the state of quadrotor is obtained using the state estimation method (e.g., Fast-LIO2 [ 19 ] , and Point LIO [ 20 ] ).

Fig. 3: Illustration of patch-based LiDAR sensing representation. The distance map is composed of the distances from the nearest point of each partition, which are divided into 100 patches to be input into the subsequent transformer encoder for feature extraction.

Fig. 4: Illustration of backpropagation process. The output action sequence is applied to the simple point-mass model to obtain the state sequence prediction in future horizon. The complete gradient of the loss with respect to the network parameters is obtained directly through backpropagation, and the temporal gradient decay is used to alleviate gradient explosion during the backpropagation process.

Fig. 5: Visualization of flight slices in simulation. The scenarios labeled (a) to (f) correspond to scenarios 1 to 6 in table I , respectively.

Scenario	Method	$\eta(\%)$	$v_{a}(m/s)$	$t_{p}(ms)$	$R_{l}$
60 static	Ours	100	2.71	6.72	1.12
	[ 12 ]	85	3.12	11.73	1.05
	[ 16 ]	80	2.63	9.59	1.05
	[ 18 ]	100	0.90	23.14	1.05
	[ 10 ]	60	2.46	8.43	2.07
105 static	Ours	100	1.97	7.01	1.19

TABLE I: SIMULATED COMPARISON IN DIFFERENT TYPES OF ENVIRONMENTS.

Fig. 6: Real-world experiments. (a) Highlight of a vertical avoidance capability. (b)-(c) Agile flight among static obstacles. (d) Flight through a gate. (e)-(g) Navigation among static and dynamic obstacles. (h) Avoiding fast-moving obstacles. White curves represent the movement paths of dynamic obstacles.

Scenario	Ablation	$\eta(\%)$	$v_{a}(m/s)$	Parameters
60 static	Ours	100	2.71	0.6M
	w/o decay	100	1.07	0.6M
	w/o patch	50	1.20	1.7M
	w/o sequence	N/A	N/A	0.6M
	encoders	N/A	N/A	$\geq$ 3.7M
	PPO	N/A	N/A	0.6M

TABLE II: ABLATION STUDY

Robot Navigation

Robot navigation studies how robots perceive, localize, plan, and move safely toward goals in static or changing environments.

See all 554 papers

ClearNav: Perception-Aligned Quadrotor Flight Using Differential-Physics
Oct 12, 2026Aditya Azad, Arthur Huang, Guanrui LiUAV Navigation Robot Navigation
Worcester Polytechnic Institute, MA, USA · Northeastern University, MA, USA
Learning Agile Navigation in Crowded Environments for Quadruped Robots
Jul 16, 2026Shuyu Wu, Zeyu Liu, Tianbao Zhang +6Robot Policy Learning Robot Navigation
Shanghai Jiao Tong University, Shanghai 200240, China · State Key Laboratory of High-end Heavy-load Robots, Midea Group, Foshan 528300, China
Anticipatory Risk-Guided Reinforcement Learning for Safe Flight Through Dynamic Clutter
Jul 26, 2026Yuchao Mei, Guohao Zhang, Luxia Ai +2Collision Avoidance Risk-Sensitive RL
National Key Laboratory of Science and Technology on Multi-spectral Information Processing, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China

Oct 12, 2026J/K move · Enter open · S save

ClearNav: Perception-Aligned Quadrotor Flight Using Differential-Physics

Aditya Azad, Arthur Huang, Guanrui Li

Worcester Polytechnic Institute, MA, USA · Northeastern University, MA, USA

UAV Navigation Robot Navigation Robot Collision Avoidance Quadrotor Control

Open paper AskPDF arXiv

Autonomous quadrotor flight in cluttered environment is an key capability for tasks like inspection and search. Navigation policies trained in simulation and transferred to hardware can fly at high speed in open space, but they can still collide as obstacle clearance shrinks. We attribute most of these collisions to a single mechanism, namely motion in directions the onboard camera does not observe. Heading that is not aligned with the direction of travel and lateral excursion during obstacle avoidance both carry the vehicle toward obstacles outside its field of view. We introduce ClearNav, a navigation policy trained with two reward terms that constrain motion to the observed direction, a forward-looking heading target and a penalty on lateral velocity. A third term penalizes speed near obstacles so that an obstacle entering the field of view remains avoidable. In simulation, across 18 held-out scenarios with 2304 paired flights per policy unseen in training, ClearNav improves success by 6.8 points, cuts the collision rate by 65% relative to the state of the arts, and flies at maximum 5m/s. For the proximity term alone under matched commanded speeds, the collision reduction still holds at 70%. The effect is significant on static scenes and consistent in direction on moving obstacles, though not significant there at the suite level, showing that safer flight in clutter is possible even on the limited sensors and compute of small drones. We also validate our navigation policy in a real-world cluttered environment, showing that it enables the quadrotor to navigate through the cluttered environment successfully and safely.

Abstract

Robot Navigation

Explore similar work

ClearNav: Perception-Aligned Quadrotor Flight Using Differential-Physics

Learning Agile Navigation in Crowded Environments for Quadruped Robots

Anticipatory Risk-Guided Reinforcement Learning for Safe Flight Through Dynamic Clutter