DroneDiffusion: Uncertainty-Guided Diffusion Path Planner for UAV Navigation
Authors: Ivan Valuev, Iana Zhura, Valerii Serpiva, Miguel Altamirano Cabrera, Dzmitry Tsetserukou
Organizations: The authors are with the Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology, Moscow, Bolshoy Boulevard 30, bld. 1, 121205, Moscow, Russia.
We present DroneDiffusion, a perception-aware diffusion planner for local 3-D UAV trajectory generation that explicitly models and avoids failure zones caused by lens flare, overexposure, and reflective surfaces. A vision-language perceptual safety estimator produces a pixel-aligned reliability map that highlights regions of degraded sensing. A denoising diffusion probabilistic model (DDPM) is conditioned on this map together with the onboard RGB image, goal point, and initial velocity to generate egocentric 3-D trajectories. To enforce obstacle avoidance at inference time without retraining, we apply training-free CHOMP guidance over a 3-D Euclidean signed distance field. The model is trained entirely in simulation and deployed zero-shot on a real drone. Reliability conditioning raises the mean perceptual reliability along generated trajectories to 0.71, compared with 0.63 for a geometric baseline, while guidance halves the collision rate of the learned prior from 14.7% to 7.8%. Perceptual safety conditioning and geometric guidance are therefore complementary: treating sensor reliability as a first-class signal reduces incursions into unreliable regions while maintaining competitive navigation performance.
Figures & tables
Fig. 1 : Perception failures in indoor UAV flight. Left: RGB observation with severe lens flare. Middle: corresponding depth map with missing and phantom geometry in the corrupted region. Right: our safety map flags the unreliable zone (red), guiding trajectory generation (magenta) away from it.
Fig. 2 : DroneDiffusion pipeline. Left: the corrupted trajectory xt is denoised over n reverse-diffusion steps by a conditional 1-D U-Net, conditioned on the RGB observation, the AnyTraverse reliability map, the initial speed and the goal point, and corrected at each step by training-free obstacle and goal guidance. Right: scene and reliability tokens enter the U-Net bottleneck through two sequential cross-attention blocks, which keeps appearance and perceptual-reliability reasoning separate.
Prompt
Weight ωi
Transparent and specular geometry
a window
1.0
a glass surface
1.0
a transparent surface
1.0
a transparent obstacle
1.0
a mirror
1.0
TABLE I : Perceptual uncertainty prompts and pooling weights ω used in AnyTraverse.
Parameter
Value
Parameter
Value
Cold reverse steps
500
Refinement start t
300
Refinement steps
11
ESDF voxel size
0.05m
UAV radius
0.25m
Safety margin
0.10m
CHOMP η
0.7m
Obstacle coefficient
0.75
Maximum correction
0.08m
Anisotropy A
[0.8,1.0,1.0]
ρ0,ρ2,ρ3
1.0,1.0,0.2
Goal weight λg
0.25
TABLE II : Diffusion and geometric-guidance configuration.
Metric
Full (Ours)
w/o Guid.
w/o Guid. and Reliab.
APF
Collision (%) ↓
7.770±1.150
14.710±2.270
13.320±1.320
6.650±0.000
Min. clearance (m) ↑
0.618±0.013
0.602±0.014
0.610±0.016
0.613±0.000
Unsafe WP (%) ↓
12.890±1.550
14.590±1.780
16.590±1.430
20.520±0.000
Mean reliability ↑
0.714±0.016
0.730±0.013
0.689±0.015
0.626±0.000
Tail reliability ↑
0.522±0.033
0.538±0.005
0.518±0.018
0.390±0.000
Goal error (m) ↓
0.723±0.012
0.610±0.011
0.666±0.014
0.601±0.000
TABLE III : Trajectory-generation results on real drone observations, averaged over five seeds (mean and std across seeds, APF is deterministic). Best per row in bold.
Stage
Mean
Min.
Max.
Share
ESDF
18.38
16.84
21.17
10.13%
AnyTraverse
122.14
117.13
125.23
67.35%
SceneEncoder
5.23
5.06
5.78
2.88%
Generation + guidance (11 steps)
35.61
33.28
38.35
19.63%
Full pipeline (warm start)
181.36
173.87
186.21
100%
TABLE IV : Runtime breakdown on an NVIDIA RTX 4070 Super (12 GB).