Organizations: Department of Informatics and Telematics, Harokopio University of Athens, Athens, Greece · Archimedes, Athena Research Center, Athens, Greece
In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time perception applications. Moreover, recent advances in 3D Gaussian Splatting (3DGS) have demonstrated significant potential for real-time neural rendering. However, their integration into end-to-end UAV-based reconstruction and visualization systems remains underexplored. Our goal is to propose an efficient architecture that combines live video acquisition via RTMP streaming, synchronized sensor fusion, camera pose estimation, and 3DGS optimization, achieving continuous model updates and low-latency deployment within interactive visualization environments that supports immersive augmented and virtual reality (AR/VR) applications. Experimental results demonstrate that the proposed method achieves competitive visual fidelity, while delivering significantly higher rendering performance and substantially reduced end-to-end latency, compared to NeRF-based approaches. Reconstruction quality remains within 4-7% of high-fidelity offline references, confirming the suitability of the proposed system for real-time, scalable augmented perception from aerial platforms.
Figures & tables
Fig. 1: Complex stadium site reconstructed using the proposed approach.
Fig. 2: Developed pipeline for converting UAV video streams into 3DGS representations integrated into a Unity environment.
Dataset
Method
SSIM
PSNR
LPIPS
Train
FPS
Memory
Mip-NeRF360 [ 28 ]
Instant-NGP (Base)
0.671
25.30
0.371
5m 37s
11.7
13MB
Mip-NeRF360
0.792
27.69
0.237
48h
0.06
8.6MB
Ours7K
0.770
25.60
0.279
6m 25s
160
523MB
Ours30K
0.815
27.21
0.214
41m 33s
134
734MB
Tanks and temples [ 29 ]
Instant-NGP (Base)
0.723
21.72
0.330
5m 26s
17.1
13MB
Mip-NeRF360
0.759
22.22
0.257
48h
0.14
8.6MB
TABLE I: Experimental evaluation and comparison of reconstruction quality and resource efficiency.