Thermal Image Refinement with Depth Estimation using Recurrent Networks for Monocular ORB-SLAM3
Organizations: Automatic Control Group (RAT), Paderborn University, 33098 Paderborn, Germany · Department of Electrical and Computer Engineering, Aarhus University, 8000 Aarhus C, Denmark, and also with Upteko ApS, Denmark
Abstract
Autonomous navigation in GPS-denied and visually degraded environments remains challenging for unmanned aerial vehicles (UAVs). To this end, we investigate the use of a monocular thermal camera as a standalone sensor on a UAV platform for real-time depth estimation and simultaneous localization and mapping (SLAM). To extract depth information from thermal images, we propose a novel pipeline employing a lightweight supervised network with recurrent blocks (RBs) integrated to capture temporal dependencies, enabling more robust predictions. The network combines lightweight convolutional backbones with a thermal refinement network (T-RefNet) to refine raw thermal inputs and enhance feature visibility. The refined thermal images and predicted depth maps are integrated into ORB-SLAM3, enabling thermal-only localization. Unlike previous methods, the network is trained on a custom non-radiometric dataset, obviating the need for high-cost radiometric thermal cameras. Experimental results on datasets and UAV flights demonstrate competitive depth accuracy and robust SLAM performance under low-light conditions. On the radiometric VIVID++ (indoor-dark) dataset, our method achieves an absolute relative error of approximately 0.06, compared to baselines exceeding 0.11. In our non-radiometric indoor set, baseline errors remain above 0.24, whereas our approach remains below 0.10. Thermal-only ORB-SLAM3 maintains a mean trajectory error under 0.4 m.
Figures & tables
| Model | AbsRel | RMSE | a1 | a2 | a3 |
|---|---|---|---|---|---|
| Shin (T) [ 31 ] | 0.232 | 0.740 | 0.618 | 0.907 | 0.987 |
| Shin (MS) [ 31 ] | 0.166 | 0.566 | 0.768 | 0.967 | 0.994 |
| Shin (Max.) [ 13 ] | 0.149 | 0.517 | 0.813 | 0.969 | 0.994 |
| ZoeDepth [ 29 ] | 0.165 | 0.533 | 0.788 | 0.944 | 0.991 |
| DepthAnything-V2 [ 30 ] | 0.112 | 0.378 | 0.902 | 0.970 | 0.990 |
| Ye et al. [ 33 ] | 0.145 | 0.499 | 0.827 | 0.969 | 0.994 |
| Model | AbsRel | RMSE | a1 | a2 | a3 |
|---|---|---|---|---|---|
| Shin (Max.) [ 13 ] | 0.262 | 1.273 | 0.589 | 0.890 | 0.960 |
| ZoeDepth [ 29 ] | 0.243 | 1.110 | 0.605 | 0.885 | 0.954 |
| DepthAnything-V2 [ 30 ] | 0.267 | 1.043 | 0.571 | 0.863 | 0.931 |
| ResNet8+GRU (ours) | 0.109 | 0.516 | 0.886 | 0.943 | 0.969 |
| MobileNet+GRU (ours) | 0.085 | 0.453 | 0.911 | 0.951 | 0.971 |
| Eff-B0+GRU (ours) | 0.079 | 0.424 | 0.920 | 0.955 | 0.971 |
Depth Estimation
Depth estimation infers scene distance from images and sensors, enabling 3D reconstruction, navigation, and spatial understanding.
See all 196 papers