What Limits Thermal Infrared Drone Detection? A Cross-Dataset Benchmark Analysis
Organizations: Institute for the Protection of Terrestrial Infrastructures, German Aerospace Center (DLR), Sankt Augustin, Germany · ACIDA Lab, Technical University of Applied Sciences Würzburg-Schweinfurt, Schweinfurt, Germany · EUT+ Data Science Institute, European University of Technology, European Union
Abstract
Thermal infrared (IR) imaging enables drone detection with reduced dependence on ambient illumination, supporting continuous surveillance beyond the limitations of visible-spectrum sensing. However, substantial and often undocumented variability in camera systems, processing pipelines, and annotation practices across public IR drone datasets complicates the assessment of detector performance and cross-domain generalization. To examine these sources of variability and their implications for drone detection, we systematically characterize existing IR datasets and establish an artifact taxonomy reflecting their origins across the acquisition and processing pipeline, encompassing optical and sensor effects, tone mapping and image enhancement, and recording-related artifacts. Focusing on long-wave IR data, we investigate the impact of training data composition and model characteristics on YOLO-based detection performance, generalization, and condition-dependent failure modes. Our results demonstrate that detection performance is governed more strongly by training data composition than by YOLO generation or model capacity, while cross-dataset generalization exhibits pronounced asymmetries. Even the best-performing configuration fails to detect over 40% of drones, with elevated miss rates for very small targets, cluttered urban backgrounds, and thermal crossover, highlighting the shortcomings of existing datasets.
Figures & tables
| Dataset | Pub. Year | No. Seq. | No. Frames | Resolution | IR Band | OSD | Image Quality / Visual Artifacts |
| (k) | (px) | ||||||
| LRDDv3 [ 19 ] | 2026 | 38 | 29.6 | 640 512 | LWIR | ✗ | shaprness, blur, pseudocolor mapping |
| CST Anti-UAV [ 31 ] | 2025 | 220 | 238 | 640 512 | LWIR | ✓ | sharpening & compression artifacts |
| Anti-UAV410 [ 8 ] | 2023 | 410 | 438 | 640 512 | MWIR | ✓ | lens reflection, compression, motion blur |
| Hamburg2 (H2) [ 2 ] | 2023 | 23 | 65 | 640 480 | LWIR | ✗ | compression artifacts, watermark, |
| 1024 768 | vignetting, motion blur, defocus blur |
| Model | Scale | Params (M) | FLOPs (B) |
|---|---|---|---|
| YOLOv8 | n | 3.2 | 8.7 |
| s | 11.2 | 28.6 | |
| m | 25.9 | 78.9 | |
| l | 43.7 | 165.2 | |
| YOLO11 | s | 9.4 | 21.5 |
| m | 20.1 | 68.0 |
| Dataset | Subsets | Split | ||
| train | val | test | ||
| H2 [ 2 ] | FLIR | 26,368 | – | 14,251 |
| InfraTec | 23,373 | – | 2,446 | |
| Total | 49,741 | – | 16,697 | |
| LRDDv3 [ 19 ] | – | 18,460 | 3,379 | 7,623 |
| CST [ 31 ] | – | 124,301 | 43,527 | 70,214 |
| Split | Background Category | |||||
|---|---|---|---|---|---|---|
| building | mountain | sky | jungle | urban | water | |
| train | 53,648 | 20,230 | 8,470 | 4,908 | 26,177 | 10,868 |
| val | 13,974 | 9,659 | 2,231 | 1,197 | 11,670 | 4,796 |
| test | 8,458 | 10,687 | 6,611 | 13,651 | 26,004 | 4,803 |
| Size | mAP | FNR | ||
|---|---|---|---|---|
| Cat. | @0.25 | @0.5 | @0.5-0.95 | |
| XXS | 0.675 | 0.623 | 0.320 | 0.705 |
| XS | 0.808 | 0.799 | 0.528 | 0.452 |
| S | 0.848 | 0.842 | 0.569 | 0.343 |
| M | 0.553 | 0.543 | 0.391 | 0.690 |
| L | – | – | – | – |
| Background | mAP | FNR | FDR | ||
|---|---|---|---|---|---|
| Category | @0.25 | @0.5 | @[email protected] | ||
| water | 0.999 | 0.978 | 0.689 | 0.119 | 0.013 |
| sky | 0.986 | 0.951 | 0.449 | 0.222 | 0.033 |
| jungle | 0.779 | 0.772 | 0.507 | 0.582 | 0.009 |
| mountains | 0.768 | 0.739 | 0.513 | 0.511 | 0.020 |
| urban areas | 0.617 | 0.602 | 0.364 | 0.678 | 0.024 |
| Attr. | Incl. | mAP | FNR | ||
|---|---|---|---|---|---|
| @0.25 | @0.5 | @0.5-0.95 | |||
| TC | ✗ | 0.887 | 0.868 | 0.545 | 0.377 |
| ✓ | 0.666 | 0.643 | 0.397 | 0.653 | |
| DBC | ✗ | 0.768 | 0.748 | 0.470 | 0.532 |
| ✓ | 0.707 | 0.670 | 0.388 | 0.604 | |
| CDB | ✗ | 0.792 | 0.770 | 0.481 | 0.494 |
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| Size Category | Object Area ( ) | Description |
|---|---|---|
| xx-small (XXS) | extremely tiny objects | |
| x-small (XS) | very small objects | |
| small (S) | small objects | |
| medium (M) | medium-sized objects | |
| large (L) | large objects |
| Model | mAP | FDR | FNR | ||
|---|---|---|---|---|---|
| @0.25 | @0.5 | @0.5-0.95 | |||
| YOLOv8n | 0.657 | 0.637 | 0.386 | 0.084 | 0.538 |
| YOLOv8s | 0.648 | 0.619 | 0.363 | 0.367 | 0.419 |
| YOLOv8m | 0.711 | 0.691 | 0.420 | 0.062 | 0.532 |
| YOLOv8l | 0.747 | 0.726 | 0.452 | 0.030 | 0.537 |
| YOLO11s | 0.742 | 0.717 | 0.434 | 0.068 | 0.472 |
| YOLO | Size | mAP | FNR | ||
|---|---|---|---|---|---|
| Model | Cat. | @0.25 | @0.5 | @0.5-0.95 | |
| v8n | XXS | 0.553 | 0.505 | 0.257 | 0.671 |
| XS | 0.728 | 0.720 | 0.468 | 0.463 | |
| S | 0.801 | 0.789 | 0.495 | 0.407 | |
| M | 0.461 | 0.411 | 0.260 | 0.785 | |
| L | – | – | – | – | |
| YOLO | Attr. | Incl. | mAP | FNR | ||
|---|---|---|---|---|---|---|
| Model | @0.25 | @0.5 | @0.5-0.95 | |||
| v8n | TC | ✗ | 0.864 | 0.843 | 0.519 | 0.314 |
| ✓ | 0.542 | 0.517 | 0.307 | 0.700 | ||
| DBC | ✗ | 0.674 | 0.655 | 0.402 | 0.536 | |
| ✓ | 0.653 | 0.596 | 0.323 | 0.562 | ||
| CDB | ✗ | 0.712 | 0.689 | 0.418 | 0.498 | |
| YOLO | Background | mAP | FNR | FDR | ||
|---|---|---|---|---|---|---|
| Model | Category | @0.25 | @0.5 | @[email protected] | ||
| v8n | water | 1.000 | 0.987 | 0.674 | 0.089 | 0.021 |
| sky | 0.987 | 0.963 | 0.458 | 0.235 | 0.037 | |
| jungle | 0.710 | 0.700 | 0.441 | 0.454 | 0.151 | |
| mountains | 0.667 | 0.630 | 0.416 | 0.522 | 0.039 | |
| urban | 0.511 | 0.499 | 0.294 | 0.762 | 0.042 | |
Infrared Object Detection
Infrared object detection locates and classifies objects in thermal imagery, including small, low-contrast targets and visible–thermal scenes.
See all 35 papers