MITE-Net: SWaP-Optimized 4K Video Tiny Target Perception for Embodied Edge SAR
Organizations: School of Mathematics and Computing Science, University of Leicester, Leicester LE1 7RH, UK · Machine Life and Intelligence Research Center, Guangzhou University, Guangzhou 510006, China
Abstract
Real-time tiny target perception in high-resolution imagery is critical for embodied Search-and-Rescue (SAR) missions. However, strict Size, Weight, and Power (SWaP) constraints on edge devices like UAVs create a bottleneck: traditional image downsampling causes severe feature loss, while slice-based processing incurs prohibitive latency. To address this gap, this paper introduces a comprehensive framework encompassing a novel architecture, specialized datasets, and hardware-level benchmarks. First, we propose MITE-Net, a SWaP-optimized cascaded architecture, which couples a bio-inspired, learning-free Tiny Target Motion-Based Region Proposal Network (TTM-RPN) with a sub-0.14M-parameter R-CNN-like head. Second, to standardize 4K tiny target evaluation, we construct the SAR-Tiny Datasets by relabeling two challenging UAV datasets: SeaDroneSee-Tiny (dynamic maritime scenes, tiny targets predominantly of 64-256 pixels ) and UAVID-Tiny (cluttered urban scenes, extremely tiny targets, less than 64 pixels). Third, we benchmark against state-of-the-art YOLO models on an edge device, NVIDIA Jetson AGX Xavier, where MITE-Net directly processes 4K maritime imagery, achieving a 100% search success rate at 30.33 FPS. Consuming merely 3.19 W (9.51 FPS/W), MITE-Net vastly outperforms YOLO baselines in target recall and energy efficiency. Conversely, UAVID-Tiny evaluations expose a compound structural limitation: the learning-free bionic front-end struggles against urban backgrounds, while the ultra-lightweight head lacks representational capacity for complex features. Ultimately, this work delivers an efficient onboard perception paradigm and a rigorous baseline guiding future end-to-end SAR architectures.
Figures & tables
| Dataset | Split | Sequences | Frames | BBoxes | Target Density | Key Characteristics |
|---|---|---|---|---|---|---|
| SeaDroneSee-Tiny | Train | seq 2, 3, 4, 5, 6, 7, 8 | 3858 | 7178 | 1-5 / frame | Dynamic maritime backgrounds. |
| Val | seq 9 | 1001 | 3003 | 3 / frame | Baseline maritime background evaluation. | |
| Test | seq 1 | 1001 | 11243 | 12 / frame | Density mimicking real-world SAR crises. | |
| UAVID-Tiny | Train | seq 2, 5, 7, 8, 16, 17, 33 | 3208 | 63398 | 10-50/ frame | Massive urban clutter. |
| Val | seq 24 | 901 | 15063 | 16 / frame | Occlusion and varied lighting conditions. | |
| Test | seq 23 | 701 | 9839 | 14 / frame | Early-stage target discovery in urban scenes. |
| YOLOv11n [ 10 ] | YOLOv8n-P2 [ 9 ] | MITE-Net (Proposed) | |||||
| Resize | Resize | SAHI [ 11 ] | Raw 4K + 2ds | Raw 4K + 8ds | |||
| SAR Criteria | SDS-T | Search Success Rate (%, ) | 83.33 | 83.33 | 100 | 100 | 83.33 |
| False Alarm Rate (%, ) | 6.83 | 16.77 | 3.12 | 67.72 | 82.29 | ||
| Max Search Time (Frame, ) | 126 | 74 | 385 | 299 | 119 | ||
| Avg. Search Time (Frame, ) | 17.90 | 11.20 | 62.58 | 69.00 | 36.80 | ||
| U-T | Search Success Rate (%, ) | 11.11 | 22.22 | 36.11 | 8.33 | 0.00 | |
| Configurations | SAR Criteria | SWaP Criteria | |||||||
|---|---|---|---|---|---|---|---|---|---|
| ds | SSR ( ) | FAR ( ) | FPS ( ) | Eff. ( ) | Total FLOPs (G, ) | TTM-RPN FLOPs (G, ) | R-CNN-like Head FLOPs (G, ) | ||
| vSTMD | Others | ||||||||
| 1 | 25 | 100.00 | 67.83 | 11.81 | 7.43 | 2.1851 | 1.9972 | 0.0317 | 0.1561 |
| 2 | 10 | 100.00 | 35.41 | 30.94 | 10.18 | 0.5268 | 0.3689 | 0.0258 | 0.1321 |
| 25 | 100.00 | 67.72 | 30.33 | 10.32 | 0.5605 | 0.3689 | 0.0258 | 0.1657 | |
| 50 | 100.00 | 82.76 | 30.16 | 10.12 | 0.5607 | 0.3689 | 0.0258 | 0.1659 | |
| Module | SeaDroneSee-Tiny | UAVID-Tiny | ||
|---|---|---|---|---|
| R 0.1 | R 0.5 | R 0.1 | R 0.5 | |
| TTM-RPN (No-Category) | 0.9584 | 0.5812 | 0.1047 | 0.0580 |
| R-CNN-Head (Category) | 0.7377 | 0.7072 | 0.0230 | 0.0103 |
| Motion Information | R 0.1 | R 0.5 |
|---|---|---|
| 0.7377 | 0.7072 | |
| 0.7306 | 0.7012 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Model | Resolution | mAP | mAR | m | FPS | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SeaDroneSee -Tiny | YOLOv8n-P2 [ 9 ] | SAHI [ 11 ] ( ) | 0.46 | 0.59 | 0.54 | 0.60 | 0.63 | 0.64 | 0.60 | 0.65 | 0.65 | 4.79 |
| YOLOv11n [ 10 ] | Resize ( ) | 0.24 | 0.46 | 0.18 | 0.24 | 0.48 | 0.46 | 0.27 | 0.48 | 0.46 | 29.15 | |
| YOLOv8n-P2 [ 9 ] | Resize ( ) | 0.26 | 0.42 | 0.28 | 0.26 | 0.49 | 0.47 | 0.28 | 0.47 | 0.37 | 31.22 | |
| MITE-Net (Ours) | Raw (4K + 2ds) | 0.27 | 0.38 | 0.08 | 0.47 | 0.48 | 0.48 | 0.30 | 0.40 | 0.38 | 30.33 | |
| UAVID-Tiny | YOLOv8n-P2 [ 9 ] | SAHI [ 11 ] ( ) | 0.04 | 0.34 | 0.16 | 0.04 | 0.47 | 0.31 | 0.03 | 0.31 | 0.21 | 4.15 |