SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Clutter-Aware SAR Ship Detection
Organizations: Yunnan Normal University, No. 768, Jucheng Avenue, Chenggong District, Kunming 650500, China.
Abstract
Ship detection in Synthetic Aperture Radar (SAR) imagery is challenged by coherent speckle noise, complex coastal clutter, and the prevalence of small-scale targets. Conventional detectors, primarily designed for optical imagery, often exhibit limited adaptability to SAR-specific degradation and suffer from the loss of fine-grained ship signatures during spatial downsampling. To address these limitations, we propose SARES-DEIM, a domain-aware detection framework grounded in the DEtection TRansformer (DETR) paradigm. Central to our approach is SARESMoE (SAR-aware Expert Selection Mixture-of-Experts), a module leveraging a sparse gating mechanism to selectively route features toward specialized wavelet, spatial, and frequency-oriented experts. This sparsely activated architecture enhances clutter-aware representation while keeping the active inference cost controlled. Furthermore, we introduce the Space-to-Depth Enhancement Pyramid (SDEP) neck to preserve high-resolution spatial cues from shallow stages and improve the localization of small targets. Experiments on HRSID and SAR-Ship-Dataset show that SARES-DEIM achieves competitive results across both public benchmarks, with more prominent advantages on the challenging HRSID dataset. Specifically, SARES-DEIM achieves 76.4% mAP50:95 and 93.8% mAP50 on HRSID, while keeping the active computation at 72.6 GFLOPs and 136.5 FPS on a single NVIDIA A40 GPU with batch size 8; the batch-size-1 latency is 37.6 ms.
Figures & tables
| Model | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) | FPS |
|---|---|---|---|---|---|---|---|
| Faster R-CNN [ 40 ] | – | 88.0 | 82.1 | – | 136.7 | 147.8 | – |
| SSD [ 41 ] | – | 90.1 | 81.0 | – | 32.0 | 70.0 | – |
| FCOS [ 42 ] | – | 81.1 | 83.6 | – | 36.3 | 128.0 | – |
| CSCF-Net [ 43 ] | – | 91.5 | 90.7 | – | 2.61 | 9.4 | – |
| SAR-D-FINE [ 44 ] | 72.0 | 90.8 | 91.2 | – | 11.8 | 31.0 | 109.0 |
| OptiSAR-Net [ 45 ] | 65.4 | 90.2 | – | – | 2.7 | 11.8 | 90.6 |
| Model | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) | FPS |
|---|---|---|---|---|---|---|---|
| Faster R-CNN [ 40 ] | – | 86.3 | 80.7 | – | 136.7 | 147.8 | – |
| SSD [ 41 ] | – | 88.9 | 87.1 | – | 32.0 | 70.0 | – |
| FCOS [ 42 ] | – | 87.5 | 89.1 | – | 36.3 | 128.0 | – |
| CoAM-Darknet [ 47 ] | – | 96.0 | 93.7 | 95.3 | 65.8 | 123.5 | – |
| YOLOv8-S ∗ [ 48 ] | 66.1 | 97.1 | 94.5 | 93.6 | 9.8 | 23.6 | 212.8 |
| YOLOv8-M ∗ [ 48 ] | 66.2 | 95.5 | 91.5 | 90.8 | 23.2 | 67.8 | 204.8 |
| Model | Params (M) | FLOPs (G) | FPS (batch size 8) | Latency (ms, batch size 1) |
|---|---|---|---|---|
| YOLOv8-S [ 48 ] | 9.8 | 23.6 | 212.8 | 11.2 |
| YOLOv8-M [ 48 ] | 23.2 | 67.8 | 204.8 | 11.5 |
| YOLOv11-S [ 49 ] | 9.4 | 21.5 | 243.9 | 10.1 |
| YOLOv11-M [ 49 ] | 20.0 | 68.2 | 172.4 | 13.0 |
| RT-DETR-L [ 14 ] | 28.8 | 104.8 | 106.4 | 66.2 |
| D-FINE-S [ 17 ] | 10.2 | 24.8 | 227.4 | 29.1 |
| Target Test Set | Method | (%) | (%) | (%) | (%) | TP | FP | FN |
|---|---|---|---|---|---|---|---|---|
| SAR-Ship-Dataset [ 50 ] | DEIM-S (Base) [ 16 ] | 15.9 | 49.1 | 28.2 | 62.9 | 9,628 | 24,530 | 5,670 |
| SAR-Ship-Dataset [ 50 ] | SARES-DEIM | 17.2 | 54.7 | 34.6 | 67.0 | 10,248 | 19,352 | 5,050 |
| SSDD [ 51 ] | DEIM-S (Base) [ 16 ] | 34.3 | 70.3 | 47.4 | 75.2 | 401 | 445 | 132 |
| SSDD [ 51 ] | SARES-DEIM | 35.2 | 75.1 | 51.1 | 80.1 | 427 | 408 | 106 |
| Target Test Set | Confidence | DEIM-S | DEIM-S | SARES-DEIM | SARES-DEIM |
|---|---|---|---|---|---|
| SAR-Ship-Dataset [ 50 ] | 0.10 | 7.4 | 69.7 | 13.0 | 72.6 |
| 0.25 | 28.2 | 62.9 | 34.6 | 67.0 | |
| 0.50 | 55.7 | 55.1 | 60.1 | 59.6 | |
| SSDD [ 51 ] | 0.10 | 11.2 | 82.4 | 20.1 | 86.5 |
| 0.25 | 47.4 | 75.2 | 51.1 | 80.1 | |
| 0.50 | 80.4 | 63.2 | 82.1 | 70.4 |
| Scenario | Method | (%) | (%) | (%) | (%) |
|---|---|---|---|---|---|
| Inshore | DEIM-S [ 16 ] (Base) | 74.7 | 92.3 | 90.3 | 86.3 |
| Inshore | SARES-DEIM | 75.8 | 93.2 | 90.9 | 87.7 |
| Offshore | DEIM-S [ 16 ] (Base) | 90.3 | 99.4 | 98.8 | 98.6 |
| Offshore | SARES-DEIM | 91.0 | 99.4 | 99.1 | 98.6 |
| SDEP | SARESMoE Stages | (%) | (%) | (%) | (%) | (%) | (%) | (%) | ||
|---|---|---|---|---|---|---|---|---|---|---|
| P3 | P4 | P5 | ||||||||
| 73.0 | 92.0 | 73.5 | 75.0 | 32.5 | 92.4 | 84.4 | ||||
| 74.7 | 92.9 | 76.0 | 76.2 | 34.1 | 92.5 | 87.4 | ||||
| 72.9 | 92.8 | 73.6 | 72.7 | 31.0 | 91.4 | 85.9 | ||||
| 75.3 | 93.6 | 76.0 | 76.2 | 34.3 | 92.0 | 87.1 | ||||
| 74.9 | 92.9 | 76.2 | 76.3 | 33.1 | 93.1 | 87.3 | ||||
| Routing Strategy | (%) | (%) | (%) | (%) | (%) | (%) | (%) |
|---|---|---|---|---|---|---|---|
| Standard MLP Router | 75.2 | 93.4 | 75.8 | 76.2 | 24.6 | 86.6 | 89.6 |
| Frequency Branch Only | 75.3 | 93.6 | 76.2 | 75.2 | 20.6 | 87.7 | 89.9 |
| Spatial Branch Only | 75.7 | 93.8 | 76.4 | 75.8 | 28.7 | 87.9 | 90.2 |
| Dual-Branch Fusion (Ours) | 76.4 | 93.8 | 77.0 | 76.8 | 34.6 | 93.1 | 88.0 |
| Variant | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) |
|---|---|---|---|---|---|---|
| Uniform All-Expert Aggregation | 75.6 | 93.4 | 93.1 | 87.9 | 87.6 | 128.8 |
| Fixed Top-2 Routing | 75.4 | 93.2 | 92.1 | 88.4 | 90.7 | 75.3 |
| Dynamic Top-2 Routing (Ours) | 76.4 | 93.8 | 93.1 | 88.0 | 90.8 | 72.6 |
| Routing Policy | Seed | (%) | (%) | (%) | (%) |
|---|---|---|---|---|---|
| Fixed Top-2 Routing | 0 | 75.4 | 93.2 | 92.1 | 88.4 |
| 13 | 75.1 | 92.8 | 93.2 | 87.3 | |
| 21 | 75.1 | 93.4 | 92.5 | 88.4 | |
| 42 | 75.4 | 93.0 | 93.1 | 87.7 | |
| Mean SD | |||||
| Dynamic Top-2 Routing | 0 | 76.4 | 93.8 | 93.1 | 88.0 |
| Fusion Strategy (P2 P3) | (%) | (%) | (%) | (%) | (%) | (%) | (%) |
|---|---|---|---|---|---|---|---|
| Baseline (No P2 Fusion) | 75.3 | 93.6 | 76.0 | 76.2 | 34.3 | 92.0 | 87.1 |
| Standard Strided Downsampling | 74.4 | 93.2 | 75.3 | 74.4 | 24.3 | 86.3 | 89.6 |
| Strip Convolution [ 53 ] | 74.1 | 93.2 | 75.0 | 74.7 | 28.1 | 86.8 | 89.4 |
| SDEP (Space-to-Depth) | 76.4 | 93.8 | 77.0 | 76.8 | 34.6 | 93.1 | 88.0 |
| Configuration | (%) | (%) | (%) | (%) | (%) | (%) | (%) |
| Shared Expert Only | 74.5 | 92.7 | 75.8 | 76.7 | 32.2 | 92.1 | 86.6 |
| P3: Spatial Expert Only | 73.8 | 92.4 | 75.2 | 75.3 | 28.6 | 92.8 | 85.6 |
| P3: Wavelet Expert Only | 74.1 | 92.7 | 75.4 | 75.8 | 33.3 | 92.5 | 87.3 |
| P4: Frequency Expert Only | 73.9 | 92.3 | 75.1 | 75.2 | 36.9 | 91.9 | 86.9 |
| P4: Hybrid Expert Only | 74.2 | 92.8 | 75.6 | 74.9 | 29.6 | 92.3 | 86.6 |
| P5: Frequency Expert Only | 74.6 | 92.6 | 75.7 | 77.1 | 31.1 | 92.9 | 86.8 |
| Expert Number | (%) | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) |
|---|---|---|---|---|---|---|---|
| 2/2/2 | 74.7 | 93.1 | 75.9 | 75.9 | 33.5 | 37.6 | 72.6 |
| 4/4/4 | 74.8 | 92.9 | 75.9 | 76.5 | 32.1 | 46.4 | 72.6 |
| 8/8/8 | 75.1 | 93.0 | 76.4 | 76.0 | 35.5 | 63.9 | 72.6 |
| 16/16/16 | 74.8 | 93.0 | 76.1 | 75.6 | 30.2 | 99.1 | 72.6 |
| Ours (4/8/16) | 76.4 | 93.8 | 77.0 | 76.8 | 34.6 | 90.8 | 72.6 |
| Gating Setting | (%) | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) |
|---|---|---|---|---|---|---|---|
| Top-1 | 75.2 | 93.6 | 76.5 | 75.9 | 37.7 | 90.8 | 67.1 |
| Top-All | 75.0 | 92.9 | 76.2 | 76.8 | 35.4 | 90.8 | 126.0 |
| Top-2 (Ours) | 76.4 | 93.8 | 77.0 | 76.8 | 34.6 | 90.8 | 72.6 |
| SDEP Insertion Level | (%) | (%) | (%) | (%) | (%) | Params (M) | FLOPs (G) |
|---|---|---|---|---|---|---|---|
| No SDEP | 75.3 | 93.6 | 76.0 | 76.2 | 34.3 | 90.2 | 63.4 |
| P2 P4 | 74.1 | 92.8 | 75.3 | 75.9 | 41.8 | 92.9 | 68.4 |
| P2 P5 | 74.0 | 92.4 | 75.3 | 75.4 | 28.5 | 91.2 | 67.5 |
| P2 P3 (Ours) | 76.4 | 93.8 | 77.0 | 76.8 | 34.6 | 90.8 | 72.6 |
Object Detection
Object detection locates and classifies objects in images or video, balancing localization accuracy, robustness, and inference speed.
See all 624 papers