Rethinking Representations for Cross-Domain Infrared Small Target Detection: A Generalizable Perspective from the Frequency Domain
Organizations: Department of Mathematics, Hong Kong Baptist University, Hong Kong, China · School of Automation, Northwestern Polytechnical University, Xi’an, 710072, China · Wangxuan Institute of Computer Technology, Peking University, Beijing, China
Abstract
The accurate target-background separation in infrared small target detection (IRSTD) highly depends on the discriminability of extracted representations. However, most existing methods are confined to domain-consistent settings, while overlooking whether such discriminability can generalize to unseen domains. In practice, distribution shifts between training and testing data are inevitable due to variations in observational conditions and environmental factors. Meanwhile, the intrinsic indistinctiveness of infrared small targets aggravates overfitting to domain-specific patterns. Consequently, the detection performance of models trained on source domains can be severely degraded when deployed in unseen domains. To address this challenge, we propose a spatial-spectral collaborative perception network (SCPNet) for cross-domain IRSTD. Moving beyond conventional spatial learning pipelines, we rethink IRSTD representations from a frequency perspective and reveal inconsistencies in spectral phase as the primary manifestation of domain discrepancies. Based on this insight, we develop a phase rectification module (PRM) to derive generalizable target awareness. Then, we employ an orthogonal attention mechanism (OAM) in skip connections to preserve positional information while refining informative representations. Moreover, the bias toward domain-specific patterns is further mitigated through selective style recomposition (SSR). Extensive experiments have been conducted on three IRSTD datasets, and the proposed method consistently achieves state-of-the-art performance under diverse cross-domain settings.
Figures & tables
| Method | Venue | NUDT → IRSTD-1K | NUDT → NUAA | NUAA → IRSTD-1K | NUAA → NUDT | IRSTD-1K → NUDT | IRSTD-1K → NUAA | ||||||||||||
| IoU | IoU | IoU | IoU | IoU | IoU | ||||||||||||||
| Tophat [ 8 ] | 5.95 | 69.69 | 621.38 | 27.80 | 90.74 | 193.67 | 5.95 | 69.69 | 621.39 | 12.59 | 69.41 | 76.50 | 12.59 | 69.41 | 76.50 | 27.80 | 90.74 | 193.67 | |
| MPCM [ 9 ] | 22.90 | 79.12 | 135.53 | 45.18 | 90.74 | 26.25 | 22.90 | 79.12 | 135.53 | 15.60 | 58.62 | 185.54 | 15.60 | 58.62 | 185.54 | 45.18 | 90.74 | 26.25 | |
| RLCM [ 30 ] | 17.67 | 64.64 | 54.05 | 27.16 | 84.25 | 135.79 | 17.67 | 64.64 | 54.05 | 15.38 | 76.40 | 480.03 | 15.38 | 76.40 | 480.03 | 27.16 | 84.25 | 135.79 | |
| LIG [ 29 ] | 11.67 | 81.14 | 624.59 | 30.10 | 88.88 | 77.39 | 11.67 | 81.14 | 624.59 | 28.29 | 78.41 | 170.65 | 28.29 | 78.41 | 170.65 | 30.10 | 88.88 | 77.39 | |
| ACMNet [ 18 ] | 40.39 | 83.71 | 104.18 | 59.81 | 92.12 | 20.40 | 37.48 | 74.56 | 158.04 | 36.25 | 74.23 | 138.43 | 36.67 | 73.42 | 66.71 | 64.55 | 90.80 | 19.40 | |
| Method | Venue | NUAA-SIRST | NUDT-SIRST | IRSTD-1K | |||||||||
| IoU | IoU | IoU | |||||||||||
| Tophat [ 8 ] | 27.80 | 43.51 | 90.74 | 193.67 | 12.59 | 22.37 | 69.41 | 76.50 | 5.95 | 11.23 | 69.69 | 621.38 | |
| MPCM [ 9 ] | 45.18 | 62.24 | 90.74 | 26.25 | 15.60 | 26.98 | 58.62 | 185.54 | 22.90 | 37.27 | 79.12 | 135.53 | |
| RLCM [ 30 ] | 27.16 | 42.71 | 84.25 | 135.79 | 15.38 | 26.66 | 76.40 | 480.03 | 17.67 | 30.04 | 64.64 | 54.05 | |
| LIG [ 29 ] | 30.10 | 46.27 | 88.88 | 77.39 | 28.29 | 36.20 | 78.41 | 170.65 | 11.67 | 20.90 | 81.14 | 624.59 | |
| TLLCM [ 31 ] | 17.92 | 30.40 | 84.25 | 20.04 | 11.77 | 21.07 | 72.59 | 151.83 | 11.28 | 27.67 | 81.81 | 212.67 | |
| PRM | OAM | SSR | IoU | |||
| ✘ | ✘ | ✘ | 49.42 | 66.14 | 86.73 | 111.67 |
| ✔ | ✘ | ✘ | 57.64 | 73.12 | 87.75 | 38.64 |
| ✘ | ✔ | ✘ | 51.93 | 68.35 | 89.45 | 92.01 |
| ✘ | ✘ | ✔ | 54.47 | 70.05 | 88.77 | 66.50 |
| ✘ | ✔ | ✔ | 55.62 | 71.47 | 85.71 | 63.69 |
| ✔ | ✔ | ✔ | 60.01 | 74.99 | 90.47 | 41.90 |
| Methods | Params | FLOPs | IoU | ||
| MSHNet | 4.1M | 6.1G | 54.91 | 86.85 | 55.12 |
| S 2 CP-MSHNet | 5.5M | 6.7G | 62.06 | 90.08 | 25.51 |
| SCTransNet | 11.2M | 10.1G | 53.98 | 84.81 | 56.15 |
| S 2 CP-SCTransNet | 12.3M | 11.3G | 62.62 | 90.51 | 24.82 |
| Parameter | Setting | IoU | |||
| 0.2 | 54.46 | 70.51 | 81.58 | 37.45 | |
| 0.3 | 55.35 | 71.26 | 82.75 | 30.21 | |
| 0.4 | 54.50 | 70.55 | 82.10 | 28.33 | |
| 0.5 | 53.17 | 69.43 | 80.52 | 38.28 | |
| 0.1 | 55.64 | 71.49 | 82.53 | 29.75 | |
| 0.2 | 56.25 | 72.01 | 84.76 | 29.82 |
Infrared Small Target Detection
Infrared small target detection finds faint, often sub-pixel objects against cluttered thermal backgrounds while limiting false alarms.
See all 43 papers