Organizations: VCIP, CS, Nankai University, Tianjin 300350, China · School of Software Technology, Dalian University of Technology, Dalian 116024, China · College of Electronic Science and Technology, National University of Defense Technology (NUDT), Changsha 410000, China
Long-range infrared imaging frequently confronts dense target clusters whose diffraction-limited signatures merge into a single indistinguishable blob, concealing the number, sub-pixel positions, and radiant intensities of the underlying sources. While deep learning has advanced general object detection, resolving such Closely-Spaced Infrared Small Targets (CSIST) remains largely unexplored, owing to a systemic infrastructure void and a fundamental paradigm mismatch. The dominant formulation, which reduces unmixing to a blind, discrete sub-pixel separation, is inherently insufficient: without semantic guidance, the ill-posed inverse problem admits ambiguous solutions plagued by false and missed detections, while grid-based discretization locks predictions onto fixed lattice centers, chaining precision to prohibitively expensive grid refinement. We argue that CSIST unmixing should instead be informed and continuous. To ground this paradigm shift, we establish the first comprehensive open-source ecosystem for the field, comprising the large-scale CSIST-100K benchmark, a tailored metric suite, and the GrokCSO toolkit. Upon this foundation, we propose DISTA-Net++, which anchors a dynamic deep unfolding backbone with two synergistic mechanisms: a Count-Guided Prior that injects the global target count as an explicit semantic constraint to regularize the solution space, and a Continuous Coordinate Rectification that regresses off-grid offsets to decouple localization accuracy from grid resolution. Extensive experiments validate our paradigm: even under the most economical 3x division, DISTA-Net++ surpasses 7x-division state-of-the-art methods by 16.15% in CSO-mAP and 62.96% in count accuracy at merely one-sixth of their computation, demonstrating that unmixing precision need not be purchased with finer discretization. The complete ecosystem is available at https://github.com/GrokCV/GrokDet.
Figures & tables
Fig. 1: Evolution of processing paradigms for closely-spaced infrared small targets (CSIST). Top right : Infrared Small Target Detection ( IRSTD ) acts only as a coarse detector, reporting a single bounding box for overlapped targets. Bottom left : Existing unmixing models (e.g., DISTA-Net ) succeed in separating the overlapped signals, yet in a blind, discrete manner, thus suffering from count ambiguity and grid quantization error. Bottom right: The proposed DISTA-Net++ establishes an informed, continuous formulation, achieving faithful recovery of target count, sub-pixel positions, and intensities aligned with the Ground Truth (GT). Unmixing results are shown cropped and enlarged around the target region for clarity.
Fig. 2: Conceptual illustration of imaging and unmixing processes for closely-spaced infrared small targets (CSIST). CSIST unmixing aims to disentangle and accurately estimate the count, positions, and intensities of overlapping targets.
Fig. 3: Overview of the CSIST-100K dataset and the multi-target imaging process. (a) Physical Forward Imaging Model. Illustration of the energy overlap process: (Left) independent sub-pixel point sources and their PSFs; (Middle) a 1D cross-section demonstrating cumulative linear superposition ( f=f1+f2 ); (Right) the final stacked focal-plane response where closely spaced targets merge into a visually indivisible peak. (b) Target Count Distribution. The statistical distribution of images across varying target counts (1 to 5 targets). (c) Inter-target Distance Distribution. The distribution of Euclidean distances (in pixels) between target pairs. The vast majority fall within the extremely close range of [0.5,0.7) pixels, inducing severe spatial overlap well below the classical resolution limit.
Fig. 4: Division of each pixel into an n×n grid of sub-pixels, representing potential target positions.
Fig. 5: Overall architecture of the proposed DISTA-Net++. The framework is intrinsically driven by three synergistic components: (a) Dynamic Deep Unfolding Backbone (top) that adaptively extracts features via a Dynamic Transform (DT) module and computes stage-wise soft-thresholds via a Dynamic Thresholding Generator (DTG) to handle sensitive signal variations; (b) Count-Guided Prior module (bottom left) that leverages global target count to semantically modulate features and suppress overlapping ambiguity; and (c) Continuous Coordinate Rectification mechanism (bottom right) that regresses sub-pixel offsets to refine discrete grid estimations into precise continuous spatial localization.
Fig. 6: Architecture of the k -th stage in the dynamic deep unfolding backbone. Each stage contains three main components: a dual-branch dynamic transform module ( Fd(k) ) for feature extraction, a Dynamic Thresholding Generator (DTG) for feature refinement, and an inverse transform module ( F~(k) ) for reconstruction. In the full DISTA-Net++ framework, the DTG is further modulated by a global semantic count prior (omitted in this diagram for visual clarity) to adaptively regulate the thresholds.
Fig. 7: Detailed architecture of the Count-Aware Modulation (CAM) operation. It effectively integrates the spatial visual features with the semantic count feature to produce channel-wise modulation weights.
Fig. 8: Comprehensive performance and efficiency comparison on CSIST-100K . (a) Multidimensional Performance: A radar chart benchmarking representative frameworks across five core metrics. Note that the TP-PRMSE ( ↓ ) axis is intentionally inverted (the outer edge represents a lower, superior error) to maintain a visually consistent “larger area indicates better overall performance” paradigm. (b) Performance-Complexity Trade-off: Evaluation of CSO-mAP against computational complexity (FLOPs, mapped to a logarithmic x-axis) and network capacity (parameters, represented by bubble area). DISTA-Net++ achieves an optimal balance, dwarfing the performance of heavy architectures at merely a fraction of their computational budget.
Method
Params ↓
FLOPs ↓
CSO-mAP
PSNR ↑
CSO-SSIM ↑
C-ACC ↑
TP-PRMSE ↓
mAP
AP-05
AP-10
AP-15
AP-20
AP-25
Traditional Optimization
ISTA [ 34 ]
-
398.6M
6.327
0.3910
1.722
4.549
9.186
15.79
26.87
0.0590
11.68
0.1459
Image Super-Resolution
ACTNet [ 42 ]
46.21M
62.80G
45.51
0.3821
7.414
40.46
83.28
96.01
36.89
0.8275
42.36
0.1329
CTNet [ 43 ]
0.4003M
2.756G
45.30
0.3864
7.485
40.41
82.69
95.51
35.62
0.8076
35.14
0.1331
TABLE I: Comparison with SOTA methods on the CSIST-100K dataset.
Fig. 9: Visual comparison of 3 × sub-pixel division unmixing for scenes containing different numbers of closely-spaced infrared small targets . Each row corresponds to a target count scenario, where the first column shows the raw input with an overlapping diffraction spot highlighted by a red box, and subsequent columns present the unmixing results of different methods for this highlighted region. Unmixing results are shown cropped and enlarged for clarity.
Fig. 10: Interpretability through stage-wise evolutionary trajectories. (a) Evolution of Reconstructed Radiation Maps. Tracking the intermediate representations from Stage 1 to Stage 6 for a highly challenging dense 4-target cluster (Ground Truth shown on the right). While the baseline DISTA-Net merges the cluster into a diffusive blob and ultimately fails to recover the source count, DISTA-Net++ actively suppresses count ambiguity, rapidly converging to four compact, off-grid spatial peaks. (b) Stage-wise PSNR Dynamics. PSNR evolution under identical unfolding depths. The terminal spike reflects the final structural projection from continuous feature manifolds to the discrete radiation map, where DISTA-Net++ decisively outperforms the baseline by expanding the fidelity margin ( Δ=+1.21 dB).
Fig. 11: Robustness across extended inter-target distances. (a) Visual Progression across Inter-target Distances. Evolution from severely mixed ( 0.5 pixel) to fully isolated ( 3.0 pixels). (b) (CSO-mAP, TP-PRMSE) vs. Inter-target Distance. While the localization error of grid-based baselines remains clamped to their theoretical quantization floor regardless of inter-target distance, DISTA-Net++ utilizes continuous regression to drive sub-pixel error toward zero as spatial overlap relaxes.
Fig. 12: Robustness under extended target count. Evaluation as cluster density scales across the expanded range (plotted from 2 to 9 targets). (a) CSO-mAP vs. Target Count. The trajectory of overall sub-pixel detection performance. (b) C-ACC vs. Target Count. The trajectory of semantic count estimation. Even when trained on datasets containing these extremely dense configurations, baselines suffer systemic semantic collapse, whereas DISTA-Net++ sustains a commanding accuracy lead.
Fig. 13: Robustness against physics-based sensor noise. Relative performance margin ( Δ CSO-mAP) compared to the DISTA-Net baseline under physically faithful degradation models. (a) Δ CSO-mAP vs. Gaussian Standard Deviation ( σ ). Performance under varying thermal noise standard deviations. (b) Δ CSO-mAP vs. Poisson Conversion Gain ( K ). Performance under varying photon conversion gains. DISTA-Net++ demonstrates remarkable resilience, maintaining substantial positive margins even as severe physical noise uniformly collapses the baseline performances.
Method
Params ↓
FLOPs ↓
Performance Metrics
CSO-mAP ↑
PSNR ↑
C-ACC ↑
TP-PRMSE ↓
c=5
ISTA-Net [ 36 ]
0.1711M
39.54G
65.54
37.96
26.80
0.08874
ISTA-Net+ [ 36 ]
0.2247M
48.16G
68.18
40.57
35.96
0.08761
CFGN [ 59 ]
0.5376M
4.122G
68.25
39.23
34.62
0.08772
DISTA-Net [ 19 ]
0.4911M
99.51G
69.51
41.08
35.68
0.08727
TABLE II: Comparison of methods across different sampling grids on the CSIST-100K dataset.
Model Baseline
CSO‑mAP ↑
PSNR ↑
C‑ACC ↑
TP‑PRMSE ↓
Deep Unfolding
FISTA‑Net [ 58 ]
44.66
38.48
40.68
0.1331
+ CCR
79.87
38.64
42.39
0.06362
ISTA‑Net+ [ 36 ]
46.06
38.50
46.32
0.1327
+ CCR
85.88
40.23
57.70
0.05185
DISTA‑Net [ 19 ]
46.62
40.06
48.87
0.1323
TABLE III: Plug-and-play generality of the continuous paradigm (CCR).
Model Baseline
CSO-mAP ↑
PSNR ↑
C-ACC ↑
TP-PRMSE ↓
Deep Unfolding
ISTA-Net+ [ 36 ]
46.06
38.50
46.32
0.1327
+ CGM
46.57
39.48
48.80
0.1326
+ CCI
41.38
38.36
74.84
0.1313
+ CGM & CCI
43.75
39.97
85.92
0.1320
DISTA-Net [ 19 ]
46.62
40.06
48.87
0.1323
TABLE IV: Plug-and-play generality of the informed paradigm (CGM + CCI).
Config.
DT
DTG
CGM
CCI
CCR
Params (M) ↓
FLOPs (G) ↓
CSO‑mAP ↑
PSNR ↑
C‑ACC ↑
TP‑PRMSE ↓
1
–
–
–
–
–
0.4493
31.93
46.31
36.84
34.28
0.1328
2
✓
–
–
–
–
0.4494
31.93
46.25
36.56
32.84
0.1328
3
–
✓
–
–
–
0.4910
34.75
46.45
38.11
40.75
0.1326
4
✓
✓
–
–
–
0.4911
34.76
46.62
40.06
48.87
0.1323
5
✓
✓
✓
–
–
0.5641
34.79
46.76
39.49
47.39
0.1325
6
✓
✓
–
✓
–
0.5267
34.79
43.89
39.50
87.75
0.1322
TABLE V: Ablation studies on different components of DISTA-Net++ on the CSIST-100K dataset. DT and DTG form the adaptive backbone; CGM and CCI realize the informed paradigm; CCR realizes the continuous paradigm.
Fig. 14: Mechanism validation of the Count-Guided Prior. (a) Visualization for Count‑aware Feature. A t-SNE projection of the count embedding c , demonstrating distinct semantic clustering aligned with the ground-truth target count. (b) CSO-mAP vs. Count Perturbation. Performance under count perturbations. Injecting the exact ground-truth embedding (0 perturbation) establishes the theoretical upper bound, which the default predictive model (Vanilla) closely matches. Injecting erroneous embeddings ( ±1,±2 ) demonstrates graceful degradation, proving the framework’s robustness against counting errors.
Variant
CSO-mAP ↑
PSNR ↑
C-ACC ↑
TP-PRMSE ↓
w/o F0 (final only)
81.46
38.28
84.64
0.04841
w/o tanh (linear head)
87.07
42.47
96.92
0.04567
DISTA-Net++ (Ours)
87.47
42.78
97.14
0.04602
TABLE VI: Design analysis of the CCR on CSIST-100K.
Fig. 15: Ablation study on loss weight sensitivity. (a) CSO-mAP vs. λ1 . The effect of the counting loss weight on sub-pixel detection performance. (b) CSO-mAP vs. λ2 . The effect of the offset loss weight. The red dots indicate the optimal settings adopted in our final model ( λ1=250 and λ2=300 ). The broad plateaus across both metrics demonstrate that the framework is highly robust and avoids delicate hyperparameter tuning.
Due to the optical diffraction limit and long imaging distances, Closely-Spaced Infrared Small Targets (CSIST) typically exhibit energy overlap, manifesting as indistinguishable blobs in infrared images. This ambiguity invalidates the one-to-one mapping assumption of traditional detection, thereby necessitating a paradigm shift towards CSIST Unmixing, which decomposes these blobs into discrete sub-targets. However, the dominant paradigm deep unfolding networks are shackled by the high latency and structural inflexibility intrinsic to their repetitively iterative architecture. To this end, we propose the Fast One-stage CSIST Unmixing Scheme (FOCUS), a one-stage lightweight paradigm which demonstrates that deep unfolding is not necessary. Motivated by the key observation that image super-resolution (SR) and CSIST Unmixing share an isomorphic degradation model, our insight is that it is possible to achieve a paradigm shift from image SR to CSIST Unmixing via completely transforming the label space, loss functions, and evaluation criteria. Specifically, to avoid entangling geometric recovery with artifact suppression, FOCUS adopts a single pass mapping with an internal coarse-to-fine flow that progressively refines target localization from coarse spatial distributions to finer sub-pixel precision. While sparsity regularization suppresses background clutter, it also attenuates target intensities. To compensate for this attenuation of valid signals, flux conservation is introduced as a competing constraint that restores signal energy back to target centers. To the best of our knowledge, this work is the first attempt to address this task via a lightweight one-stage framework without the DUN paradigm. Experiments demonstrate that our method matches or surpasses the state-of-the-art unfolding approaches in both localization and unmixing accuracy, while boosting the inference speed by 60x.
Ximeng Zhai, Zheng Wang, Yaohong Chen +3
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China · University of Chinese Academy of Sciences, Beijing 100049, China · Beijing Institute of Astronautical Systems Engineering, Beijing 100094, China +2
Due to the limitations of optical lens focal length and detector resolution, distant clustered infrared small targets often appear as mixed spots. The Close Small Object Unmixing (CSOU) task aims to recover the number, sub-pixel positions, and radiant intensities of individual targets from these spots, which is a highly ill-posed inverse problem. Existing methods struggle to balance the rigorous sparsity guarantees of model-driven approaches and the dynamic scene adaptability of data-driven methods. To address this dilemma, this paper proposes a Dynamic Sparse Compressed Sensing Network (DSCSNet), a deep-unfolded network that couples the Alternating Direction Method of Multipliers (ADMM) with learnable parameters. Specifically, we embed a strict ℓ1-norm sparsity constraint into the auxiliary variable update step of ADMM to replace the traditional ℓ2-norm smoothness-promoting terms, which effectively preserves the discrete energy peaks of small targets. We also integrate a self-attention-based dynamic thresholding mechanism into the reconstruction stage, which adaptively adjusts the sparsification intensity using the sparsity-enhanced information from the iterative process. These modules are jointly optimized end-to-end across the three iterative steps of ADMM. Retaining the physical logic of compressed sensing, DSCSNet achieves robust sparsity induction and scene adaptability, thus enhancing the unmixing accuracy and generalization in complex infrared scenarios. Extensive experiments on the synthetic infrared dataset CSIST-100K demonstrate that DSCSNet outperforms state-of-the-art methods in key metrics such as CSO-mAP and sub-pixel localization error.
Infrared small target detection (IRSTD) aims to identify long distance small targets from complex infrared backgrounds, and is a fundamental task in remote sensing. Deep learning methods have improved IRSTD by learning discriminative image-to-mask mappings, but such feed-forward designs often underuse physical decomposition structure between targets and backgrounds. Deep unfolding methods partially address this issue by embedding model-driven iterations into neural networks, yet existing designs still operate mainly in image domain and use updates and memory mechanisms that are not fully coupled with underlying optimization process. To address these limitations, we propose Latent Consistent Proximal unfolding network (LCPNet). First, we verify that low-rank prior remains valid in latent representations and perform unfolding in this space, preserving physical constraint while avoiding repeated compression of intermediate states. Second, we derive a Latent Consistent Proximal (LCP) solver that evolves each latent variable from its previous state rather than reconstructing through an indirect residual, and stabilizes small target updates through task-adaptive normalization and gain control. Third, we introduce Shared Optimization Memory (SOM), a common historical state shared by all decomposition variables to provide coordinated guidance across unfolding stages. Extensive experiments on four public benchmarks demonstrate that LCPNet outperforms state-of-the-art methods while achieving accurate and robust detection with low false alarms and competitive efficiency. Model and code are available at https://github.com/Tianfang-Zhang/LCPNet.
Tianfang Zhang, Fengyi Wu, Lei Li +4
Department of Automation, Tsinghua University, Beijing, 100190, China · School of Information and Communication Engineering and the Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu, 610054, China · School of Artificial Intelligence, Beijing Institute of Technology, Beijing, 100081, China