CNN-Transformer with Sigmoid Label for High-Resolution Sub-Degree DOA Estimation
Authors: Lifeng Wang, Xintong Li, Aifei Liu
Organizations: Academy of AI and Advanced Technology, Xi’an Jiaotong-Liverpool University, Taicang 215400, China · Department of Electrical and Computer Engineering, Western University, London, ON N6A 3K7, Canada
This paper addresses the grid quantization error of deep-learning (DL)-based direction-of-arrival (DOA) estimation. Classification- based DOA methods discretize the continuous angular space into a grid, so that with a peak-based read-out, the accuracy and resolution are limited by the grid step and by the width of the label peak. To address this issue, we propose a sigmoid label that encodes the sources' DOAs as the sum of angle-shifted monotonic sigmoid functions. Differentiating the output of a CNN-Transformer network trained with the sigmoid label produces sharp spectral peaks at the source DOAs. Combined with a moderately refined grid step of 0.25 degrees, the CNN-Transformer with the proposed sigmoid label attains sub-degree accuracy and a 1-degree resolution, breaking the limit of the grid quantization error. Under the unified CNN-Transformer backbone, we compare the proposed Sigmoid label with the Gaussian label, the 0-1 hard label, and the binary cross-entropy (BCE) baseline. Numerical results demonstrate that the Sigmoid label attains the highest accuracy and superior resolution compared to other labels.
Figures & tables
Figure 1: The proposed Sigmoid label and its first derivative for two sources at −43.7∘ and −41.7∘ (separation 2∘ , w=0.2∘ ). (a) The Sigmoid label (before derivative) forms a monotonic CDF. (b) The first derivative (after derivative) forms two sharp peaks at the source angles.
Figure 2: Output spectra at a 2∘ separation (SNR =5 dB) for two sources at −48.1∘ and −46.1∘ : (a) the Gaussian and Sigmoid-derivative spectra; (b) the 0-1 hard, BCE and MUSIC spectra.
Figure 3: RMSE versus SNR of the proposed Sigmoid label, the three baselines and MUSIC, for a small ( 2∘ , left) and a large ( 20∘ , right) angular separation.
Figure 4: Probability of resolution versus angular separation of the proposed Sigmoid label, the three baselines, and MUSIC, at an SNR of 0 dB (left) and 5 dB (right).
Motivated by sensing modalities in modern autonomous systems that involve hardware-constrained spatial sampling over large arrays with limited coherence time, we develop a novel framework for rapid super-resolution multi-signal direction-of-arrival (DoA) estimation based on Hankel-structured sensing and data matrix decomposition of arbitrary rank, under both the L2 and L1-norm formulation. The resulting L2-norm estimator is shown to be maximum-likelihood optimal in white Gaussian noise. The L1-norm estimator is shown to be maximum-likelihood optimal in independent, identically distributed (i.i.d.) isotropic Laplace noise, offering broad robustness to impulsive interference and corrupted measurements commonly encountered in practice. Extensive simulations demonstrate that the proposed methods exhibit powerful super-resolution capabilities, requiring significantly lower SNR and achieving substantially higher resolution probability than recent competing approaches.
Georgios I. Orfanidis, Dimitris A. Pados, George Sklivanitis +1
Center for Connected Autonomy and AI and the Dept. of Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431 USA · Air Force Research Laboratory, AFRL/RI, Rome, NY 13441 USA
Integrated Sensing and Communication (ISAC) systems rely on accurate Direction-of-Arrival (DoA) estimation for effective beamforming and spectral-efficiency enhancement. While numerous classical and deep-learning-based DoA estimation methods have been reported in the literature, their suitability for real-time ISAC operation remains insufficiently understood because practical deployment requires consideration of both estimation accuracy and computational latency. This paper presents a unified evaluation framework for systematically comparing classical and learning-based DoA estimators within an ISAC beamforming pipeline. Representative classical and learning-based DoA estimators, together with an ensemble architecture, are integrated with Singular Value Decomposition (SVD)-based beamforming and evaluated under identical operating conditions. The impact of DoA estimation accuracy, inference latency, beamforming-weight generation time, and resulting effective spectral efficiency is investigated. Results show that different estimators occupy distinct operating points in the accuracy-latency-performance design space. Although learning-based approaches substantially reduce estimation time compared with MUSIC, the overall processing latency increasingly becomes dominated by the computational cost of SVD-based beamforming. Among the evaluated methods, the Regression Convolutional Neural Network (RCNN) exhibits a favorable balance between estimation accuracy, computational efficiency, and beamforming performance, making it a promising candidate for real-time ISAC deployment. The findings further suggest that future low-latency ISAC systems may benefit from beamforming strategies that reduce or avoid computationally intensive SVD-based beamforming-weight generation.
Anjali K. S., Manoj Kumar Panda, Chandramani Singh
Department of Electronics and Communication Engineering, Amrita School of Engineering, Bengaluru, Amrita Vishwa Vidyapeetham, India · Department of Electronic Systems Engineering, Indian Institute of Science, Bangalore, India
Neural networks outperform classical GCC-PHAT for Time-Difference-of-Arrival (TDOA) estimation in noise and reverberation, yet their internal strategy remains unexplored. To uncover it, we turn GCC-PHAT's mathematical steps into diagnostic targets, probing hidden layers of three architectures (MLP, CNN, Transformer) and complementing with gradient attribution and causal frequency masking. We find that cross-power computation consistently emerges across all architectures and conditions, while PHAT whitening, the defining step of GCC-PHAT, fails to emerge. Instead, networks learn a magnitude-aware frequency weighting that preserves per-frequency reliability information discarded by PHAT. This makes PHAT an information bottleneck: removing it from both classical and neural GCC pipelines improves performance under additive noise. On real-world reverberant data, PHAT remains the best classical weighting, but end-to-end networks achieve lower error by learning data-adaptive weighting.
Yaozhong Kang, Jiang Wang, Runwu Shi +3
Department of Systems and Control Engineering, Institute of Science Tokyo, Japan