cs.LGApr 23, 2026

Dilated CNNs for Periodic Signal Processing: A Low-Complexity Approach

Authors: Eli GildishMichael GrebshteinIgor Makienko

Organizations: RSL Electronics LTD, Migdal Ha'Emek, 23100, Israel

Abstract

Denoising of periodic signals and accurate waveform estimation are core tasks across many signal processing domains, including speech, music, medical diagnostics, radio, and sonar. Although deep learning methods have recently shown performance improvements over classical approaches, they require substantial computational resources and are usually trained separately for each signal observation. This study proposes a computationally efficient method based on DCNN and Re-sampling, termed R-DCNN, designed for operation under strict power and resource constraints. The approach targets signals with varying fundamental frequencies and requires only a single observation for training. It generalizes to additional signals via a lightweight resampling step that aligns time scales in signals with different frequencies to re-use the same network weights. Despite its low computational complexity, R-DCNN achieves performance comparable to state-of-the-art classical methods, such as autoregressive (AR)-based techniques, as well as conventional DCNNs trained individually for each observation. This combination of efficiency and performance makes the proposed method particularly well suited for deployment in resource-constrained environments without sacrificing denoising or estimation accuracy.

Explore similar work

Sep 15, 2026stat.ML

Time-warping estimation via stationarity-based learning of the de-warped signal

Time-warping estimation is a fundamental problem in signal processing with applications in bioacoustics, radar, and biomedical analysis. This paper introduces a Time-Warping Estimation Trainable (TWET) model for estimating timewarping functions from a single observation. The proposed approach formulates time-warping estimation as a stationarization problem in the wavelet domain and leverages a hierarchical dilated convolutional architecture to estimate the time-warping functions. A differentiable stationarity criterion is introduced for end-to-end optimization. TWET is compared with existing approaches. Experimental results show improved deformation reconstruction accuracy together with significantly reduced computation time, making the framework compatible with low-latency applications.
Corentin Presvôts, Adrien Meynard
Jun 19, 2026cs.SD

Direct Raw Audio Signal Processing via Reservoir Computing: An Investigation into 'Feature-Free' Architectures

This paper evaluates Reservoir Computing (RC) as an autonomous, 'feature-free' framework for audio processing, designed to eliminate traditional, handcrafted feature extraction stages. We investigate whether the high-dimensional temporal dynamics inherent in a reservoir can function as a robust end-to-end processor for the direct classification of raw acoustic signals. By bypassing computationally intensive representations like MFCCs, this approach seeks to mitigate significant intellectual and pre-processing bottlenecks in traditional signal pipelines. Our study evaluates and compares shallow, sequential, and parallel deep reservoir architectures to determine their capacity for hierarchical feature representation. Experimental results demonstrate that the proposed parallel approach consistently outperforms shallow and sequential baselines while maintaining low model complexity. These findings highlight the potential of RC as an efficient and scalable alternative for time-domain audio processing, offering a promising pathway toward deployable, low-power acoustic systems with minimal preprocessing requirements.
Rinku Sebastian, Simon O Keefe, Martin A Trefzer
Jun 15, 2026cs.LG

RepNN: Tackling spectral bias in deep neural networks via parameter reparameterization

Deep neural networks (DNNs) have achieved remarkable success in scientific computing, yet they often suffer from spectral bias in capturing oscillatory and multiscale behaviors. In this study, we investigate this limitation by examining the failure of shallow ReLU neural networks in fitting high-frequency functions. This observation identifies two important factors in resolving rapid oscillations: the initial slope scale and the distribution of partition points induced by the networks. Motivated by this analysis, we propose RepNN, a reparameterized neural network model with activation ReLU or tanh designed for high-frequency and multiscale problems. The key idea is to reparameterize the weights and biases in the first hidden layer, which enables effective control of the initial slope scale and provides an appropriate distribution of the initial partition points. Furthermore, treating the reparameterized weights and biases as trainable parameters allows the DNN to achieve adaptive frequency scaling during training. In addition, we derive quantitative estimates for the output and slope magnitudes of the reparameterized DNN to guide the initialization of the proposed method. Numerical experiments, including multiscale one- and four-dimensional function approximations, forward and inverse PDE problems in combination with physics-informed neural networks (PINNs), and operator learning for an earthquake problem using real data, demonstrate that RepNN improves the predicted accuracy of vanilla DNNs in capturing highly oscillatory features with slightly additional computational cost. These results indicate that RepNN provides an effective and flexible approach for overcoming spectral bias and applying DNNs to multiscale problems.
Yong Wang, Tao Zhou, Xuhui Meng