eess.ASNov 6, 2026

Lightweight Neural Prediction for MDCT-Based Perceptual Audio Coding

Authors: Niccolo Abate, Gabriel Soule, Marina Bosi

Organizations: Center for Computer Research in Music and Acoustics (CCRMA), Stanford University, Stanford, CA, USA

Abstract

Perceptual audio codecs often use predictive coding to further reduce signal redundancy. Rather than learning the entire codec pipeline end-to-end, we insert a small neural network as a drop-in, deterministic predictor in an otherwise conventional codec: the network estimates the next Modified Discrete Cosine Transform (MDCT) coefficient block from a short context of reconstructed blocks, and the encoder transmits the quantized residual. We compare Multilayer Perceptron (MLP) and Convolutional Neural Network (CNN) predictors against a non-predictive baseline and a per-line Normalized Least Mean Squares (NLMS) linear predictor (similar to the MPEG-2 AAC Main Profile predictor). The CNN consistently outperforms the MLP, the linear predictor, and the baseline in signal-to-noise ratio (SNR), noise-to-mask ratio (NMR), and MUSHRA evaluation scores. Using a 512-sample analysis window (w = 512), our neural predictors recover, and the CNN exceeds, the coded quality obtained by the non-predictive baseline after quadrupling the analysis-window length to w = 2048, at substantially lower algorithmic delay. The CNN uses only 0.13M parameters (roughly 20x fewer than the MLP) and has a decoder real-time factor (RTF) of ~0.10 on a consumer CPU.

Figures & tables

Explore similar work

CardsList
  1. Probing Neural Audio Codecs with Speaker Traits and Speech Characteristics

    Oct 14, 2026Jihwan Lee, Tiantian Feng, Minu Kim +6Neural Audio CodecsSpeech Processing

  2. GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding

    Oct 3, 2026Ron Aluf, Alon Canfi, Eliya NachmaniNeural Audio Codecs

  3. Neural Audio Codec with Adjustable Token Temporal Resolution Using Sampling-Frequency-Independent Convolutional Layers

    Jul 2, 2026Tomohiko Nakamura, Wataru Nakata, Kanami Imamura +1Neural Audio CodecsAudio Tokenization