cs.SDNov 17, 2026

High-Fidelity Binarized Neural Vocoder

Authors: Andong Li, Tong Lei, Xiaodong Li, Chengshi Zheng

Organizations: Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China · University of Chinese Academy of Sciences, Beijing 10190, China · Tencent Hunyuan Multimodal Models Department, Tencent, Shenzhen 518054, China

Abstract

Neural vocoders have achieved remarkable progress in high-fidelity waveform generation in recent years, but most existing methods still rely on full-precision operators, leading to non-negligible storage and computational costs during inference. Binary neural networks (BNNs) provide an alternative direction by quantizing weights and activations to 1 bit. However, directly applying binarization to neural vocoders is rather challenging as it inherently incurs severe information loss. To this end, we propose BiVoC, a BNN-oriented time-frequency neural vocoder for high-fidelity waveform generation. Building on our previous full-precision RNDVoC framework, BiVoC adapts the inverse-problem formulation, range-null decomposition, and fineto-coarse non-uniform subband modeling to the 1-bit setting. Specifically, we develop a simple binarized convolutional unit to provide stable time-frequency feature modeling under binary representations. Furthermore, we analyze the quality-complexity sensitivity of different modules and propose a mixed-precision design to retain quality-sensitive components in full precision while binarizing computation-dominant parts. Extensive experiments are conducted on LibriTTS and multiple out-of-distribution benchmarks. Both objective and subjective results demonstrate that BiVoC substantially outperforms BNN variants obtained by directly binarizing existing vocoders, while achieving competitive performance against several mainstream full-precision vocoder baselines under much lower theoretical computational cost. These results demonstrate the promising potential of BNNs in the audio generation field. Codes and pre-trained weights are available at https://github.com/Andong-Li-speech/BiVoC.

Figures & tables

Explore similar work

CardsList
  1. ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding

    Sep 10, 2026Luca Della Libera, Cem Subakan, Mirco RavanelliAudio Token CompressionNeural Audio Codecs

  2. PhaseGAN: High-Fidelity Vocoder via Decoupled Amplitude and GAN-Driven Phase Reconstruction

    Sep 11, 2026Wenzheng Zhang, Xueliang Zhang, Shulin He +7Neural VocodersSpeech Processing

  3. Scalable Neural Vocoder from Range-Null Space Decomposition

    Mar 9, 2026Andong Li, Tong Lei, Zhihang Sun +4Neural VocodersSpeech Processing