cs.SDNov 9, 2026

AudioCodex: Streaming Autoencoders for Live Audio

Authors: Marco Pasini, Javier Nistal, Cyran Aouameur, Stefan Lattner, George Fazekas

Organizations: Queen Mary University of London, UK · Sony Computer Science Laboratories, Paris, France

Abstract

We introduce AudioCodex, a fully causal autoencoder for live generative audio applications that compresses stereo audio into compact continuous latent sequences at ~10 Hz. It combines a Mean Flow magnitude autoencoder with latent hypersphere projection, bounded-noise augmentation, representation alignment, and adversarial phase recovery to learn representations that support both efficient downstream generation and high-quality reconstruction. Through extensive ablations, we show that AudioCodex outperforms the state-of-the-art in terms of generation-reconstruction trade-off, whilst remaining strictly causal in both encoding and decoding. This work paves the way towards truly real-time interactive and streaming generative audio applications.

Figures & tables

Explore similar work

CardsList
  1. A Generative-First Neural Audio Autoencoder

    Feb 17, 2026Jonah Casebeer, Ge Zhu, Zhepei Wang +1AutoencodersAudio Representation Learning

  2. AudioGAR: Bridging Reconstruction and Generation in Latent Audio Generative Models

    Oct 5, 2026Xianghong Fang, Geeyang Tay, Wentao Ma +2Neural Audio CodecsAudio Diffusion Models

  3. F3-Tokenizer: Taming Audio Autoencoder Latents for Understanding and Generation

    Jun 4, 2026Dinghao Zhou, Xingchen Song, Di Wu +3Audio Representation LearningAutoencoders