Neural Speech Codecs

Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 6Week of Sep 21
View on map

Latest papers 28

All topics
CardsList

  1. Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization

    Oct 1, 2026Jeeyoung Yun, Seohwan Yun, Sungwoong KimNeural Speech CodecsAudio Tokenizers

    Korea University, Seoul, Republic of Korea

  2. Interpreting and Evaluating Dynamic-Rate Speech Codec Boundaries

    Sep 29, 2026Han Wang, Jiaqi Li, Yingda Shen +2Neural Speech CodecsSpeech Encoder

    The Chinese University of Hong Kong, Shenzhen · Zhejiang University · Amphion Technology Co., Ltd.

  3. Controlling Speaking Rate in Autoregressive TTS via Activation Steering

    Sep 27, 2026Francesco Verdini, Antonis Asonitis, Aref Farhadipour +4Autoregressive Text-To-SpeechSeed-Tts-Eval Benchmark

    AGIGO · Sapienza University of Rome · ETH Zurich +1

  4. Narrowband Voice Communication Using Streaming Neural Compression

    Sep 21, 2026Dahong Luo, Anannya Trehan, Aritrik Ghosh +1Neural Speech CodecsNeural Audio Codecs

    University of Maryland, College Park

  5. TokenMapper: A Step Toward Interoperable Speech Token Translation

    Sep 14, 2026Tal Kozakov, Tal Rosenwein, Eliya NachmaniAudio TokenizersSpeech Translation

    Department of Electrical and Computer Engineering, Ben-Gurion University of the Negev

  6. ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding

    Sep 12, 2026Luca Della Libera, Cem Subakan, Mirco RavanelliNeural Speech CodecsDataset Distillation

    Concordia University · Mila-Quebec AI Institute · Universit´e Laval

  7. Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

    Sep 3, 2026Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7Neural Speech CodecsDataset Distillation

    Apple

  8. PACodec: A Low-bitrate Neural Speech Codec with Parallel Additive Vector Quantization

    Sep 3, 2026Fei Liu, Yang Ai, Xiao-Hang Jiang +1Neural Speech CodecsResidual Vector Quantization

    National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei, China

  9. BiMTokenizer: Preserving Semantic-Acoustic Balance in Low-Bitrate Speech Tokenization via Bidirectional State-Space Modeling

    Sep 1, 2026Xin Zhang, Lin Li, Chuanbo Liu +2Neural Speech CodecsAcoustic Latent Space

    Wuhan University of Technology, Wuhan, China · NEC Laboratories Asia Pacific, Singapore · NEC Corporation, Japan +1

  10. ReLMCodec: Designing Predictable Speech Tokens from Pre-Quantization Phoneme Structure

    Aug 8, 2026Zixiang Wan, Xusheng Yang, Zheng Wang +1Neural Speech CodecsSelf-Supervised Speech Models

    1Peking University, Shenzhen, China · 2Tencent, Shenzhen, China

  11. LILAC: An Idempotent Neural Speech Codec

    Aug 6, 2026June Young Yi, Dongwook Lee, Jiheum Yeom +1Neural Speech CodecsNeural Audio Codecs

    Department of Computer Science and Engineering, Seoul National University · 2Interdisciplinary Program in Artificial Intelligence, Seoul National University · Department of Electrical and Computer Engineering, Seoul National University +1

  12. Investigating Codec-Internal Latent Audio Watermarking for Neural Codec Robustness

    Jul 23, 2026Zi Hu, Houmin Sun, Linxi Li +4Neural CodecsNeural Speech Codecs

    Digital Innovation Research Center, Duke Kunshan University, Kunshan, China · OfSpectrum, Inc., Los Angeles, USA · University of Warwick, Coventry, United Kingdom +1

  13. Streaming Neural Speech Codecs through Time-Invariant Representations

    Jul 6, 2026Kélian Estève, Salima Mhdaffar, Mickael Rouvier +2Neural Speech CodecsDiscrete Speech Representations

    LIA, Avignon Universit´e, France · LS2N, Nantes Universit´e, France

  14. FlexiSLM: A Spoken Language Model with Dynamic and Controllable Frame Rates

    Jun 30, 2026Jiaqi Li, Chaoren Wang, Xiaohai Tian +9Speech Language ModelsNeural Speech Codecs

    1The Chinese University of Hong Kong, Shenzhen · 2ByteDance

  15. DTM-Codec: Dynamic Token Masking for VFR Speech Coding with Efficient Boundary Selection

    Jun 28, 2026Hoyeol Sohn, Juhan NamNeural Speech CodecsFrame Rate

    Graduate School of Cultural Technology, KAIST, South Korea

  16. AugCodec: A Low-Bitrate Disentangled Neural Speech Codec via Data Augmentation

    Jun 20, 2026Dongmei Wang, Xiaohang Sun, Yang Liu +10Neural Speech CodecsSpeech Separation

    Amazon, USA

  17. ProsoCodec: Prosody-Oriented Speech Codec for Voice Conversion

    Jun 20, 2026Jeongsoo Choi, Ji-Hoon Kim, Shujie Hu +1Neural Speech CodecsProsody

    KAIST, South Korea · Chung-Ang University, South Korea · The Chinese University of Hong Kong, China

  18. SDP-Codec: A Speaker-Decoupled Speech Codec with Pitch Injection for Low-Bitrate Coding and Zero-Shot Voice Conversion

    Jun 19, 2026Hounsu Kim, Juhan NamNeural Speech CodecsAffectcodec

    Graduate School of Culture Technology, KAIST, Daejeon, South Korea

  19. Efficiency-Performance Trade-offs in Neural Speaker Diarization via Structured Pruning and Low-Bit Quantization

    Jun 12, 2026Rishit Chatterjee, Tahiya ChowdhurySpeaker DiarizationNeural Speech Codecs

    Department of Computer Science, Colby College, Waterville, Maine, United States

  20. Self-Guidance: Enhancing Neural Codecs via Decoder Manifold Alignment

    Jun 11, 2026Xiang Li, Yixuan Zhou, Jingran Xie +2Neural Speech CodecsNeural Codecs

    Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China

  21. Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions

    Jun 10, 2026Haiyun Li, Shuhai Peng, Zhisheng Zhang +4Multi-Bit WatermarkingWatermarks

    Shenzhen International Graduate School, Tsinghua University, China · Pengcheng Laboratory, China · Independent Researcher, China

  22. Benchmarking Neural Speech Compression from a Rate-Distortion Perspective

    Jun 10, 2026Jun Xu, Zhengxue Cheng, Fengxi Zhang +3Neural Speech CodecsRate-Distortion Theory

    School of Information Science and Electronic Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

  23. ContextCodec: Content-Focused Context Guidance for Ultra-Low Bitrate Speech Coding

    Jun 9, 2026Chengbin Liang, Wenqi Guo, Hao Cao +1Neural Speech Codecs

    Department of Electronic Engineering, Tsinghua University, Beijing, China · Department of Automation, Tsinghua University, Beijing, China

  24. AffectCodec: Emotion-Preserving Neural Speech Codec with Block-Diagonal Residual FSQ

    May 22, 2026Zhaoyang Meng, Zhengyao Ma, Kecan Mao +2Neural Speech CodecsAffectcodec

    Beijing University of Posts and Telecommunications

  25. Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning

    May 19, 2026Junyi Wang, Chi Zhang, Jing Qian +4Neural Speech CodecsUltra-Low Bitrates

    Tsinghua University, China · Huawei Technologies Co., Ltd, China

  26. AffectCodec: Emotion-Preserving Neural Speech Codec for Expressive Speech Modeling

    May 11, 2026Jiacheng Shi, Hongfei Du, Xinyuan Song +3Neural Speech CodecsAffectcodec

    College of William & Mary · Emory University · George Mason University

  27. ClariCodec: Optimising Neural Speech Codes for 200bps Communication using Reinforcement Learning

    Apr 16, 2026Junyi Wang, Chi Zhang, Jing Qian +4Neural Speech CodecsUltra-Low Bitrates

    Tsinghua University, China · Huawei Technologies Co., Ltd, China

  28. Speech Codec Probing from Semantic and Phonetic Perspectives

    Mar 11, 2026Xuan Shi, Chang Zeng, Tiantian Feng +3Audio TokenizersNeural Speech Codecs

    University of Southern California, USA · Dolby Laboratories, USA