Residual VQ

VQ: Vector Quantization

Overview

Residual vector quantization (RVQ) approximates a vector or signal by adding codebook entries in stages, with each stage encoding the error left by the previous ones. Researchers use it in neural audio codecs and generative tokenizers for images, motion, and physiological signals, as well as for recommendation IDs, retrieval, and compressed model caches. Common approaches combine RVQ with autoencoders, coarse-to-fine autoregressive prediction, progressive coding, or task-aware objectives, and are evaluated on reconstruction quality, bitrate, latency, and downstream tasks. A central tension is balancing compact codes and efficient decoding against fidelity and useful semantic structure; stage-aware geometry, adaptive codebooks, and unequal error costs remain active design challenges.

Latest papers

CardsList

36 papers3 papers in the last four weeks, down 67% on the four weeks before. 0.0% of all new papers.

  1. Adaptive Residual Quantization for Memory-Efficient Temporal Action Segmentation

    Nov 9, 2026Gerard Donahue, Guven Gergerli, Ayush Gupta +3Temporal Action SegmentationVector-Quantized Variational Autoencoder

  2. Semantic Residual Vector Quantization for Sign Language Generation

    Nov 4, 2026Chang Liu, Ke Han, Niccolò Biondi +4Sign Language GenerationHuman Motion Generation

  3. Efficient Generative Image Compression with Quantized Latents Refinement

    Oct 21, 2026Hao Cao, Yinhuan Huang, Wenqi Guo +3Generative Image CompressionLearned Image Compression

  4. HE-NAC: High-Efficiency Neural Audio Coding via Hierarchical and Residual Multi-Band Quantization

    Oct 11, 2026Darius Pétermann, Wootaek Lim, Seungkwon Beack +1Neural Audio CodecsResidual VQ

  5. A Systematic Study of Semantic ID Spaces for Generative Information Retrieval

    Oct 6, 2026Alexia Allal, Hicham Randrianarivo, Sylvain LamprierResidual VQVector Quantization

  6. MRVQ: One Resident Index for Dimension- and Rate-Elastic Vector Search

    Oct 2, 2026Sean Culatana, Shang-En Huang, Kang LiEmbedding CompressionDense Retrieval

  7. Rethinking Fixed Temporal Grids: Frequency-Disentangled Motion Generation

    Oct 2, 2026Yunjiao Zhou, Junlang Qian, Gen Li +3Human Motion GenerationMotion Representation Learning

  8. Bandits via Additive Quantized Representations

    Oct 1, 2026Ami Tavory, Noam Touitou, Tal Sarig +2Contextual BanditsResidual VQ

  9. An Efficient Parametric Codec for Low-Bitrate First-Order Ambisonics

    Sep 27, 2026Wei-Ting Lai, Amy Bastine, Lachlan Birnie +2Residual VQSpatial Audio

  10. GeoRVQ: Decoder-aware geometry for residual-token prediction in physiological signals

    Sep 22, 2026Bo Cui, Yaowen ZhangMasked Language ModelingResidual VQ

  11. Geometry-Aware Hyperbolic Residual-Quantized Variational Autoencoders

    Sep 22, 2026Alessio Colombo, Melika AyoughiResidual VQHierarchical Representation Learning

  12. Neural Residual Modeling for Scientific Data Compression under Guaranteed Error Bounds

    Sep 19, 2026Surya Majumder, Liangji Zhu, Sanjay Ranka +1Residual LearningResidual VQ

  13. Storage-Scalable Progressive Semantic Communication via Knowledge-Base Reuse

    Sep 9, 2026Heng Zhu, Ye Liu, Kun Zhu +1Residual VQSemantic Communication

  14. SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation

    Sep 4, 2026Hongyu Wu, Xu Wu, Tianhao Wu +4Sign Language GenerationText-to-Motion Generation

  15. Language-Statistical Analysis of Neural Audio Codec Tokens Across Architectures, Corpora, and Noise Conditions

    Aug 31, 2026Joonyong Park, Shinnosuke Takamichi, David M. Chan +3Neural Audio CodecsResidual VQ

  16. PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenization

    Aug 25, 2026Yunxiao Luo, Siyuan Wang, Ben Chen +2Residual VQGenerative Retrieval

  17. SA-RSQ: A Versatile Sparse Representation Framework for Multi-modal Recommender Systems

    Aug 24, 2026Xiang Wang, Shigang Quan, Tingzhen Chang +5Vector QuantizationResidual VQ

  18. Geometric Iterative Retrieval for Neural Audio Codec Resynthesis

    Aug 19, 2026Leo Schmidt-Traub, Frédéric Berdoz, Luca A. Lanzendörfer +1Neural Audio CodecsResidual VQ

  19. HARP: Harmonic-Aware Residual Partitioning for Neural Audio Codecs

    Jul 18, 2026Qiaoyu Yang, Lixing He, Binyue Deng +1Audio Representation LearningNeural Audio Codecs

  20. GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache

    Jul 1, 2026Soosung Kim, Minjae Park, Eui-Young Chung +1LLM CompressionResidual VQ

  21. NAC: Neural Action Codec for Vision-Language-Action Models

    Jun 19, 2026Ahad Jawaid, Yu XiangNeural Audio CodecsResidual VQ

  22. Learning Variable-Length Tokenization for Generative Recommendation

    May 18, 2026Minhao Wang, Bowen Wu, Wei ZhangResidual VQGenerative Recommendation

  23. RQ-MoE: Residual Quantization via Mixture of Experts for Efficient Input-Dependent Vector Compression

    May 14, 2026Zhengjia Zhong, Shuyan Ke, Zaizhou Lin +3Residual VQVector Quantization

  24. Shao: Scaling Acoustic Token Language Models Toward High-Fidelity Music Generation

    May 3, 2026Jiafeng Liu, Yuanliang Dong, Hongjia Liu +8Text-to-Music GenerationAudio Representation Learning

  25. A Note on TurboQuant and the Earlier DRIVE/EDEN Line of Work

    Apr 20, 2026Ran Ben-Basat, Yaniv Ben-Itzhak, Gal Mendelson +3Residual VQVector Quantization

  26. Emotion-Aware Quantization for Discrete Speech Representations: An Analysis of Emotion Preservation

    Mar 22, 2026Haoguang Zhou, Siyi Wang, Jingyao Wu +2Discrete Speech Representation LearningResidual VQ

  27. EvoTok: A Unified Image Tokenizer via Residual Latent Evolution for Visual Understanding and Generation

    Mar 12, 2026Yan Li, Ning Liao, Xiangyu Zhao +5Image TokenizationUnified Multimodal Models