Vector Quantization

Also known as VQ

Overview

Vector quantization replaces continuous vectors with indices into a set of representative codewords, reducing storage and creating discrete tokens for models. Common approaches learn codebooks with autoencoders, use residual or product quantization, or impose geometric structure such as lattices and spheres; they are evaluated on image and audio reconstruction, vector retrieval, language-model quality, and inference speed. Applications range from visual and speech tokenizers to compressed LLM weights and attention caches, where specialized kernels can determine whether smaller representations also run faster. A central tension is preserving task-relevant information at very low bit rates while avoiding codebook collapse, calibration costs, and hardware overhead; utilization alone does not guarantee low distortion or strong downstream results.

Latest papers

CardsList

136 papers19 papers in the last four weeks, up 27% on the four weeks before. 0.1% of all new papers.

  1. Sparse designs via quantization of the uniform measure on high-dimensional hypercubes

    Nov 18, 2026Luc Pronzato, Anatoly ZhigljavskyVector Quantization

  2. HADVQ: Hessian Aware Directional Vector Quantization

    Nov 17, 2026Daniil Li, Mars Davletshin, Vadim Klyzhenko +4QuantizationLLM Quantization

  3. MiSTiQ: MicroScaling Trellis Quantization for Extreme KV Cache Compression

    Nov 16, 2026Ofir Gordon, Lior Dikstein, Paul Balanca +3KV-Cache QuantizationLow-Bit Quantization

  4. Pairwise distortion distribution for compression and quantization

    Nov 9, 2026Carl Nuzman, Jeongmin Chae, Kursat Rasim Mestav +1Intrinsic DimensionalityRate-Distortion Theory

  5. Does Pose Encoding Matter? Analyzing Geometric Representations for Discrete Motion Vocabulary Learning

    Nov 8, 2026Amir Kimiyaie, Nahal Mafi, Hamed TabkhiTokenizationMotion Representation Learning

  6. CALFA-KV: Joint Calibration and Fisher-Guided Anchors for 1-Bit KV Cache Compression

    Nov 7, 2026Xiancai Tian, Leichao Zhang, Shenhui Zhang +5KV-Cache CompressionKV-Cache Quantization

  7. CodeQuant2: Enhanced Outlier Mitigation and Adaptive Clustering for Low-Precision LRMs

    Nov 6, 2026Xingyu Liu, Xiangyang Yin, Tianhua Xia +2LLM QuantizationNeural Network Quantization

  8. SIDRec: End-to-End Semantic ID Representation and Modeling for Recommendation

    Oct 31, 2026Zhuohang Jiang, Yongsen Pan, Pangjing Wu +3Semantic ID RecommendationSemantic Representation Learning

  9. MXCode: Vector Quantization for MX-Native Inference at Scale

    Oct 30, 2026Gaurav Kolhe, Cansu Demirkiran, Shubhi Tyagi +8QuantizationLLM Quantization

  10. Trainable Vector Quantization for Large Language Models

    Oct 30, 2026Anastasiia Prutianova, Alina Bogdanova, Mikhail Shutov +3LLM QuantizationVector Quantization

  11. Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?

    Oct 27, 2026Jialv Zou, Xiaotong Li, Zhengrong Yue +6Discrete Visual TokenizationVisual Representation Learning

  12. CoS-VQ: Coordinated Shared-Scale Vector Quantization for Large Language Models

    Oct 27, 2026Zukang Xu, Zhixiong Zhao, Xing Hu +3LLM QuantizationVector Quantization

  13. From Perception to Pixels: Human-Derived Visually Distinct Colors for Improved Dominant Color Extraction

    Oct 23, 2026Uldana Shyndali, Nurdaulet Toleugaliyev, Kuat Zharykbayev +2Human Visual PerceptionVector Quantization

  14. SQuAT: Spherical Lattice Vector Quantization-Aware Training

    Oct 22, 2026Sebastian Loeschcke, Ivan Koryakovskiy, Tycho F. A. van der Ouderaa +4LLM QuantizationVector Quantization

  15. Extreme Compression of Per-Layer Embeddings via Cross-Layer Latent Vector Quantization

    Oct 22, 2026Jiacheng Liu, Yaxin Luo, Xiaohan Zhao +5Embedding CompressionLLM Compression

  16. Beyond 4 bits: Data-Centric Post-training Quantization and Recovery

    Oct 20, 2026Rhea Sanjay Sukthanker, Riccardo Grazzi, James Hensman +1LLM QuantizationPost-Training Quantization

  17. E8-QAT: Efficient 2-Bit Quantization-Aware Training with Implicit Lattice Codebooks

    Oct 20, 2026Xinyu Lei, Hong Huang, Jiebin Zhang +6LLM QuantizationQuantization-Aware Training

  18. Discrete Neural Interlingua for Ontology-Agnostic EHR Modeling

    Oct 19, 2026Tong Ding, Caiwei Tian, Dongmin Bang +6Tokenization in Language ModelsEHR Foundation Models

  19. TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference

    Oct 15, 2026Muhammad Azlan Qazi, Alexandros Iosifidis, Qi ZhangEfficient Transformer InferenceTransformer Inference

  20. Sliced Wasserstein Sketches with Error Certificates

    Oct 14, 2026Elaheh Akbari, James Liu, Keaton Hamm +1Sliced Wasserstein DistanceVector Quantization

  21. E8 Lattice Key Quantization for Low-Bit KV-Cache Compression

    Oct 11, 2026Sasho Nedelkoski, Alexander Acker, Soeren Becker +2KV-Cache CompressionKV-Cache Quantization

  22. SAGE: Pushing 2-Bit Vector-Quantized LLMs toward Real-World Usability

    Oct 10, 2026Xianglong Yan, Zenan Wu, Kewei Zhang +2LLM QuantizationWeight-Only Quantization

  23. The Polytopal Neural Network

    Oct 8, 2026A. Emilie J. Wedenborg, Anders V. Nørskov, Teresa Dorszewski +2Neural Network InterpretabilityGeometric Representation Learning

  24. Optimal random quantisers for spherically symmetric distributions

    Oct 8, 2026Luc Pronzato, Anatoly ZhigljavskyVector QuantizationRate-Distortion Optimization

  25. OrBIT: Structure-Guided Embedding Compression

    Oct 7, 2026Yunied Puig, Amit Kumar JaiswalEmbedding CompressionLLM Compression

  26. A Systematic Study of Semantic ID Spaces for Generative Information Retrieval

    Oct 6, 2026Alexia Allal, Hicham Randrianarivo, Sylvain LamprierResidual VQVector Quantization