Vector Quantization

Also known as VQ

Follow this topic Ask about this topic

Momentum

8 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 86

All topics

The Polytopal Neural Network
Oct 8, 2026A. Emilie J. Wedenborg, Anders V. Nørskov, Teresa Dorszewski +2Neural Network Interpretability Geometric Representation Learning
Technical University of Denmark · UiT The Arctic University of Norway
Optimal random quantisers for spherically symmetric distributions
Oct 8, 2026Luc Pronzato, Anatoly ZhigljavskyVector Quantization Rate-Distortion Optimization
Laboratoire I3S, CNRS-Université Côte d’Azur, Sophia Antipolis, France · School of Mathematics, Cardiff University, UK
OrBIT: Structure-Guided Embedding Compression
Oct 7, 2026Yunied Puig, Amit Kumar JaiswalEmbedding Compression LLM Compression
Jay Chaudhry Software Innovation Centre Indian Institute of Technology (BHU) Varanasi, India
A Systematic Study of Semantic ID Spaces for Generative Information Retrieval
Oct 6, 2026Alexia Allal, Hicham Randrianarivo, Sylvain LamprierResidual VQ Vector Quantization
Artefact Research Center Paris, France · LERIA, Angers University Angers, France
Derandomizing Dense Binary Hypervector Codebooks for Quantized Scalars
Sep 29, 2026Dmitri Rachkovskij, Evgeny Osipov, Olexander Volkov +2Vector Quantization Hyperdimensional Computing
Department of Computer Science, Electrical and Space Engineering, Luleå University of Technology, 971 87 Luleå, Sweden · Institute of Information Technologies and Systems, 03187 Kyiv, Ukraine · AI, Robotics and Cybersecurity Center (ARC) and Department of Computer Science, Örebro University, 70182 Örebro, Sweden +2
FineSID: Scalable and Efficient Semantic Identifier Learning for Generative Recommendation
Sep 29, 2026Song-Li Wu, Weinan Gan, Zhaocheng Du +2Semantic ID Recommendation Vector Quantization
Tsinghua University · Huawei Noah’s Ark Lab · University of Science and Technology of China
TORQUE: Optimizing What (not) to Quantize Before and After Rotation
Sep 28, 2026Ran Ben Basat, Michael Mitzenmacher, Shay VargaftikRotation-Based Quantization Vector Quantization
University College London · Harvard University · VMware Research by Broadcom
SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models
Sep 21, 2026Kewei Zhang, Zheng Chen, Haotong Qin +1VLM Quantization Efficient VLM Inference
Shanghai Jiao Tong University · The Hong Kong Polytechnic University
ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models
Sep 16, 2026Shijie Lian, Bin Yu, Zhaolong Shen +5Vector Quantization Robotic Manipulation
Huazhong University of Science and Technology · Zhongguancun Academy · DeepCybo +5
M2Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models
Sep 16, 2026Chunpu Xu, Zhixuan Liang, Yuhao Zhang +6Vector Quantization Vision-Language-Action Models
The Hong Kong Polytechnic University, HongKong SAR, China · Shanghai AI Laboratory, Shanghai, China · The University of Hong Kong, HongKong SAR, China +2
Storage-Scalable Progressive Semantic Communication via Knowledge-Base Reuse
Sep 9, 2026Heng Zhu, Ye Liu, Kun Zhu +1Residual VQ Semantic Communication
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
When Does Low-Bit Quantization Preserve the Decisions of Vector Search?
Sep 9, 2026Wenxuan Xiao, Xu CaoVector Quantization Low-Bit Quantization
Astrmira Tech.
Tree-VQ: Progressive Image Compression from Pretrained Vector Quantizers
Sep 3, 2026Mingming Ma, Xinkun Wang, Tianyi Xu +3Learned Image Compression Vector Quantization
School of Artificial Intelligence Xidian University
PACodec: A Low-bitrate Neural Speech Codec with Parallel Additive Vector Quantization
Sep 3, 2026Fei Liu, Yang Ai, Xiao-Hang Jiang +1Neural Audio Codecs Speech Processing
National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei, China
Unfolding the Leech Lattice: Fused Multi-Shell Decoding and VRAM Layouts for 2-Bit LLM Weights
Sep 2, 2026Pier-Jean MalandrinoLLM Inference Vector Quantization
Scub
A Unified Rate-Distortion Perspective on Vector, Product, and Scalar Quantization
Sep 2, 2026Xianghong Fang, Wenlong Mou, Yuan Yuan +2Vector Quantization Product Quantization
University of Toronto · 2Boston College · 3Vijil
BiMTokenizer: Preserving Semantic-Acoustic Balance in Low-Bitrate Speech Tokenization via Bidirectional State-Space Modeling
Sep 1, 2026Xin Zhang, Lin Li, Chuanbo Liu +2Neural Audio Codecs Vector Quantization
Wuhan University of Technology, Wuhan, China · NEC Laboratories Asia Pacific, Singapore · NEC Corporation, Japan +1
RSLM: Training-Free Vector Quantization for Approximate Nearest Neighbor Search
Aug 31, 2026Rastislav Lenhardt, Teodora Dobos, Thomas Vecchiato +2Rotation-Based Quantization Vector Quantization
Google Zurich, Switzerland · Technical University of Munich Munich, Germany · University of Copenhagen Copenhagen, Denmark +1
MASQ: Mask-Aware Spatiotemporal Quantization for Unsupervised Skeleton Action Segmentation
Aug 30, 2026Xinyao Qin, Linxiang Peng, Youbao Ye +2Temporal Action Segmentation Unsupervised Representation Learning
University of Science and Technology of China, China
Gromov-Wasserstein Quantization and Clustering: Structure, Rates, and Algorithms
Aug 11, 2026Florian Beier, Stephan EcksteinClustering Vector Quantization
Department of Mathematics, University of Tübingen, Germany
SSTQ:Privacy-Preserving Vector Quantization via Subsampled Stochastic TurboQuant
Aug 5, 2026Adel Javanmard, David P. Woodruff, Vahab MirrokniDistributed Optimization Vector Quantization
University of Southern California · Google Research · Carnegie Mellon University
VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection
Aug 5, 2026Narges Rashvand, Ghazal Alinezhad Noghre, Shanle Yao +2Vector Quantization Reconstruction-Based Anomaly Detection
Electrical and Computer Engineering Department University of North Carolina at Charlotte Charlotte, NC, USA
Spend Bits Where Queries Look: KV Cache Vector Quantization with Attention-Preserving Transforms
Aug 4, 2026Samuel Fernández-Menduiña, Amir Ziashahabi, Eduardo Pavez +2KV Caching Vector Quantization
Department of Electrical and Computer Engineering, University of Southern California
VQ-bench: A Composable Vector Quantization Framework
Jul 31, 2026Ashwin Padaki, Amir Ingber, Edo LibertyVector Quantization
University of Pennsylvania and Pinecone · Pinecone
A Motion-Aware Vector Quantization Framework with Centroid Reuse for Efficient VLA Inference
Jul 27, 2026Zhuoran Song, Haozhe Jiang, Chunyu Qi +4AI Accelerator Inference Efficient VLA Model Inference
School of Computer Science, Shanghai Jiao Tong University, 2 Institute of Automation, Chinese Academy of Sciences China
Codebook Capacity Governs Perceptual Quality Across Resolutions in Hierarchical Discrete Video Compression
Jul 25, 2026Manikanta Kotthapalli, Banafsheh RekabdarVector-Quantized Variational Autoencoder Vector Quantization
Department of Computer Science Portland State University Portland, OR 97201
dRAE: Representation Autoencoder with Hyper-Spherical Codes
Jul 24, 2026Tianren Ma, Lin Long, Chuyan Chen +4Autoencoders Hyperspherical Representation Learning
University of Chinese Academy of Sciences · Ant Group · Zhejiang University +1
VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers
Jul 21, 2026Xianghong Fang, Yuan Yuan, Dehan Kong +1Visual Tokenization Image Reconstruction
University of Toronto · 2Boston College · 3Vijil
TurboVec: A Case Study in Cost-Efficient Private Retrieval for Enterprise RAG via Codebook-Oblivious Quantization
Jul 18, 2026Navnit Shukla, Kamal Pandey, Omsankar TiwariRetrieval-Augmented Generation Vector Quantization
Snowflake Inc. Tustin, California, USA · Rivian Automotive Inc. Irvine, United States of America · Google Deepmind Sunnyvale, California, USA
HARP: Harmonic-Aware Residual Partitioning for Neural Audio Codecs
Jul 18, 2026Qiaoyu Yang, Lixing He, Binyue Deng +1Audio Representation Learning Neural Audio Codecs
Georgia Institute of Technology, Atlanta, United States · The Chinese University of Hong Kong, Hong Kong, China · Tencent Music Entertainment, Shenzhen, China

Oct 8, 2026, cs.LGJ/K move · Enter open · S save

The Polytopal Neural Network

A. Emilie J. Wedenborg, Anders V. Nørskov, Teresa Dorszewski, Kristoffer Wickstrøm+1

Technical University of Denmark · UiT The Arctic University of Norway

Neural Network Interpretability Geometric Representation Learning Vector Quantization Neural Network Compression

Open paper AskPDF arXiv

Understanding how deep neural networks process information remains a central challenge. Existing interpretability methods often compromise structural fidelity, rely on prespecified corpora, or explain models post-hoc. We propose Polytopal Neural Networks (PNNs), a framework that extracts distinct layer-wise aspects by enforcing a polytope-based structure that is used directly in subsequent information processing. We scale our approach using learned corpus representations and an amortized simplex inference procedure and highlight how the framework also gives a direct route to vector quantized (VQ) training. In PNNs, observations are explicitly described by their alignment with layer-specific aspects. Empirical results show that imposing polytopal constraints on neural network representations preserves meaningful structures in the latent space with minimal degradation in performance, favorable compressed representations when compared to VQ representations in unsupervised learning, while also providing a performant new approach to VQ deep learning training. Our findings suggest that deep networks can enforce interpretable polytope-based representations, offering a principled path toward more transparent AI systems with minimal performance compromise.

Momentum

Related topics

Latest papers 86