Low-Bit Quantization

Follow this topic Ask about this topic

Momentum

21 papers in the last four weeks, up 62% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 155

All topics

Provable Quantization with Randomized Hadamard Transform
May 13, 2026Ying Feng, Piotr Indyk, Michael Kapralov +2Vector Quantization Randomized Sketching
Contextual Bandits for Resource-Constrained Devices using Probabilistic Learning
May 13, 2026Marco Angioli, Kevin Johansson, Antonello Rosato +2Hyperdimensional Computing Contextual Bandits
Sapienza University of Rome · Orebro University · Linkoping University +1
FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression
May 12, 2026Namyoon Lee, Yongjune KimKV Caching Rotation-Based Quantization
POSTECH
MuonQ: Enhancing Low-Bit Muon Quantization via Directional Fidelity Optimization
May 12, 2026Yupeng Su, Ruijie Zhang, Ziyue Liu +24-Bit Quantization Muon Optimizer
University of California, Santa Barbara
ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language Models
May 11, 2026Ryan Lucas, Mehdi Makni, Xiang Meng +2LLM Quantization Alternating Direction Method of Multipliers
MIT Operations Research Center · MIT Sloan School of Management · MIT Center for Statistics
Theory-optimal Quantization Based on Flatness
May 11, 2026Xiusheng Huang, Zhe Li, Xuanwu Yin +5LLM Quantization Activation Quantization
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences · Beijing Academy of Artificial Intelligence +2
PermuQuant: Lowering Per-Group Quantization Error by Reordering Channels for Diffusion Models
May 10, 2026Yongsen Cheng, Kai Liu, Kaiwen Tao +5Diffusion Model Quantization Post-Training Quantization
Shanghai Jiao Tong University · Huawei Noah’s Ark Lab
Fitting Is Not Enough: Smoothness in Extremely Quantized LLMs
May 9, 2026Yuzhuang Xu, Xu Han, Yuxuan Li +2LLM Quantization Post-Training Quantization
1Harbin Institute of Technology, Harbin, China · 2Tsinghua University, Beijing, China
Finer is Better (with the Right Scaling)
May 8, 2026Clemens Schaefer, Gil TabakLLM Quantization 4-Bit Quantization
Google LLC, Mountain View, Ca
Direction-Preserving Number Representations
May 8, 2026Bardia Zadeh, George A. Constantinides4-Bit Quantization Low-Bit Quantization
Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom
LoopQ: Quantization for Recursive Transformers
May 8, 2026Rui Fang, Hsi-Wen Chen, Ming-Syan ChenRecurrent Transformers Language Modeling
National Taiwan University
OSAQ: Outlier Self-Absorption for Accurate Low-bit LLM Quantization
May 6, 2026Zhikai Li, Zhen Dong, Xuewen Liu +2LLM Quantization Weight-Only Quantization
Institute of Automation, Chinese Academy of Sciences · University of California, Santa Barbara.
Statistically-Lossless Quantization of Large Language Models
May 4, 2026Michael Helcig, Eldar Kurtic, Dan AlistarhLLM Quantization LLM Inference Acceleration
ETH Z̈urich · ISTA
Colinearity Decay: Training Quantization-Friendly ViTs with Outlier Decay
May 2, 2026Jin Tong, Guang Liang, Peilin Sun +1Vision Transformer Activation Outliers
State Key Laboratory of Novel Software Technology, Nanjing University, Nanjing 210023, China · School of Artificial Intelligence, Nanjing University, Nanjing 210023, China · Zhongguancun Academy, Beijing 100094, China
BWLA: Breaking the Barrier of W1AX Post-Training Quantization for LLMs
May 1, 2026Zhixiong Zhao, Zukang Xu, Dawei YangLLM Quantization LLM Inference Acceleration
1Houmo AI
Technical Report: Activation Residual Hessian Quantization (ARHQ) for Low-Bit LLM Quantization
Apr 30, 2026YiFeng Wang, Zhun Sun, Keisuke SakaguchiLLM Quantization Activation Quantization
Graduate School of Information Sciences Tohoku University
CoQuant: Joint Weight-Activation Subspace Projection for Mixed-Precision LLMs
Apr 29, 2026Zhe Ding, Su Pan, Duowei PanMixed-Precision Quantization LLM Quantization
School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, China · Amazon AGI, Seattle, WA, USA
QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention
Apr 28, 2026Sehyeon Oh, Yongin Kwon, Jemin LeeSoftmax Attention GPU Acceleration
University of Science and Technology, Daejeon, Republic of Korea · Electronics and Telecommunications Research Institute, Daejeon, Republic of Korea · Pusan National University, Busan, Republic of Korea +1
BitRL: Reinforcement Learning with 1-bit Quantized Language Models for Resource-Constrained Edge Deployment
Apr 27, 2026Md. Ashiq Ul Islam Sajid, Mohammad Sakib Mahmood, Md. Tareq Hasan +3LLM Quantization RL for Language Models
Department of Computer Science BRAC University Dhaka 1212, Bangladesh · Department of Computer Science Missouri State University Springfield, MO, USA · Department of Computer Science & Engineering Prime University Dhaka, Bangladesh +2
Efficient INT8 Single-Image Super-Resolution via Deployment-Aware Quantization and Teacher-Guided Training
Apr 22, 2026Pham Phuong Nam Nguyen, Nam Tien Le, Thi Kim Trang Vo +1Efficient Neural Network Inference Quantization-Aware Training
University of Information Technology · 3Vietnam National University, Ho Chi Minh City · 2Ho Chi Minh City University of Technology
From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization
Apr 21, 2026Chenxi Zhou, Pengfei Cao, Jiang Li +4LLM Quantization Post-Training Quantization
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences · College of Computer Science, Inner Mongolia University +1
Revisiting RaBitQ and TurboQuant: A Symmetric Comparison of Methods, Theory, and Experiments
Apr 21, 2026Jianyang Gao, Yutong Gou, Yuexuan Xu +5Vector Quantization KV-Cache Quantization
ETH Zurich · Nanyang Technological University · University of Michigan +2
LBLLM: Lightweight Binarization of Large Language Models via Three-Stage Distillation
Apr 21, 2026Siqing Song, Chuang Wang, Yong Lang +2LLM Quantization Activation Quantization
MAIS, Institute of Automation, Chinese Academy of Sciences, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, China · Central Media Technology Institute, Huawei
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
Apr 20, 2026Alireza Dadgarnia, Soroush Tabesh, Mahdi Nikdan +4LLM Quantization Post-Training Quantization
ISTA · ETH Zürich · ISTA & Red Hat AI +1
A Note on TurboQuant and the Earlier DRIVE/EDEN Line of Work
Apr 20, 2026Ran Ben-Basat, Yaniv Ben-Itzhak, Gal Mendelson +3Residual VQ Vector Quantization
UCL and Broadcom · VMware Research by Broadcom · North Carolina State University +2
Towards Joint Quantization and Token Pruning of Vision-Language Models
Apr 19, 2026Xinqing Li, Xin He, Xindong Zhang +3Vision-Language Models VLM Quantization
VCIP, College of Computer Science, Nankai University · School of Computer Science and Engineering, Tianjin University of Technology · OPPO Research Institute +3
Robust Ultra Low-Bit Post-Training Quantization via Stable Diagonal Curvature Estimate
Apr 15, 2026Jaemin Kim, Sungkyun Kim, Junyeol Lee +1LLM Quantization Language Model Calibration
Seoul National University · Hanyang University
MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models
Feb 3, 2026Maximilian Kleinegger, Elvir Crnčević, Dan AlistarhLLM Quantization LLM Inference Acceleration
1Vienna University of Technology, Vienna, Austria · Institute of Science & Technology Austria (ISTA), Vienna, Austria · 3Red Hat AI, Boston, USA
QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks
Nov 24, 2025Kazi Ahmed Asif Fuad, Lizhong ChenQuantization-Aware Training Kolmogorov-Arnold Networks
Department of EECS · Oregon State University · Corvallis, OR 97331
Activation Quantization of Vision Encoders Needs Prefixing Registers
Oct 6, 2025Seunghyeon Kim, Taesun Yeom, Jinho Kim +3Activation Outliers Activation Quantization
POSTECH · NYU Langone Health2 · Google3

May 13, 2026, cs.LGJ/K move · Enter open · S save

Provable Quantization with Randomized Hadamard Transform

Ying Feng, Piotr Indyk, Michael Kapralov, Dmitry Krachun+1

Vector Quantization Randomized Sketching Low-Bit Quantization Neural Network Quantization

Open paper AskPDF arXiv

Vector quantization via random projection followed by scalar quantization is a fundamental primitive in machine learning, with applications ranging from similarity search to federated learning and KV cache compression. While dense random rotations yield clean theoretical guarantees, they require

Θ(d^2)

time. The randomized Hadamard transform

HD

reduces this cost to

O(d \log d)

, but its discrete structure complicates analysis and leads to weaker or purely empirical compression guarantees. In this work, we study a variant of this approach: dithered quantization with a single randomized Hadamard transform. Specifically, the quantizer applies

HD

to the input vector and subtracts a random scalar offset before quantizing, injecting additional randomness at negligible cost. We prove that this approach is unbiased and provides mean squared error bounds that asymptotically match those achievable with truly random rotation matrices. In particular, we prove that a dithered version of TurboQuant achieves mean squared error

\bigl(π\sqrt{3}/2 + o(1)\bigr) \cdot 4^{-b}

b

bits per coordinate, where the

o(1)

term vanishes uniformly over all unit vectors and all dimensions as the number of quantization levels grows.

Momentum

Related topics

Latest papers 155