Mixed-Precision Quantization

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 38% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 100

All topics

Layerwise Error Attribution for Fast and Robust Mixed-Precision Post-Training Quantization
Oct 7, 2026Samy Houache, Yann Traonmilin, Jean-François AujolPost-Training Quantization Neural Network Quantization
IMB, UB · UB, IMB
Quantize by Drift: Label-Free Mixed-Precision Post-Training Quantization for Text Embedders
Oct 6, 2026Hyojung Han, Jongmin Kim, Seung-Hun JeonPost-Training Quantization Mixed-Precision Quantization
ThakiCloud
Q-PACE: Dynamic Precision Allocation for Quantization-Aware Training
Oct 6, 2026Alexandra Volkova, Matin Ansaripour, Erik Schultheis +2LLM Quantization Quantization-Aware Training
ISTA · EPFL, ISTA
AlignQuant: Tile-Aligned Mixed-Precision Quantization for Efficient LLM Generation
Oct 5, 2026Hanzhi Zhang, Qiao Zhang, Qinglei Cao +4Mixed-Precision Quantization LLM Quantization
LLaVi Lab, Computer Science & Engineering, University of North Texas
StagQ: Constraint-Driven Multi-Precision Weight Quantization for LLMs
Oct 5, 2026Zhe Wei, Mengqi Guo, Yuan Yuan +3Mixed-Precision Quantization LLM Quantization
Huawei Technologies Ltd.
Backward-State Policy Is Part of the Learning Algorithm
Sep 30, 2026Shuxiao Xie, Shuyang Xie, Dezhi Ran +2Mixed-Precision Quantization Backpropagation
Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC), China
Fiona: Accelerating FHE Inference with Packing-Aware Ternary Weights
Sep 28, 2026Yiteng Peng, Zhibo Liu, Dongwei Xiao +1Mixed-Precision Quantization Efficient Neural Network Inference
The Hong Kong University of Science and Technology · State Key Laboratory of Novel Software Technology, Nanjing University
From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers
Sep 28, 2026Nafiseh HosseinpourFardi, Negar Alihadi, Mahmoudreza Babaei +2Mixed-Precision Quantization LLM Quantization
Sharif University of Technology, Tehran, Iran · GISMA University of Applied Sciences, Potsdam, Germany · BRAINS, Brandenburg Research Center for Applied Intelligent Systems, Potsdam, Germany +3
Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization
Sep 27, 2026I Kennedy, T KennedyMixed-Precision Quantization LLM Quantization
baa.ai Auckland, New Zealand
Q-WAM: 4-Bit Quantization of World Action Models with Action-Subspace Protection
Sep 27, 2026Arash Akbari, Arman Akbari, Jingwu Luo +7Mixed-Precision Quantization 4-Bit Quantization
Northeastern University · EmbodyX · University of Minnesota - Twin Cities +1
RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models
Sep 23, 2026David Población-Criado, Dario Garcia-Gasulla, Eduardo QuinonesMixed-Precision Quantization Edge Inference
Barcelona Supercomputing Center (BSC) · Universitat Politècnica de Catalunya - BarcelonaTech (UPC)
Beyond Scalar Sensitivity: Activation-Aware Mixed-Precision LLM Quantization with Cross-Layer Refinement
Sep 22, 2026Akihiro Yoshida, Yuma IchikawaMixed-Precision Quantization LLM Quantization
Fujitsu Limited, Institute of Science Tokyo · Fujitsu Limited, RIKEN Center for AIP
VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Models
Sep 21, 2026Jiuyi Xu, Qing Jin, Meida Chen +3Mixed-Precision Quantization Efficient VLA Model Inference
Colorado School of Mines · Independent Researcher · University of Central Florida +2
The Undetected Damage of Quantization on Retrieval and How to Fix It
Sep 21, 2026Luca Zhou, Alessandro Zirilli, Daniele Solombrino +2Mixed-Precision Quantization Information Retrieval
Sapienza University of Rome · Not Diamond · Paradigma
Text Scores Do Not Establish Performance on Lexically Non-Diagnostic Speech Tasks: A Qwen2-Audio Quantization Case Study
Sep 20, 2026Mengzhe Geng, Jinxi Ji, Junhao XuAudio-Language Model Evaluation Mixed-Precision Quantization
National Research Council Canada · The Hong Kong Polytechnic University · The Chinese University of Hong Kong
Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing
Sep 16, 2026Eunju Shin, Jongbin RyuMixed-Precision Quantization Mixture-of-Experts Quantization
Ajou University, South Korea
Task-Aware QUBO Allocation for Mixed-Precision Quantization
Sep 4, 2026Osama Orabi, Artur Zagitov, Hadi Salloum +2Mixed-Precision Quantization Cost-Aware Inference
Laboratory of Quantum Computing, Innopolis University, 420500 Innopolis, Russia · Q Deep, Laboratory of Quantum Computing, 420502 Innopolis, Russia · Moscow Independent Research Institute of Artificial Intelligence (MIRAI), 117218 Moscow, Russia +2
Hardware-Aware FP4 FlashAttention-4
Sep 3, 2026Robert HuMixed-Precision Quantization GPU Kernel Optimization
GRAPHCORE RESEARCH
The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally
Sep 1, 2026Jundong Hu, Shekar RamachandranMixed-Precision Quantization LLM Quantization
PayPal AI
Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs
Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision Quantization LLM Quantization
Department of Computer Science and Engineering, Seoul National University · Neural Processing Research Center · 3Neural Processing Research Center +2
HyQuant: Hybrid-Precision Quantization for LLM Attention
Aug 28, 2026Jiatong Ding, Bingxin Xing, Yu Zhang +9Mixed-Precision Quantization LLM Quantization
Shanghai Jiao Tong University · Xi’an Jiaotong University · Xiamen University +1
DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization
Aug 27, 2026Tao Zhang, Jianchao Tan, Pingwei Sun +6Mixed-Precision Quantization LLM Quantization
South China University of Technology · Meituan · East China Normal University
FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference
Aug 24, 2026Gongwei Lee, Ji Liu, Juncheng Jia +1Mixed-Precision Quantization LLM Quantization
School of Computer Science and Technology, Soochow University, Suzhou, China · Hithink Research, Hangzhou, China · Electronic Engineering, Tsinghua University, Beijing, China
HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression
Aug 12, 2026Yuefeng ZhangMixed-Precision Quantization Learned Image Compression
Beijing Institute of Computer Technology and Application, Beijing, China · School of Elite Engineering, Northwestern Polytechnical University, Shaanxi, China
SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding
Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Mixed-Precision Quantization KV Caching
Nokia · Rice University
PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks
Aug 7, 2026Hui Xie, Tong Shi, Haotong Qin +3Mixed-Precision Quantization 4-Bit Quantization
State Key Laboratory of Complex & Critical Software Environment, Beihang University · School of Artificial Intelligence, Beihang University · Center for Project-Based Learning, D-ITET, ETH Zurich +2
MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model
Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision Quantization Efficient Neural Network Inference
Microelectronics Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China
APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning
Aug 6, 2026Sadegh Jafari, Mohiuddin Bilwal, Fan Zhou +2Model Compression Mixed-Precision Quantization
Department of Computer Science Iowa State University Ames, IA, USA · Department of Agricultural and Biosystems Engineering Iowa State University Ames, IA, USA
Recurrent Residual Quantization: A Progressive Multi-Precision Representation for LLMs
Aug 4, 2026Yu Luo, Bo Dong, Wenhua Cheng +1Mixed-Precision Quantization LLM Quantization
Intel
TASQ: Temporal-Adaptive Bit Sparsification Quantization for Diffusion Models
Aug 4, 2026Seokho Han, Dongwei Wang, Jinhee Kim +4Mixed-Precision Quantization Diffusion Model Quantization
Department of Electrical and Computer Engineering, Sungkyunkwan University, Korea · Department of Electrical and Computer Engineering, University of Arizona, USA · Department of Electrical and Computer Engineering, Duke University, USA +1

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

Layerwise Error Attribution for Fast and Robust Mixed-Precision Post-Training Quantization

Samy Houache, Yann Traonmilin, Jean-François Aujol

IMB, UB · UB, IMB

Post-Training Quantization Neural Network Quantization Mixed-Precision Quantization

Open paper AskPDF arXiv

Mixed-precision post-training quantization is a network compression method that assigns bits layer by layer, under a global memory budget using a small calibration set. The main difficulties are to overcome the combinatorial nature of the allocation problem and to manage the sensitivity to small, potentially corrupted databases. Hence, an efficient allocation method should be fast to compute and preserve model quality when calibration data are corrupted. To design such a method, we derive a layerwise probabilistic analysis of the quantization error that separates propagated error from the local perturbation introduced at a given layer. We use this local term to build a separable score for a simple allocation algorithm, that requires no external solver. The probabilistic nature of our approach brings robustness to corrupted data. On denoising tasks with DRUNet, with an average budget of 4 bits per weight, our method matches or improves state-of-the-art mixed-precision baselines under clean calibration, and is more robust to corrupted calibration, with PSNR gains of up to 7.5 dB under the tested corruptions. Experiments show bit-allocation speed-ups from 28x to 2,570x over the studied baselines. For quantized diffusion models, our experiments show that a direct application of our framework also improves the state-of-the-art.

Momentum

Related topics

Latest papers 100