Neural Network Quantization

Overview

Neural network quantization studies how to use lower-precision numbers for model weights, activations, caches, and training states while preserving useful behavior. Post-training quantization adjusts a trained model using calibration data or reconstruction objectives, while quantization-aware training exposes the model to low precision during optimization; rotations, outlier handling, and mixed-precision allocation are common techniques. Work spans language models and KV caches, vision and diffusion models, and edge devices, with quality measured using benchmarks such as ImageNet, language-model perplexity, reasoning tasks, and generative quality. A central tension is that lower bit widths do not guarantee faster or safer deployment: accuracy and behavior can shift, and real gains depend on hardware, kernels, and the task being evaluated.

Latest papers

CardsList

438 papers28 papers in the last four weeks, down 63% on the four weeks before. 0.2% of all new papers.

  1. Benford's Law as a Distributional Prior for Post-Training Quantization of Large Language Models

    Jan 29, 2026Arthur Negrão, Pedro Silva, Vander L. S. Freitas +2LLM Quantization4-Bit Quantization

  2. Preserving Fairness and Safety in Quantized LLMs Through Critical Weight Protection

    Jan 17, 2026Muhammad Alif Al Hakim, Alfan Farizki Wicaksono, Fajri KotoLLM QuantizationMultilingual Language Model Evaluation

  3. ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs

    Jan 12, 2026Haoqian Meng, Yilun Luo, Yafei Zhao +3LLM Quantization4-Bit Quantization

  4. Beyond local reconstruction: Geometry-preserving output alignment for binary LLM quantization

    Dec 25, 2025Dung Anh Hoang, Cuong Pham, Cuong Nguyen +3LLM QuantizationBinary Quantization

  5. QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks

    Nov 24, 2025Kazi Ahmed Asif Fuad, Lizhong ChenQuantization-Aware TrainingKolmogorov-Arnold Networks

  6. Adaptive Layer-Wise Transformations for Post-Training Quantization of Large Language Models

    Nov 21, 2025Cuong Pham, Hoang Anh Dung, Cuong C. Nguyen +4LLM QuantizationPost-Training Quantization

  7. Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

    Nov 19, 2025Kexin Chu, Dawei Xiang, Zixu Shen +3Mixed-Precision QuantizationGPU Acceleration

  8. You Had One Job: Per-Task Quantization Using LLMs' Hidden Representations

    Nov 9, 2025Amit LeVi, Raz Lapid, Rom Himelstein +3Neural Network QuantizationMixed-Precision Quantization

  9. Quantization Effects of Artificial Neural Networks for Embedded Edge-Computing Applications

    Nov 7, 2025Alperen Aksoy, Ilja Bekman, Vesselin Dimitrov +6Neural Network QuantizationBinary Neural Networks

  10. Activation Quantization of Vision Encoders Needs Prefixing Registers

    Oct 6, 2025Seunghyeon Kim, Taesun Yeom, Jinho Kim +3Activation OutliersActivation Quantization

  11. QuantDemoire: Quantization with Outlier Aware for Image Demoiréing

    Oct 5, 2025Zheng Chen, Kewei Zhang, Xiaoyang Liu +4QuantizationPost-Training Quantization

  12. QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception

    Sep 3, 2025Seth Z. Zhao, Huizhi Zhang, Zhaowei Li +11V2X CommunicationCooperative Perception

  13. SalQ-VLM: Fine-Grained Saliency-Guided Quantization for Vision-Language Models

    Aug 5, 2025Yufei Xue, Yushi Huang, Lunjie Zhu +2Vision-Language ModelsVLM Quantization

  14. Squeeze10-LLM: Squeezing LLMs' Weights by 10 Times via a Staged Mixed-Precision Quantization Method

    Jul 24, 2025Qingcheng Zhu, Yangyang Ren, Linlin Yang +6Mixed-Precision QuantizationLLM Quantization

  15. GPLQ: A General, Practical, and Lightning QAT Method for Vision Transformers

    Jun 13, 2025Guang Liang, Xinyao Liu, Jianxin WuQuantization-Aware Training4-Bit Quantization

  16. On Orthogonal Recurrent Neural Networks Quantization

    Feb 5, 2024Armand Foucault, Franck Mamalet, François MalgouyresRecurrent Neural NetworksNeural Network Quantization