Neural Network Quantization

Overview

Neural network quantization studies how to use lower-precision numbers for model weights, activations, caches, and training states while preserving useful behavior. Post-training quantization adjusts a trained model using calibration data or reconstruction objectives, while quantization-aware training exposes the model to low precision during optimization; rotations, outlier handling, and mixed-precision allocation are common techniques. Work spans language models and KV caches, vision and diffusion models, and edge devices, with quality measured using benchmarks such as ImageNet, language-model perplexity, reasoning tasks, and generative quality. A central tension is that lower bit widths do not guarantee faster or safer deployment: accuracy and behavior can shift, and real gains depend on hardware, kernels, and the task being evaluated.

Latest papers

CardsList

438 papers28 papers in the last four weeks, down 63% on the four weeks before. 0.2% of all new papers.

  1. Calibrate in Context: Efficient Data-Free Quantization from Small Synthetic Pools

    Nov 19, 2026Haowen Hua, Sen Lin, Yaokun Huang +6Neural Network QuantizationPost-Training Quantization

  2. Zonotopic Analysis of Quantization Error in Neural Networks

    Nov 18, 2026Robert Debbas, Éric Goubault, Sylvie PutotNeural Network VerificationNeural Network Quantization

  3. Compression Effects on Low-Resource Multilingual Translation

    Nov 18, 2026Abbas SaniLow-Resource MTLLM Quantization

  4. MoMoVL: Modality-Aware Adaptive Compression for On-Device Sparsely-Activated Vision-Language Models

    Nov 18, 2026Dongkeun Lee, Wonjun LeeEfficient VLM InferenceVLM Compression

  5. HADVQ: Hessian Aware Directional Vector Quantization

    Nov 17, 2026Daniil Li, Mars Davletshin, Vadim Klyzhenko +4QuantizationLLM Quantization

  6. High-Fidelity Binarized Neural Vocoder

    Nov 17, 2026Andong Li, Tong Lei, Xiaodong Li +1Neural VocodersBinary Quantization

  7. MiSTiQ: MicroScaling Trellis Quantization for Extreme KV Cache Compression

    Nov 16, 2026Ofir Gordon, Lior Dikstein, Paul Balanca +3KV-Cache QuantizationLow-Bit Quantization

  8. Advancing Quantization for R&R Models with Microscaling Formats

    Nov 12, 2026Yavuz Yetim, Bor-Yiing Su, Zhe Wang +16QuantizationEfficient Neural Network Inference

  9. SPARC: Accurate Photonic Matrix Multiplication via Representative Vectors

    Nov 12, 2026Yasuhiro Fujiwara, Tatsuhiro Nakamori, Hideyuki KawashimaPhotonic ComputingEfficient Neural Network Inference

  10. SignRot: LLM Quantization with Massive Outlier-Aware Sign-Adjusted Rotation

    Nov 12, 2026Jaehun Gim, Jaewoo Kim, Gyuwan Kim +1LLM QuantizationNeural Network Quantization

  11. SoScale: Second-Order Scale Search for FP4 Quantization

    Nov 12, 2026Pengxiang Zhao, Xing Li, Hui-Ling Zhen +3LLM QuantizationNeural Network Quantization

  12. Planners Exploit Deterministic Error: Dithered Low-Bit World Models

    Nov 9, 2026Yong Hwi Song, Keon Myung LeeWorld Model-Based PlanningLow-Bit Quantization

  13. Beyond Similarity Entropy: A Rank-Guided Data-Free Quantization Framework for Vision Transformers

    Nov 8, 2026Runqing Jiang, Ye Zhang, Pengpeng Yu +4Neural Network QuantizationPost-Training Quantization

  14. MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations

    Nov 7, 2026Lorenz K. Muller, Philippe Bich, Chiara Boretti +3Post-Training QuantizationNeural Network Quantization

  15. CodeQuant2: Enhanced Outlier Mitigation and Adaptive Clustering for Low-Precision LRMs

    Nov 6, 2026Xingyu Liu, Xiangyang Yin, Tianhua Xia +2LLM QuantizationNeural Network Quantization

  16. Rotation Is Token-Blind: A Structural Criterion for Post-Training Quantization of Feed-Forward Geometry Transformers

    Nov 5, 2026Huanfei He, Bohao Zhang, Jiaxin Zhang +4Post-Training QuantizationNeural Network Quantization

  17. TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization

    Nov 4, 2026Hanzhi Zhang, Qiao Zhang, Qinglei Cao +4LLM QuantizationPost-Training Quantization

  18. Balancing hierarchical representation and quantization: A performance trade-off in text embeddings

    Nov 4, 2026Kai Ponel, Marco Polignano, Erasmo Purificato +4Embedding CompressionText Embedding Evaluation

  19. PTQ4SAM3: Semantics-Preserving Post-Training Quantization for Segment Anything Model 3

    Nov 4, 2026Xi Xiao, Yunbei Zhang, Lin Zhao +7Post-Training QuantizationNeural Network Quantization

  20. SHq: Learnable Grids for LLM Weight Quantization

    Nov 2, 2026Michael Helcig, Earl Killian, Dan AlistarhLLM QuantizationNeural Network Quantization

  21. Guarded Compression of Adam Optimizer State with Shared-Gradient Bounds

    Oct 31, 2026Annan Zhang, Shengjie Song, Wenshuai Yao +2Optimizer State CompressionQuantization

  22. Integer-Exact Microscaling: Running MXFP4 Language Models on INT8 Matrix Units

    Oct 31, 2026Shinyoung Kang, Junhyung Ahn, Yujun Kim +1LLM QuantizationNeural Network Quantization

  23. Quantization of Large Models with Weight Outliers and Sparsity

    Oct 30, 2026Leonidas Tsigkounakis, Abraham Jaeger Mountain, Yilang Zhang +1LLM QuantizationNeural Network Quantization