Overview

Activation quantization studies how to represent the intermediate values passed between neural-network layers with fewer bits, reducing memory traffic and enabling faster, smaller deployments. Common approaches include calibration-based clipping and scale selection, smoothing or rotating activations to reduce outliers, mixed-precision allocation, and quantization-aware training; methods target formats such as INT8, INT4, and FP4. Work spans language and vision models, diffusion systems, speech models, and interactive policies, with evaluations using measures such as perplexity, ImageNet accuracy, generation quality, and task success. A central tension is preserving quality across changing activation distributions while delivering real speed and memory gains on the hardware and kernels used in deployment.

Latest papers

CardsList

128 papers10 papers in the last four weeks, down 64% on the four weeks before. 0.1% of all new papers.

  1. DAQ: Decision-Aligned Post-Training Quantization for Spiking Transformers

    Nov 17, 2026Jialin Chen, Xiaochen Zhao, Aili WangPost-Training QuantizationSpiking Neural Networks

  2. Beyond a Single Sign: BiTE for Branch-Preserving Binary Threshold Expansion

    Nov 12, 2026Siddharth Gupta, Mikail Yayla, Akash KumarBinary Neural NetworksBinary Quantization

  3. SignRot: LLM Quantization with Massive Outlier-Aware Sign-Adjusted Rotation

    Nov 12, 2026Jaehun Gim, Jaewoo Kim, Gyuwan Kim +1LLM QuantizationNeural Network Quantization

  4. MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations

    Nov 7, 2026Lorenz K. Muller, Philippe Bich, Chiara Boretti +3Post-Training QuantizationNeural Network Quantization

  5. ProQuant: Progressive Quantization-aware Training for Edge MLLMs

    Nov 5, 2026Yufei Xue, Yushi Huang, Jiawei Shao +5LLM QuantizationQuantization-Aware Training

  6. What Does 4-Bit Microscaling Cost a Wearable Activity Recognizer?

    Nov 3, 2026Megan Healy, Hossein Valavi4-Bit QuantizationActivation Quantization

  7. A Unified Hessian-Guided Framework for Post-Training Quantization

    Oct 29, 2026Mads Toftrup, Marco Federici, Boris van Breugel +2QuantizationLLM Quantization

  8. Quantize by Doing: Task-Guided Mixed-Precision Quantization of Vision-Language-Action Models

    Oct 28, 2026Jiuyi Xu, Xiao Hu, Meida Chen +3Mixed-Precision QuantizationVLM Quantization

  9. ResCom: Activation Residual Compensation for Large Language Model Quantization

    Oct 25, 2026Ning Yang, Bohan Cui, Zhuowen Liu +1LLM QuantizationQuantization Error Compensation

  10. PACT: NVFP4 Data-Flow LoRA Fine-Tuning on Consumer GPUs

    Oct 18, 2026Lei Gao, Hossein Entezari Zarch, Chaoyi Jiang +1Memory-Efficient Fine-TuningParameter-Efficient Fine-Tuning

  11. SpikeQ: Spike-Guided Post-Training Quantization for Spiking Neural Networks

    Oct 16, 2026Kai Sun, Peibo Duan, Zhanglu Yan +3Spiking Neural NetworksPost-Training Quantization

  12. Compiling Multi-Threshold Operators for Quantized Non-Monotonic and Fine-Granular Activations in Custom-Tailored DNN Accelerators

    Oct 15, 2026Christoph Berganski, Felix Jentzsch, Marco PlatznerActivation QuantizationNeural Network Activation Functions

  13. HGA-Quant: Heterogeneity-Aware Quantization for AutoRegressive Visual Generation Models

    Oct 11, 2026Xinmeng Liu, Xianglong Yan, Kaicheng Yang +2Post-Training QuantizationNeural Network Quantization

  14. Deflating the Hessian: Rank-4 W4A4 Quantization for Multimodal Diffusion Transformers

    Oct 8, 2026Shiwen Wang, Pengxiang Zhao, Xiaoming YuanDiffusion Model QuantizationPost-Training Quantization

  15. TR-PTQ: High-Accuracy Integer-Only Transformer Post Training Quantization via Taylor Region Reformulation

    Oct 7, 2026Eliyahu Levy, Adam Teman, Yoni PugachovPost-Training QuantizationNeural Network Quantization

  16. Few Bits, One Law: Toward W2A4KV2

    Oct 6, 2026Kai Yi, Tarek Elgamal, Sruthikesh Surineni +3Neural Network QuantizationLLM Quantization

  17. Test-Time Adaptation of Quantized ViTs via Single-Pass Quantizer-Aligned Recalibration

    Oct 6, 2026Hyeongheon Cha, Young D. Kwon, Sung-Ju LeeTest-Time AdaptationVision Transformer

  18. VisionMX: Unlocking Microscaling Post-Training Quantization for Vision Models

    Oct 2, 2026Elad Dror Cohen, Ofir Gordon, Lior Dikstein +2Neural Network QuantizationPost-Training Quantization

  19. CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation

    Oct 2, 2026Jin Hyun, Jung Gyu Min, Gyuhyun Jung +1Post-Training QuantizationVLM Quantization

  20. Joint Branch-Space Transform Coding for Diffusion Activation Quantization with Classifier-Free Guidance

    Oct 1, 2026Mingrun Jiang, Yuejia Liu, Zishan Shao +11Classifier-Free GuidanceDiffusion Model Quantization

  21. Backward-State Policy Is Part of the Learning Algorithm

    Sep 30, 2026Shuxiao Xie, Shuyang Xie, Dezhi Ran +2Mixed-Precision QuantizationBackpropagation

  22. Behavioral Capacity Certificates for Quantized Language Models

    Sep 29, 2026Arian Eamaz, Mojtaba SoltanalianLLM QuantizationKV-Cache Quantization