Neural Network Quantization

Ask about this topic

Momentum

36 papers in the last four weeks, up 125% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 270

All topics
CardsList

  1. Finer is Better (with the Right Scaling)

    May 8, 2026Clemens Schaefer, Gil TabakLLM Quantization4-Bit Quantization

    Google LLC, Mountain View, Ca

  2. Direction-Preserving Number Representations

    May 8, 2026Bardia Zadeh, George A. Constantinides4-Bit QuantizationLow-Bit Quantization

    Department of Electrical and Electronic Engineering Imperial College London London, United Kingdom

  3. Amortized-Precision Quantization for Early-Exit Vision Transformers

    May 8, 2026Rui Fang, Hsi-Wen Chen, Ming-Syan ChenMixed-Precision QuantizationDynamic Neural Networks

    National Taiwan University

  4. PoTAcc: A Pipeline for End-to-End Acceleration of Power-of-Two Quantized DNNs

    May 7, 2026Rappy Saha, Jude Haris, Nicolas Bohm Agostini +2Efficient Neural Network InferenceFPGA-Based Neural Network Acceleration

  5. When Quantization Is Free: An int4 KV Cache That Outruns fp16 on Apple Silicon

    May 7, 2026Mohamed Amine BergachGPU Kernel OptimizationKV Caching

    Illumina, San Diego, CA, USA

  6. Saliency-Aware Regularized Quantization Calibration for Large Language Models

    May 7, 2026Yanlong Zhao, Xiaoyuan Cheng, Huihang Liu +6LLM QuantizationLanguage Model Calibration

    University of Science and Technology of China · University College London · 3Shanghai University of Finance and Economics +5

  7. OSAQ: Outlier Self-Absorption for Accurate Low-bit LLM Quantization

    May 6, 2026Zhikai Li, Zhen Dong, Xuewen Liu +2LLM QuantizationWeight-Only Quantization

    Institute of Automation, Chinese Academy of Sciences · University of California, Santa Barbara.

  8. Hardware-Aware Neural Feature Extraction for Resource-Constrained Devices

    May 5, 2026Francesco Tosini, Simone Pedroni, Christian Veronesi +5Edge InferenceVisual SLAM

    Department of Electronics, Information and Bioengineering (DEIB), Politecnico di Milano, Italy · Department of Electronics, Informationة · Smart Eyewear Lab, EssilorLuxottica, Milan, Italy

  9. Topology-Constrained Quantized nnUNet for Efficient and Anatomically Accurate 3D Tooth Segmentation

    May 5, 2026Paarth Prasad, Ruchika MalhotraQuantization-Aware TrainingTopology-Preserving Image Segmentation

    Department of Software Engineering, Delhi Technological University

  10. HeadQ: Model-Visible Distortion and Score-Space Correction for KV-Cache Quantization

    May 5, 2026Jorge L. Ruiz WilliamsSelf-AttentionKV Caching

    Independent Researcher

  11. QuIDE: Mastering the Quantized Intelligence Trade-off via Active Optimization

    May 5, 2026Xiantao JiangMixed-Precision QuantizationLLM Quantization

    College of Information Engineering, Shanghai Maritime University Shanghai 201306, China

  12. Statistically-Lossless Quantization of Large Language Models

    May 4, 2026Michael Helcig, Eldar Kurtic, Dan AlistarhLLM QuantizationLLM Inference Acceleration

    ETH Z̈urich · ISTA

  13. ViM-Q: Scalable Algorithm-Hardware Co-Design for Vision Mamba Model Inference on FPGA

    May 3, 2026Shengzhe Lyu, Yuhan She, Patrick S. Y. Hung +2Efficient Neural Network InferenceEdge Inference

    City University of Hong Kong, Hong Kong

  14. ShiftLIF: Efficient Multi-Level Spiking Neurons with Power-of-Two Quantization

    May 3, 2026Kaiwen Tang, Di Yu, Jiaqi Zheng +4Spiking Neural NetworksNeural Network Quantization

    Zhejiang University · Shandong University

  15. Technical Report: Activation Residual Hessian Quantization (ARHQ) for Low-Bit LLM Quantization

    Apr 30, 2026YiFeng Wang, Zhun Sun, Keisuke SakaguchiLLM QuantizationActivation Quantization

    Graduate School of Information Sciences Tohoku University

  16. Quantamination: Dynamic Quantization Leaks Your Data Across the Batch

    Apr 29, 2026Hanna Foerster, Ilia Shumailov, Cheng Zhang +3Data LeakagePrivacy-Preserving ML

    University of Cambridge · 2AI Sequrity Company · 3Google DeepMind

  17. CoQuant: Joint Weight-Activation Subspace Projection for Mixed-Precision LLMs

    Apr 29, 2026Zhe Ding, Su Pan, Duowei PanMixed-Precision QuantizationLLM Quantization

    School of Internet of Things, Nanjing University of Posts and Telecommunications, Nanjing, China · Amazon AGI, Seattle, WA, USA

  18. Multibit neural inference in a N-ary crossbar architecture

    Apr 28, 2026Anatole Moureaux, Anthony Lopes Temporao, Flavio Abreu AraujoEfficient Neural Network InferenceCompute-in-Memory

    Universit´e catholique de Louvain, Institute of Condensed Matter and Nanosciences, Louvain-la-Neuve, 1348, Belgium

  19. QFlash: Bridging Quantization and Memory Efficiency in Vision Transformer Attention

    Apr 28, 2026Sehyeon Oh, Yongin Kwon, Jemin LeeSoftmax AttentionGPU Acceleration

    University of Science and Technology, Daejeon, Republic of Korea · Electronics and Telecommunications Research Institute, Daejeon, Republic of Korea · Pusan National University, Busan, Republic of Korea +1

  20. Deployment-Aligned Low-Precision Neural Architecture Search for Spaceborne Edge AI

    Apr 27, 2026Parampuneet Kaur Thind, Vaibhav Katturu, Giacomo Zema +1Edge ComputingHardware-Aware NAS

    1Sapienza University of Rome · 2 Φ-lab, ESA ESRIN · 4Argotec Srl +1

  21. Enhanced Privacy and Communication Efficiency in Non-IID Federated Learning with Adaptive Quantization and Differential Privacy

    Apr 25, 2026Emre Ardıç, Yakup GençNon-IID Federated LearningDifferentially Private Federated Learning

    Department of Computer Engineering, Gebze Technical University, Gebze, Kocaeli 41400, Türkiye

  22. Efficient VQ-QAT and Mixed Vector/Linear quantized Neural Networks

    Apr 25, 2026Terry Gou, Puneet GuptaQuantization-Aware TrainingVector Quantization

  23. HGQ-LUT: Fast LUT-Aware Training and Efficient Architectures for DNN Inference

    Apr 24, 2026Chang Sun, Zhiqiang Que, Bakhtiar Zadeh +4Efficient Neural Network InferenceFPGA-Based Neural Network Acceleration

    California Institute of Technology, Pasadena, CA, USA · University of Bristol, UK · Imperial College London, UK +1

  24. FASQ: Flexible Accelerated Subspace Quantization for Calibration-Free LLM Compression

    Apr 22, 2026Ye Qiao, Yian Wang, Zhiheng Chen +2LLM CompressionGPU Acceleration

    University of California, Irvine Irvine, California, USA

  25. Quantization robustness from dense representations of sparse functions in high-capacity kernel associative memory

    Apr 22, 2026Akira TamamoriNeural Representation GeometryHopfield Networks

    Faculty of Information Science, Aichi Institute of Technology 1247 Yachigusa, Yakusa-cho, Toyota-shi, Aichi 470-0392, Japan

  26. FairyFuse: Multiplication-Free LLM Inference on CPUs via Fused Ternary Kernels

    Apr 22, 2026Fei Zuo, Xiaoyan Xi, Quanyi Zeng +2Efficient Neural Network InferenceTernary Quantization

    BA TechWorks · Peking University

  27. On the Quantization Robustness of Diffusion Language Models in Coding Benchmarks

    Apr 22, 2026Aarav Gupta, Gururaj Deshpande, Chandreyi ChakrabortyMixed-Precision QuantizationDiffusion Model Quantization

    College of Computing · Georgia Institute of Technology

  28. From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization

    Apr 21, 2026Chenxi Zhou, Pengfei Cao, Jiang Li +4LLM QuantizationPost-Training Quantization

    School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences · College of Computer Science, Inner Mongolia University +1

  29. SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving

    Apr 21, 2026Jinda Jia, Jisen Li, Zhongzhu Zhou +8LLM ServingKV Caching

    Together AI

  30. GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling

    Apr 20, 2026Alireza Dadgarnia, Soroush Tabesh, Mahdi Nikdan +4LLM QuantizationPost-Training Quantization

    ISTA · ETH Zürich · ISTA & Red Hat AI +1