Quantization

Ask about this topic

Recent momentum

-25%

18 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Mixed-Precision Quantization

Neighbouring directions

Large Language Model QuantizationWeight-Only QuantizationQuantizerMixed-Precision QuantizationFull-Precision PerformanceFloating-PointSystematic Fp16 DivergenceExtreme Low-Bit Quantization

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

3 new papers

A weekly snapshot of new work published in Quantization.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Quantization.

172 papers

Latest in Quantization

Browse all topics →
CardsList

  1. Spectral Perturbation of the Empirical Fisher Information Matrix under Weight Quantization

    Jun 26, 2026Rahid Zahid Alekberli, Hikmat KarimovFisher InformationQuantization

  2. Quantization in Federated Learning: Methods, Challenges and Future Directions

    Jun 25, 2026Farwa Ikram, Dipanwita Thakur, Antonella Guzzo +1Federated LearningQuantization

  3. CAT-Q: Cost-efficient and Accurate Ternary Quantization for LLMs

    Jun 25, 2026Shigeng Wang, Chao Li, Yangyuxuan Kang +2Large Language Model QuantizationQuantization

  4. Hierarchical Reinforcement Learning for Neural Network Compression (HiReLC): Pruning and Quantization

    Jun 24, 2026Kamar Hibatallah Baghdadi, Kawther Guoual Belhamidi, Sara Belhadj +2Context CompressionHierarchical Reinforcement Learning

  5. Quantization Inflates Reasoning: Token Inflation as a Hidden Cost of Low-Bit Reasoning Models

    Jun 24, 2026Xinyu Lian, Walid Krichene, Beichen Huang +4Large Language Model QuantizationQuantization

  6. Neural Network Quantization by Learning Low-Loss Subspaces

    Jun 23, 2026Vladimir Protsenko, Mikhalina Kharkevich, Alexander Vashchilko +1QuantizationQuantum Neural Networks

  7. GRINQH: Graded Input-based Quantization Hierarchy for Efficient LLM Generation

    Jun 22, 2026Jette Oberländer, Jan Finkbeiner, Catherine M. Schöfmann +1Large Language Model QuantizationExtreme Low-Bit Quantization

  8. HyperQuant: A Rate-Distortion-Optimal Quantization Pipeline for Large Language and Diffusion Models

    Jun 22, 2026Yuval Domb, Hadar Sackstein, Tomer SolbergWeight-Only QuantizationQuantization

  9. Efficient Network Inference via Hardware-Aware Architecture Search, Model Pruning & Quantization

    Jun 22, 2026Lucas Heublein, Mark Deutel, Axel Plinge +1Graph Neural Network InferenceReal-Time Inference

  10. Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks

    Jun 22, 2026Minh-Loi Nguyen, Long-Bao Nguyen, Van-Hieu Huynh +2Graph Neural Network InferenceMixed-Precision Quantization

  11. On the Expressive Power of Weight Quantization in Large Language Models

    Jun 20, 2026Shao-Qun ZhangLarge Language Model QuantizationQuantization

  12. Fast-TurboQuant: A Multiplier-Free Online Vector Quantization Approach

    Jun 19, 2026Pedro M. R. Pereira, Felipe A. P. de Figueiredo, Rausley A. A. de SouzaCalibration-Free Low-Bit Vector QuantizationQuantization

  13. Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models

    Jun 17, 2026Navin Ranjan, Andreas SavakisMixed-Precision QuantizationWeight-Only Quantization

  14. Shift-and-Sum Quantization for Visual Autoregressive Models

    Jun 15, 2026Jaehyeon Moon, Bumsub HamVisual Autoregressive ModelsQuantizer

  15. Quantizing Time-Series Models As Dynamical Systems: Trajectory-Based Quantization Sensitivity Score

    Jun 11, 2026Mariya Pavlova, Harrison Bo Hua Zhu, Lidia Vitanova +2QuantizationQuantile Regression

  16. Graph Reinforcement Learning for Calibration-Aware Quantum Circuit Routing

    Jun 11, 2026Yash Vardhan Tomar, Dheeraj PeddireddyQuantum Circuit SimulationQuantization

  17. DynamicPTQ: Mitigating Activation Quantization Collapse via Residual-Stream Dynamics

    Jun 10, 2026Zimo Zhao, Maolin Wang, Bowen Yu +3Weight-Only QuantizationExtreme Low-Bit Quantization

  18. What Limits Does Quantization Place on Dense Top-kk Retrieval? A Theoretical Study

    Jun 10, 2026Koki Okajima, Tsukasa YoshidaVector DatabaseTop-K

  19. NSVQ: Mitigating Codebook Collapse by Stabilizing Encoder Drift in Vector Quantization

    Jun 9, 2026Hao Lu, Yongxin Guo, Onur Koyun +3Calibration-Free Low-Bit Vector QuantizationCodebooks

  20. Optimal Post-Training Quantization Scales and Where to Find Them

    Jun 9, 2026Juan Amboage, Pablo Monteagudo-Lago, Ian Colbert +2Weight-Only QuantizationQuantizer

  21. UniSVQ: 2-bit Unified Scalar-Vector Quantization

    Jun 9, 2026Haoyu Wang, Haiyan Zhao, Xingyu Yu +4QuantizationLow-Bit

  22. Quality Is Not a Safety Proxy Under Quantization

    Jun 8, 2026Sahil KadadekarQuantizationSafety Evaluation

  23. Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization

    Jun 7, 2026Patrik Czakó, Gábor Kertész, Sándor SzénásiLarge Language Model QuantizationQuantization

  24. Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

    Jun 5, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Mixed-Precision QuantizationWeight-Only Quantization

  25. Value-and-Structure Alignment for Routing-Consistent Quantization of Mixture-of-Experts Models

    Jun 4, 2026Hancheol Park, Geonho Lee, Tairen Piao +1QuantizerQuantization

  26. Minimizing the Hidden Cost of Scales: Graph-Guided Ultra-Low-Bit Quantization for Large Language Models

    Jun 3, 2026Rayyan Abdalla, Amir Hussein, Min Wu +1Large Language Model QuantizationQuantization

  27. MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models

    Jun 3, 2026Yue Wu, Changyuan Wang, Zixuan Wang +2Weight-Only QuantizationQuantization

  28. LLM Compression with Jointly Optimizing Architectural and Quantization choices

    Jun 2, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Large Language Model CompressionLLM Inference Efficiency

  29. Perplexity Can Miss SAE Feature Damage Under Quantization

    Jun 2, 2026Evan DuanQuantizationQuantizer

  30. Qift: Shift-Friendly No-Zero W2 Post-Training Quantization for Rotated W2A4/KV4 LLM Inference

    Jun 1, 2026Chi-Wei Huang, Chia-Chi TsaiWeight-Only QuantizationQuantization

  31. GPTQ-intrinsic LoRA: A Near-optimal Algorithm for Low-precision Quantization with Low-rank Adaptation

    May 31, 2026Shihao Zhang, Rayan SaabWeight-Only QuantizationQuantization

  32. When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression

    May 31, 2026Riku Kisako, Hayato Tsukagoshi, Ryohei SasanoLarge Language Model CompressionDomain-Invariant Text Embeddings

  33. ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

    May 30, 2026Li Lin, Xiaojun WanFp8Quantization

  34. Inner Product Aware Quantization: Provably Fast, Accurate, and Adaptive Algorithms

    May 29, 2026Nathan White, Krish SingalQuantization

  35. Quantized Reasoning Models Think They Need to Think Longer, but They Do Not

    May 29, 2026Sanae Lotfi, Polina Kirichenko, Steven Li +1Large Reasoning ModelsLarge Language Model Quantization

  36. Enhancing Human-Likeness in Reinforcement Learning Agents via Hierarchical Macro Action Quantization

    May 29, 2026M. Shaheer Luqman, Usman Nizamani, Fawad Javed Fateh +4Hierarchical Reinforcement LearningDeep Reinforcement Learning

  37. HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization

    May 28, 2026Artur Zagitov, Gleb Molodtsov, Aleksandr BeznosikovWeight-Only QuantizationLarge Language Model Quantization

  38. Apertus LLM Family Expansion via Distillation and Quantization

    May 27, 2026Andrei Panferov, Davit Melikidze, Martin Jaggi +1Large Language Model QuantizationLarge Language

  39. Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression

    May 26, 2026Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3Key-Value Cache QuantizationQuantization

  40. WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization

    May 26, 2026Phong Nam Huu Nguyen, Khoi M. Le, Cong-Duy T Nguyen +3Large Language Model QuantizationQuantization

  41. Tail-Aware HiFloat4: W4A4 Post-Training Quantization for Wan2.2

    May 26, 2026Zhanfeng Feng, Shuai Guo, Xin Di +3Weight-Only QuantizationFp8

  42. GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization

    May 25, 2026Maoyang Xiang, Tao Luo, Bo WangQuantizationFlexible Register Transfer Level Design Automation

  43. Channel-wise Vector Quantization

    May 25, 2026Wei Song, Tianhang Wang, Yitong Chen +5Autoregressive Image GenerationVisual Tokens

  44. The Quantization Benefits of Residual-Free Transformers

    May 25, 2026Yiping Ji, Mahalakshmi Sabanayagam, Peyman Moghadam +2Transformer Residual StreamsWeight-Only Quantization

  45. InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

    May 25, 2026Ke Li, Dong An, Xiaoling Zang +6Large Language Model QuantizationQuantization

  46. Fermi-Dirac machines as quantizations of neurons

    May 23, 2026Alexander He, Nana Liu, Mark M. WildeQuantum ComputingHamiltonian

  47. EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture

    May 22, 2026Bowen Duan, Cong Guo, Chiyue Wei +8Calibration-Free Low-Bit Vector QuantizationExtreme Low-Bit Quantization

  48. BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization

    May 22, 2026Jiayu Zhao, Zihan Teng, Minhao Fan +4Large Language Model QuantizationMixture-Of-Expert Language Models

  49. GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs

    May 21, 2026Jianing Deng, Song Wang, Dongwei Wang +4Mixed-Precision QuantizationMixture-Of-Expert Language Models

  50. MGVQ: Synergizing Multi-dimensional Sensitivity-Aware and Gradient-Hessian Fusion for Vector Quantization

    May 20, 2026Zhong Wang, Zukang Xu, Xing Hu +1Large Language Model QuantizationQuantization

  51. ActQuant: Sub-4-bit Action-Guided Quantization for Vision-Language-Action Models

    May 19, 2026Arash Akbari, Arman Akbari, Masih Eskandar +11Weight-Only QuantizationVision-Language-Action Models

  52. Breaking Modality Heterogeneity in Low-Bit Quantization for Large Vision-Language Models

    May 19, 2026Yi Zhong, Haotong Qin, Xindong Zhang +2QuantizationCross-Modal Learning

  53. OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond

    May 19, 2026Zunhai Su, Rui Yang, Chao Zhang +11Key-Value Cache QuantizationKey-Value Cache Compression

  54. TORQ: Two-Level Orthogonal Rotation for MXFP4 Quantization

    May 19, 2026Zukang Xu, Xing Hu, Dawei YangW4A4 QuantizationQuantization

  55. OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization

    May 18, 2026Zhongzhu Zhou, Donglin Zhuang, Jisen Li +4Key-Value Cache QuantizationQuantization

  56. TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

    May 16, 2026Hanzhang Shen, Haoran Wu, Yiren Zhao +1Key-Value Cache QuantizationLLM Inference Efficiency

  57. When Bits Break Recourse: Counterfactual-Faithful Quantization

    May 16, 2026Chaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui +1QuantizationDistributional Fidelity

  58. CAR-SAM: Cross-Attention Reconstruction for Post-Training Quantization of the Segment Anything Model

    May 16, 2026Houji Wen, Jiangyong Yu, Jun Li +1Weight-Only QuantizationQuantization

  59. E-PMQ: Expert-Guided Post-Merge Quantization with Merged-Weight Anchoring

    May 16, 2026Wenjun Wang, Yanggan Gu, Shuo Cai +4Weight-Only QuantizationQuantization

  60. Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformer

    May 15, 2026Yipu Zhang, Jintao Cheng, Weilun Feng +5Feed-Forward 3D ReconstructionQuantization