Low-Bit Quantization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Low-Bit Quantization.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Low-Bit Quantization.

Inside this field

Focused directions

406 papers

Latest in Low-Bit Quantization

Open your feed →
CardsList

  1. OptiPrime: Optimizing Private Inference through Protocol-Hardware Co-design

    Sep 15, 2026Jiangrui Yu, Ye Yu, Si Chen +5Mixed-Precision Quantization

  2. Channel-Wise and Token-Aware Post-Training Quantization for Visual State Space Duality

    Sep 15, 2026Jonghyeon Lim, Changhoon YimPost-Training QuantizationSelf-Supervised Vision Transformers

  3. Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents

    Sep 14, 2026Pengyang Zhou, Xiaobin Tu, Zhengxi Liu +7Large Language Model Quantization

  4. OmniKVQuant: KV Cache Quantization for Omni-LLMs

    Sep 11, 2026Suho Yoo, Hyunjong Ok, Jongmin Choi +2Key-Value Cache QuantizationLarge Language Model Quantization

  5. Structured Transforms for Low-Overhead Quantization of Language Models

    Sep 11, 2026Daria Cherniuk, Alexander Rudikov, Boris Kashin +1Large Language Model QuantizationLow-Bit Quantization

  6. Why Does Post-Training Quantization Work?

    Sep 10, 2026Yuxiang Chen, Michael Beyer, Jun Zhu +1Post-Training QuantizationQuantization Effects

  7. Storage-Scalable Progressive Semantic Communication via Knowledge-Base Reuse

    Sep 9, 2026Heng Zhu, Ye Liu, Kun Zhu +1Residual QuantizationSemantic Communications

  8. When Does Low-Bit Quantization Preserve the Decisions of Vector Search?

    Sep 9, 2026Wenxuan Xiao, Xu CaoLow-Bit QuantizationVector Database

  9. EFQ-Softmax: Exp-Free Quantization for Softmax

    Sep 9, 2026Haohui Han, Yuming Wan, Hongni Wang +4Gumbel-Softmax RelaxationQuantization

  10. It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention

    Sep 8, 2026Raito Kiya, Satoki Ohashi, Kosuke Sato +6Large Language Model QuantizationLow-Bit Quantization

  11. A Note on Scaling in Randomly Rotated Quantization and Its Connection to the CDEF +1 Pythagorean Relation

    Sep 8, 2026Uri ErezQuantization EffectsQuantization

  12. Exploring Bottom-Up Clustering for Creating Semantic IDs

    Sep 8, 2026Leah Woldemariam, Sudhanshu Garg, Taha Belkhouja +2Recommendation ArchitectureBottom-Up Framework

  13. KBBQ: A Predictive Noise Law and the Limits of Spectrum Flattening in FP4 Quantization

    Sep 8, 2026Lexington Whalen, Yuki Ito, Ryo SakamotoLow-Bit QuantizationMatrix Multiplication

  14. Quantization Amplifies Determinism, Not Bias: Scale-Dependent Behavioral Effects of Serving-Time Weight Compression

    Sep 7, 2026Dachi KurtskhaliaLarge Language Model QuantizationQuantization Effects

  15. Matryoshka Hash Representations for Model-Aware Compact Semantic Retrieval

    Sep 7, 2026Peichun Hua, Yunming XiaoRetrieval LayerMatryoshka Representation Learning

  16. When Quantization Breaks Memory: Recurrent-State Write-Back in Low-Precision Temporal Inference

    Sep 7, 2026Ismail Erbas, Xavier Intes, Vikas PandeyRecurrent StateQuantization Effects

  17. Hardware-Aware FP4 FlashAttention-4

    Sep 3, 2026Robert HuFp8Tensor Programs

  18. Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

    Sep 3, 2026Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7Neural Audio CodecsTokenizer

  19. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  20. From Ordered Bernoulli Levels to Critical-Line Geometry: Integer Quantization, Bernoulli Residual Phase, and Prime-Power Spectra

    Sep 3, 2026Y. Kenan YılmazLow-Bit QuantizationGeometric Reasoning

  21. PACodec: A Low-bitrate Neural Speech Codec with Parallel Additive Vector Quantization

    Sep 3, 2026Fei Liu, Yang Ai, Xiao-Hang Jiang +1Neural Audio CodecsCalibration-Free Low-Bit Vector Quantization

  22. SCULPT: Training Edge Vision Models for Post-Training Quantization Readiness

    Sep 1, 2026Bharadwaj Kavuri, Sourav Babu-PK, Varadhraj Ellapan +2Post-Training QuantizationQuantization

  23. The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally

    Sep 1, 2026Jundong Hu, Shekar RamachandranQuantizationBudgets

  24. BiMTokenizer: Preserving Semantic-Acoustic Balance in Low-Bitrate Speech Tokenization via Bidirectional State-Space Modeling

    Sep 1, 2026Xin Zhang, Lin Li, Chuanbo Liu +2Neural Audio CodecsResidual Quantization

  25. HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

    Aug 31, 2026Chun-Ting Chen, Dongmin Han, Hangyeol Mun +6Large Language Model QuantizationLow-Bit Quantization

  26. QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization

    Aug 31, 2026Yipin Guo, Arun M George, Jie Fu +3Post-Training QuantizationLow-Bit Quantization

  27. Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

    Aug 31, 2026Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2Key-Value Cache QuantizationQuantization

  28. Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs

    Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision QuantizationMixture-Of-Expert Language Models

  29. TopGQ: Fast GNN Post-Training Quantization Leveraging Topology Information

    Aug 31, 2026Dain Kwon, Kanghyun Choi, Hyeyoon Lee +4Post-Training QuantizationQuantization

  30. PRQ-KMeans: Projection Residual Quantization for Semantic ID Tokenization

    Aug 25, 2026Yunxiao Luo, Siyuan Wang, Ben Chen +2Residual QuantizationTokenizer

  31. FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

    Aug 24, 2026Gongwei Lee, Ji Liu, Juncheng Jia +1Mixed-Precision QuantizationLLM Inference Efficiency

  32. Beyond Dense Adam States: Adaptive Log-Space Quantization for Memory-Efficient Optimizers

    Aug 23, 2026Yan WangLow-Bit QuantizationAdam

  33. In-Cell Learning: Language Models That Update Their Own Weights in Sequence Without Changing the File They Ship

    Aug 21, 2026Zifeng Liu, Yaxin Lu, Xuanhan Wu +6Model WeightsLow-Bit Quantization

  34. When Local Variance Optimality Is Not Enough: RoPE-Aligned Q/K Rotations for Dynamic 4-Bit Quantisation

    Aug 13, 2026Shuhan Wang, Yilin Luo, Nan Xu +1Post-Training QuantizationRotation

  35. NAS-Driven Hardware Accelerator Exploration for Edge AI and Quantization Effects on the Pareto Space

    Aug 13, 2026Eleftherios Mylonas, Angelos Kouprizas, Michael Birbas +1Neural Architecture SearchAccelerator

  36. Calibration Bets on the Past: Post-Training Quantization for Financial Time-Series Forecasting

    Aug 12, 2026Junyi Ye, Ivy Gateri WanjikuPost-Training QuantizationQuantization

  37. HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression

    Aug 12, 2026Yuefeng ZhangImage CompressionQuantization

  38. FQTree: Fine-grained Quantization and Hardware Generation of Boosted Decision Trees

    Aug 12, 2026Zhiqiang Que, Chang Sun, Haiyang Wang +6Low-Bit QuantizationField-Programmable Gate Arrays

  39. SoftWater: Class-Aware Rate Allocation for Softmax Quantization

    Aug 12, 2026Joao V. Cavalcanti, Ashia C. WilsonLow-Bit QuantizationGumbel-Softmax Relaxation

  40. Benchmarking Trustworthiness of SLMs: Pre-trained vs. Compressed

    Aug 12, 2026Haokun Lin, Kaijie Zhu, Haobo Xu +4Small Large Language ModelsLarge Language Model Reliability

  41. Language-Conditional Dequantization: Recovering What Quantization Steals from Non-English Languages

    Aug 12, 2026Nirmal ThomasLarge Language Model QuantizationQuantization Effects

  42. ReRound: Reconstructive Rounding to Resolve Midpoint Ambiguity in Calibration-Free LLM Quantization

    Aug 11, 2026He-Yen Hsieh, H. T. KungPost-Training QuantizationMedium

  43. Gromov-Wasserstein Quantization and Clustering: Structure, Rates, and Algorithms

    Aug 11, 2026Florian Beier, Stephan EcksteinGromov--WassersteinK$-Means

  44. SQuaT: Self-Supervised Knowledge Distillation via Student-Aware Quantized Teacher Features

    Aug 11, 2026HyeonJun Lee, Hyeonsik Jo, Jinwoo Chung +1Post-Training QuantizationHeterogeneous Knowledge Distillation

  45. From Sweep to Seam: Interleaved Cross-Block Post-Training Quantization

    Aug 10, 2026Achille Jacquemond, Yuma Ichikawa, Akira SakaiPost-Training QuantizationLow-Bit Quantization

  46. Tied Trit-Planes: Constraining PTQTP to a Uniform Nine-Level Quantizer, with a Persistent Folded Format for Disk-Streamed Mixture-of-Experts Serving

    Aug 9, 2026Matteo GrellaLarge Language Model QuantizationLow-Bit Quantization

  47. Quantization Degradation in Large Language Models: A Signal-Noise Perspective

    Aug 8, 2026Chenxi Zhou, Pengfei Cao, Jinyu Ye +5Quantization EffectsPost-Training Quantization

  48. RotaryQuant: Fitting 120B MoE Models on Consumer Hardware via Fused Compressed-Space Attention

    Aug 8, 2026Anthony. Lui, Mohamed. Elsaied, N. P. SavaniMixed-Precision QuantizationCold Mixture-Of-Expert Models

  49. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Key-Value CacheCache

  50. An Exploratory Evaluation of LLM-Assisted Rewriting of Moderate-Complexity Financial Sentences for DisCoCat-Based Sentiment Analysis

    Aug 7, 2026Brian Llinas, Nikos ChrisochoidesFinancial Sentiment AnalysisSentiment Analysis

  51. PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks

    Aug 7, 2026Hui Xie, Tong Shi, Haotong Qin +3Spiking Neural NetworksPost-Training Quantization

  52. ReQuant: Fixed-Grid Discrete Refinement for Post-Training Quantization

    Aug 7, 2026Yongge Ma, Guoan Wang, Feiyu Wang +5Post-Training QuantizationQuantization

  53. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationLightweight Convolutional Neural Network Hardware Accelerator

  54. CubicQuant: Parametric Non-Uniform Codebooks for High-Throughput LLM Inference with 1-8-Bit Weights

    Aug 7, 2026Xuetian GaoLarge Language Model QuantizationCodebooks

  55. Which Decisions Low-Bit Quantization Breaks, and How to Predict Them

    Aug 6, 2026Zekun Wu, Swati Dhiman, Adriano KoshiyamaQuantization EffectsQuantization

  56. BaKron: Efficient Quantization with Kronecker-Factored Hessians

    Aug 6, 2026Johann Birnick, Rayan SaabMixed-Precision QuantizationLow-Bit Quantization

  57. APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

    Aug 6, 2026Sadegh Jafari, Mohiuddin Bilwal, Fan Zhou +2Mixed-Precision QuantizationStructured Pruning

  58. Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning

    Aug 5, 2026Yue Han, Dianlin WangLarge Language Model QuantizationParameter-Efficient Fine-Tuning Methods

  59. One Qubit Can Beat One Bit: Quantum Advantage for Post-Training Quantization

    Aug 5, 2026Yuma Ichikawa, Moeto MishimaQuantizationQuantum

  60. Separating quantum circuits from classical LLMs

    Aug 4, 2026Srinivasan Arunachalam, Arkopal Dutt, Hari Krovi +1Quantum CircuitsLarge Language Model Quantization