Hardware-Aware Quantization

Ask about this topic

Latest papers

CardsList

17 papers2 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

  1. ShiftQAT: Quantization-Aware Training for the Numerical Contract of a Fixed-Function Edge CNN Accelerator

    Oct 15, 2026Oguzhan Buyuksolak, Osman Erman Okman, Mehmet Gorkem UlkarHardware-Aware QuantizationNeural Network Quantization

    Analog Devices, Inc.

  2. A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

    Sep 24, 2026Ehsan Kourkchi, Asmita Asmita, Houman Homayoun +1Tiny MLEdge ML

    Dep. of Electrical and Computer Engineering UC Davis, CA, USA. · dept. name of organization (of Aff.) Quandary Peak Research Los Angeles, CA, USA.

  3. Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding

    Sep 4, 2026Jiahao Zheng, Yifan Qin, Xiaobo Sharon Hu +1Hardware-Aware QuantizationKV-Cache Quantization

    University of Notre Dame, Notre Dame, IN, USA

  4. HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

    Aug 31, 2026Chun-Ting Chen, Dongmin Han, Hangyeol Mun +6LLM QuantizationLLM Inference Acceleration

    Cornell University New York, NY, USA · Intel Corporation Santa Clara, CA, USA · Intel Corporation Hillsboro, OR, USA

  5. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationEfficient Neural Network Inference

    Microelectronics Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China

  6. NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

    Aug 3, 2026Yizhe Chen, Wenshuai Yao, Saiya Wang +6Mixed-Precision QuantizationCompute-in-Memory

    School of Integrated Circuit Science and Engineering, Beihang University, Beijing, China · School of Integrated Circuits, Peking University, Beijing, China · Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China

  7. PolyQ: Codesigning End-to-End Quantization Framework for Scalable Edge CPU LLM Inference

    Jul 16, 2026Hyunwoo Oh, Suyeon Jang, Hanning Chen +4Mixed-Precision QuantizationLLM Quantization

    University of California, Irvine

  8. Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment

    Jul 9, 2026Hyeju Shin, Chorwon Kim, Ryangsoo Kim +2Mixed-Precision QuantizationVision-Language Models

    1ETRI, Republic of Korea.

  9. HiFA4: Training-Free 4-bit FlashAttention on Ascend HIF4 NPUs for LLM Inference

    Jul 5, 2026Hui Dong, Yanzhao Li, Jie Gao +5Neural Network QuantizationLLM Quantization

    Huawei Technologies

  10. APEX4: Efficient Pure W4A4 LLM Inference via Intra-SM Compute Rebalancing

    Jun 7, 2026Hong Guo, Nianhui Guo, Weixing Wang +3LLM QuantizationGPU Kernel Optimization

    Hasso Plattner Institute · German University of Digital Science

  11. A Hardware-Aware, Per-Layer Methodology for Post-Training Quantization of Large Language Models

    May 14, 2026Earl KillianMixed-Precision QuantizationLLM Quantization

  12. OneComp: One-Line Revolution for Generative AI Model Compression

    Mar 30, 2026Yuma Ichikawa, Keiji Kimura, Akihiro Yoshida +11Hardware-Aware QuantizationModel Compression

    Fujitsu Limited · RIKEN Center for AIP · Institute of Science Tokyo +2

  13. PQuantML: A Tool for End-to-End Hardware-aware Model Compression

    Mar 27, 2026Roope Niemi, Anastasiia Petrovych, Arghya Ranjan Das +9Model CompressionNeural Network Compression

    European Center for Nuclear Research (CERN), CH-1211 Geneva, Switzerland · Purdue University, West Lafayette, IN 47907, USA · California Institute of Technology, Pasadena, CA 91125, United States +4

  14. APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs

    Mar 24, 2026Meriem Bouzouad, Yuan-Hao Chang, Jalil BoukhobzaHardware-Aware QuantizationLLM Quantization

    Lab-STICC, CNRS UMR 6285 , ENSTA, Institut Polytechnique de Paris, Brest, France · National Taiwan University, Taipei, Taiwan

  15. InnerQ: Hardware-Aware Tuning-Free Quantization of KV Cache for Large Language Models

    Feb 26, 2026Sayed Mohammadreza Tayaranian Hosseini, Amir Ardakani, Warren J. GrossHardware-Aware QuantizationKV-Cache Quantization

    Department of Electrical and Computer Engineering McGill University Montreal, QC, Canada

  16. SigmaQuant: Hardware-Aware Heterogeneous Quantization Method for Edge DNN Inference

    Feb 25, 2026Qunyou Liu, Pengbo Yu, Marina Zapater +1Hardware-Aware QuantizationNeural Network Quantization

    Embedded Systems Laboratory (ESL), EPFL, Switzerland · University of Applied Sciences and Arts Western Switzerland (HES-SO), Switzerland

  17. Enabling Low-Latency Machine learning on Radiation-Hard FPGAs with hls4ml

    Feb 17, 2026Katya Govorkova, Julian Garcia Pardinas, Vladimir Loncar +5Hardware-Aware QuantizationFPGA-Based Neural Network Acceleration

    Massachusetts Institute of Technology (MIT), 77 Massachusetts Ave, Cambridge, MA 02139, USA · Department of Experimental Physics, European Organization for Nuclear Research (CERN), 1211 Geneva 23, Switzerland · University of Milano-Bicocca (Italy), and Department of Experimental Physics, European Organization for Nuclear Research (CERN), 1211 Geneva 23, Switzerland