Hardware-Aware Quantization

Ask about this topic

Latest papers

CardsList

22 papers5 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. TileQuant: Tile as the Precision-Allocation Unit for LLM Mixed-Precision Post-Training Quantization

    Nov 4, 2026Hanzhi Zhang, Qiao Zhang, Qinglei Cao +4LLM QuantizationPost-Training Quantization

    LLaVi Lab, Computer Science & Engineering, University of North Texas · Computer Science, Saint Louis University · Data Science, University of North Texas

  2. Realizing Low-Precision Storage and Sparse Execution in a Folded FPGA Speech Enhancer

    Oct 26, 2026Clément LarocheFPGA-Based Neural Network AccelerationHardware-Aware Quantization

    Audio Research, GN A/S, Ballerup, Denmark

  3. Adapting DNNs to Embrace Voltage Scaling Induced Errors via Accumulation-Aware Quantization

    Oct 24, 2026Alexis Maras, Panagiotis Chaidos, Georgios Alexandris +2Neural Network Hardware AccelerationHardware-Aware Quantization

    National Technical University of Athens, Athens, Greece

  4. FIGFLEX: A Mixed-Precision FP-INT GEMM Accelerator Co-Designed with Low-Bit LLM Quantization

    Oct 21, 2026Faraz Tahmasebi, Haocheng Xu, Andrew Trauger +4LLM Inference AccelerationLLM Quantization

    University of California, Irvine, Irvine, CA, USA

  5. TernScope: Model-Hardware Co-Design for Efficient Ternary Endoscopic Segmentation

    Oct 21, 2026Zhuoyu Wu, Wenhui Ou, Qiawei Zheng +3Medical Image SegmentationNeural Network Hardware Acceleration

    CyPhi AI Research Lab, School of Information Technology, Monash University Malaysia, Malaysia · Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong · School of Computer Science and Engineering, Southeast University, Nanjing, China +1

  6. ShiftQAT: Quantization-Aware Training for the Numerical Contract of a Fixed-Function Edge CNN Accelerator

    Oct 15, 2026Oguzhan Buyuksolak, Osman Erman Okman, Mehmet Gorkem UlkarHardware-Aware QuantizationNeural Network Quantization

    Analog Devices, Inc.

  7. A Rapid Pipeline for Training and Deploying ML Models on WeBe Band

    Sep 24, 2026Ehsan Kourkchi, Asmita Asmita, Houman Homayoun +1Tiny MLEdge ML

    Dep. of Electrical and Computer Engineering UC Davis, CA, USA. · dept. name of organization (of Aff.) Quandary Peak Research Los Angeles, CA, USA.

  8. Interface-Aware KV Cache Quantization for Dense On-Chip NVM in Long-Context LLM Decoding

    Sep 4, 2026Jiahao Zheng, Yifan Qin, Xiaobo Sharon Hu +1Hardware-Aware QuantizationKV-Cache Quantization

    University of Notre Dame, Notre Dame, IN, USA

  9. HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

    Aug 31, 2026Chun-Ting Chen, Dongmin Han, Hangyeol Mun +6LLM QuantizationLLM Inference Acceleration

    Cornell University New York, NY, USA · Intel Corporation Santa Clara, CA, USA · Intel Corporation Hillsboro, OR, USA

  10. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationEfficient Neural Network Inference

    Microelectronics Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China

  11. NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

    Aug 3, 2026Yizhe Chen, Wenshuai Yao, Saiya Wang +6Mixed-Precision QuantizationCompute-in-Memory

    School of Integrated Circuit Science and Engineering, Beihang University, Beijing, China · School of Integrated Circuits, Peking University, Beijing, China · Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China

  12. PolyQ: Codesigning End-to-End Quantization Framework for Scalable Edge CPU LLM Inference

    Jul 16, 2026Hyunwoo Oh, Suyeon Jang, Hanning Chen +4Mixed-Precision QuantizationLLM Quantization

    University of California, Irvine

  13. Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment

    Jul 9, 2026Hyeju Shin, Chorwon Kim, Ryangsoo Kim +2Mixed-Precision QuantizationVision-Language Models

    1ETRI, Republic of Korea.

  14. HiFA4: Training-Free 4-bit FlashAttention on Ascend HIF4 NPUs for LLM Inference

    Jul 5, 2026Hui Dong, Yanzhao Li, Jie Gao +5Neural Network QuantizationLLM Quantization

    Huawei Technologies

  15. APEX4: Efficient Pure W4A4 LLM Inference via Intra-SM Compute Rebalancing

    Jun 7, 2026Hong Guo, Nianhui Guo, Weixing Wang +3LLM QuantizationGPU Kernel Optimization

    Hasso Plattner Institute · German University of Digital Science

  16. A Hardware-Aware, Per-Layer Methodology for Post-Training Quantization of Large Language Models

    May 14, 2026Earl KillianMixed-Precision QuantizationLLM Quantization

  17. OneComp: One-Line Revolution for Generative AI Model Compression

    Mar 30, 2026Yuma Ichikawa, Keiji Kimura, Akihiro Yoshida +11Hardware-Aware QuantizationModel Compression

    Fujitsu Limited · RIKEN Center for AIP · Institute of Science Tokyo +2

  18. PQuantML: A Tool for End-to-End Hardware-aware Model Compression

    Mar 27, 2026Roope Niemi, Anastasiia Petrovych, Arghya Ranjan Das +9Model CompressionNeural Network Compression

    European Center for Nuclear Research (CERN), CH-1211 Geneva, Switzerland · Purdue University, West Lafayette, IN 47907, USA · California Institute of Technology, Pasadena, CA 91125, United States +4

  19. APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs

    Mar 24, 2026Meriem Bouzouad, Yuan-Hao Chang, Jalil BoukhobzaHardware-Aware QuantizationLLM Quantization

    Lab-STICC, CNRS UMR 6285 , ENSTA, Institut Polytechnique de Paris, Brest, France · National Taiwan University, Taipei, Taiwan

  20. InnerQ: Hardware-Aware Tuning-Free Quantization of KV Cache for Large Language Models

    Feb 26, 2026Sayed Mohammadreza Tayaranian Hosseini, Amir Ardakani, Warren J. GrossHardware-Aware QuantizationKV-Cache Quantization

    Department of Electrical and Computer Engineering McGill University Montreal, QC, Canada

  21. SigmaQuant: Hardware-Aware Heterogeneous Quantization Method for Edge DNN Inference

    Feb 25, 2026Qunyou Liu, Pengbo Yu, Marina Zapater +1Hardware-Aware QuantizationNeural Network Quantization

    Embedded Systems Laboratory (ESL), EPFL, Switzerland · University of Applied Sciences and Arts Western Switzerland (HES-SO), Switzerland

  22. Enabling Low-Latency Machine learning on Radiation-Hard FPGAs with hls4ml

    Feb 17, 2026Katya Govorkova, Julian Garcia Pardinas, Vladimir Loncar +5Hardware-Aware QuantizationFPGA-Based Neural Network Acceleration

    Massachusetts Institute of Technology (MIT), 77 Massachusetts Ave, Cambridge, MA 02139, USA · Department of Experimental Physics, European Organization for Nuclear Research (CERN), 1211 Geneva 23, Switzerland · University of Milano-Bicocca (Italy), and Department of Experimental Physics, European Organization for Nuclear Research (CERN), 1211 Geneva 23, Switzerland