Quantization Level

Quantization level, the number of bits used to represent model weights and activations, is a crucial aspect of optimizing deep learning models for efficiency and deployment on resource-constrained devices. Current research focuses on developing quantization-aware training methods and post-training quantization techniques for various architectures, including large language models, diffusion models, and convolutional neural networks, often employing techniques like knowledge distillation and adaptive quantization strategies to minimize accuracy loss. These advancements are significant because they enable the deployment of powerful deep learning models on edge devices and reduce computational costs, impacting both scientific research and practical applications across diverse fields.

Papers

October 8, 2024

Integrated Encoding and Quantization to Enhance Quanvolutional Neural Networks
Daniele Lizzio Bosco, Beatrice Portelli, Giuseppe Serra
Quantum Machine Learning Quantization Operator Quantization Level

August 22, 2024

DeepHQ: Learned Hierarchical Quantizer for Progressive Deep Image Coding
Jooyoung Lee, Se Yoon Jeong, Munchurl Kim
Quantization Level Layer Wise Quantization Progressive Matrix Overall Compression

July 19, 2024

Mixture of Experts with Mixture of Precisions for Tuning Quality of Service
HamidReza Imani, Abdolah Amirany, Tarek El-Ghazawi
Language Model Mixture Component Expert Knowledge Mixture of Expert Multidimensional Local Precision Rate Service Provider Hyper Tune Quantization Level

July 17, 2024

Toward INT4 Fixed-Point Training via Exploring Quantization Error for Gradients
Dohyung Kim, Junghyup Lee, Jeimin Jeon, Jaehyeon Moon, Bumsub Ham
Quantization Error Quantization Level Network Quantization Quantization Performance

July 16, 2024

QVD: Post-training Quantization for Video Diffusion Models
Shilong Tian, Hong Chen, Chengtao Lv, Yu Liu, Jinyang Guo, Xianglong Liu, Shengxi Li, Hao Yang, Tao Xie
Quantization Operator Video Diffusion Model Video Frame Quantization Level Dynamic Quantization Image Diffusion

July 11, 2024

Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing
Cui Zhang, Wenjun Zhang, Qiong Wu, Pingyi Fan, Qiang Fan, Jiangzhou Wang, Khaled B. Letaief
Quantization Level Gradient Quantization Vehicle Edge Computing

June 25, 2024

CDQuant: Greedy Coordinate Descent for Accurate LLM Quantization
Pranav Ajit Nair, Arun Sai Suggala
Large Language Model Quantization Operator Post Training Quantization Large Pre Trained Model Post Training Quantization Level Greedy Coordinate INT4 Quantization

June 18, 2024

Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates
Cristian Meo, Ksenia Sycheva, Anirudh Goyal, Justin Dauwels
Pre Trained Model Parameter Efficient Fine Tuning Low Rank Matrix Quantization Level Differentiable Logic

May 3, 2024

Three Quantization Regimes for ReLU Networks
Weigutian Ou, Philipp Schenkel, Helmut Bölcskei
ReLU Network Lipschitz Operator Quantization Level Layer ReLU Network

April 15, 2024

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
Sreyes Venkatesh, Razvan Marinescu, Jason K. Eshraghian
Quantization Aware Training Weight Quantization Quantization Level Uniform Quantization Quad Attention Sharpness Aware Quantization

March 26, 2024

Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
Kartikeya Bhardwaj, Nilesh Prasad Pandey, Sweta Priyadarshi, Kyunggeun Lee, Jun Ma, Harris Teague
Large Language Model Knowledge Distillation Propagation Environment Quantization Level Weight Only Quantization Uniform Quantization Quantization Aware Knowledge Distillation

January 31, 2024

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, Michael W. Mahoney, Yakun Sophia Shao, Kurt Keutzer, Amir Gholami
Long Context LLM Quantization Level Cache Quantization Input Quantization

November 27, 2023

TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models
Yushi Huang, Ruihao Gong, Jing Liu, Tianlong Chen, Xianglong Liu
Diffusion Model Post Training Quantization Quantization Technique Quantization Level Dynamic Quantization

August 22, 2023

Towards Clip-Free Quantized Super-Resolution Networks: How to Tame Representative Images
Alperen Kalay, Bahri Batuhan Bilecen, Mustafa Ayazoglu
Super Resolution Post Training Quantization Super Resolution Network Quantization Level Representative Dataset Maximally Tense Image

August 1, 2023

AQUILA: Communication Efficient Federated Learning with Adaptive Quantization in Device Selection Strategy
Zihao Zhao, Yuzhu Mao, Zhenpeng Shi, Yang Liu, Tian Lan, Wenbo Ding, Xiao-Ping Zhang
Quantization Technique Quantization Level Adaptive Quantization Communication Efficient Federated Learning Device Selection

July 20, 2023

Communication-Efficient Split Learning via Adaptive Feature-Wise Compression
Yongjeong Oh, Jaeho Lee, Christopher G. Brinton, Yo-Seb Jeon
Quantization Level Feature Compression Adaptive Quantization Intermediate Feature Gradient Vector

May 29, 2023

LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
Zechun Liu, Barlas Oguz, Changsheng Zhao, Ernie Chang, Pierre Stock, Yashar Mehdad, Yangyang Shi, Raghuraman Krishnamoorthi, Vikas Chandra
Large Language Model Training Free Quantization Aware Training Quantization Level Free Distillation LLM RBMT

December 15, 2022

Huber-energy measure quantization
Gabriel Turinici
Gradient Norm Quantization Level Quantization Parameter Optimal Quantization

November 29, 2022

Quantization-aware Interval Bound Propagation for Training Certifiably Robust Quantized Neural Networks
Mathias Lechner, Đorđe Žikelić, Krishnendu Chatterjee, Thomas A. Henzinger, Daniela Rus
Neural Network Adversarial Attack Adversarial Robustness Quantized Neural Network Quantization Level Interval Bound Propagation

November 12, 2022

Exploiting the Partly Scratch-off Lottery Ticket for Quantization-Aware Training
Yunshan Zhong, Gongrui Nan, Yuxin Zhang, Fei Chao, Rongrong Ji
Quantization Aware Training Lottery Ticket Quantization Level Forward Pas