Paper ID: 2202.05137

Quantization in Layer's Input is Matter

Daning Cheng, WenGuang Chen

In this paper, we will show that the quantization in layer's input is more important than parameters' quantization for loss function. And the algorithm which is based on the layer's input quantization error is better than hessian-based mixed precision layout algorithm.

Submitted: Feb 10, 2022