Lookup Table
Lookup tables (LUTs) are data structures mapping inputs to pre-computed outputs, offering significant speed advantages over computationally intensive calculations. Current research focuses on applying LUTs to accelerate various machine learning tasks, particularly in image and video processing, natural language processing, and efficient deployment of large language models on resource-constrained devices. This involves developing novel LUT architectures, such as neural implicit LUTs and multi-LUT systems, and integrating them with other techniques like attention mechanisms and quantization to optimize accuracy and efficiency. The widespread adoption of LUTs promises to significantly improve the speed and energy efficiency of numerous applications, particularly in edge computing and real-time processing.
Papers
Genetic Quantization-Aware Approximation for Non-Linear Operations in Transformers
Pingcheng Dong, Yonghao Tan, Dong Zhang, Tianwei Ni, Xuejiao Liu, Yu Liu, Peng Luo, Luhong Liang, Shih-Yang Liu, Xijie Huang, Huaiyu Zhu, Yun Pan, Fengwei An, Kwang-Ting Cheng
Taming Lookup Tables for Efficient Image Retouching
Sidi Yang, Binxiao Huang, Mingdeng Cao, Yatai Ji, Hanzhong Guo, Ngai Wong, Yujiu Yang