Delta Compression

Delta compression focuses on efficiently storing and transmitting only the differences between data versions or similar data blocks, thereby reducing storage needs and bandwidth consumption. Current research emphasizes improving compression ratios and speed through machine learning techniques, such as learning-based compression algorithms that exploit serial correlations within data and dynamic quantization schemes that adapt to varying data sensitivity. These advancements are significantly impacting data storage and processing in diverse applications, including large language model serving, database management, and deep learning checkpointing, leading to substantial performance gains and cost reductions.

Papers