cs.CVJul 15, 2026

Deep Learning-based Filtering for Video Coding: A Survey on Architectures, Algorithms, and Complexity Analysis

Authors: Young-Woon Lee, Byung-Gyu Kim

Organizations: Department of Computer and Electronics Convergence Engineering, Sunmoon University, Asan 31460, South Korea · Division of Artificial Intelligence Engineering/ICT Convergence Research Institute, Sookmyung Women’s University, Seoul 04310, South Korea

Abstract

As Ultra-High-Definition (UHD) displays and immersive media services become ubiquitous in the Internet of Things (IoT) and Consumer Electronics (CE) sectors, including 8K display and mobile devices, the demand for high-efficiency video coding is unprecedented. While Deep Learning-based Filtering (DLF) has emerged as a promising solution to mitigate compression artifacts inherent in standards like High Efficiency Video Coding (HEVC/H.265) and Versatile Video Coding (VVC/H.266), its deployment in CE devices is severely constrained by computational complexity, memory bandwidth, and power consumption. To bridge the gap between academic research and practical deployment, this paper presents a comprehensive, hardware-oriented survey of DLF techniques. We propose a systematic three-dimensional taxonomy classifying methods into (1) Integration Scheme within the Video Coding, (2) Coding Information Utilization, and (3) Network Design Strategy. Unlike prior reviews, this work critically analyzes the trade-offs between Rate-Distortion (RD) performance and hardware feasibility, highlighting the evolution from heavy, performance-oriented models to lightweight, hardware-friendly architectures targeting Neural Processing Units (NPUs). Furthermore, we incorporate the latest standardization activities from the Joint Video Experts Team (JVET) on Neural Network-based Video Coding (NNVC) to provide realistic guidelines. We also identify open challenges such as real-time inference latency and error propagation, providing a roadmap toward robust, low-power intelligent video coding in next-generation CE vision endpoints.

Figures & tables

Explore similar work

CardsList
  1. Ultra-Fast Neural Video Compression

    Jun 3, 2026Jiahao Li, Wenxuan Xie, Zhaoyang Jia +4Neural Video CompressionVideo Compression

  2. MLVC: Multi-platform Learned Video Codec for Real-World Deployment

    Jun 26, 2026Tanel Pärnamaa, Martin Lumiste, Ardi Loot +3Neural Video CompressionVideo Compression

  3. FDIM: A Feature-distance-based Generic Video Quality Metric for Versatile Codecs

    Apr 27, 2026Jiayi Wang, Lichun Zhang, Xiaoqi Zhuang +3Video Quality AssessmentVideo Compression