cs.CVJul 23, 2025

DiNAT-IR: Exploring Dilated Neighborhood Attention for High-Quality Image Restoration

Authors: Hanzhou Liu, Binghan Li, Chengkai Liu, Mi Lu

Organizations: Texas A&M University

Abstract

Transformers, with their self-attention mechanisms for modeling long-range dependencies, have become a dominant paradigm in image restoration tasks. However, the high computational cost of self-attention limits scalability to high-resolution images, making efficiency-quality trade-offs a key research focus. To address this, Restormer employs channel-wise self-attention, which computes attention across channels instead of spatial dimensions. While effective, this approach may overlook localized artifacts that are crucial for high-quality image restoration. To bridge this gap, we explore Dilated Neighborhood Attention (DiNA) as a promising alternative, inspired by its success in high-level vision tasks. DiNA balances global context and local precision by integrating sliding-window attention with mixed dilation factors, effectively expanding the receptive field without excessive overhead. However, our preliminary experiments indicate that directly applying this global-local design to the classic deblurring task hinders accurate visual restoration, primarily due to the constrained global context understanding within local attention. To address this, we introduce a channel-aware module that complements local attention, effectively integrating global context without sacrificing pixel-level precision. The proposed DiNAT-IR, a Transformer-based architecture specifically designed for image restoration, achieves competitive results across multiple benchmarks, offering a high-quality solution for diverse low-level computer vision problems.

Figures & tables

Explore similar work

CardsList
  1. Fast and Accurate Image Restoration and Generation with Rank Enhanced Linear Attention

    May 22, 2025Yuang AiEfficient ViTsLinear Attention

  2. ATD: Improved Transformer with Adaptive Token Dictionary for Image Restoration

    Mar 3, 2026Leheng Zhang, Wei Long, Yawei Li +3Image RestorationEfficient ViTs