cs.CVApr 29, 2026

MetaSR: Content-Adaptive Metadata Orchestration for Generative Super-Resolution

Authors: Jiaqi GuoMingzhen LiHaohong WangAggelos K. Katsaggelos

Organizations: Department of Electrical and Computer Engineering, Northwestern University, Evanston, Illinois, USA · TCL

Abstract

We study generative super-resolution (SR) in real-world scenarios where content and degradations vary across domains, genres, and segments. For example, images and videos may alternate between text overlays, fast motion, smooth cartoons, and low-light faces, each benefiting from different forms of side information. Existing metadata-guided SR methods typically use a fixed conditioning design, which is suboptimal when useful cues are content dependent and transmission budgets are limited. We propose MetaSR, a Diffusion Transformer (DiT)-based framework that selects and injects task-relevant metadata to guide SR under resource constraints. Specifically, we use the DiT's own VAE and transformer backbone to fuse heterogeneous metadata, and adopt an efficient distillation strategy that enables one-step diffusion inference. Experiments across diverse content buckets and degradation regimes show that MetaSR outperforms reference solutions by up to 1.0~dB PSNR while achieving up to 50% transmission bitrate saving at matched quality. We assess these gains under a rate--distortion optimization (RDO) framework that jointly accounts for sender-side bitrate and receiver/display quality metrics (e.g., PSNR and SSIM).

Explore similar work

CardsList
  1. GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution

    Apr 28, 2026Fabio D'Oronzio, Federico Putamorsi, Leonardo Zini +2Low-Rank Adaptation