cs.CVNov 17, 2026

Fast Training-Free Low-Light Video Enhancement with a Frozen Image Diffusion Prior

Authors: Hon Ming Yam, Chun Pong Lau

Organizations: City University of Hong Kong

Abstract

Pretrained image diffusion models can enhance low-light video without low-light training data and without retraining for a new camera. ZVRD, the only published training-free method for low-light video, is too slow to use: our implementation needs over a minute per 256×256256 \times 256 frame. We present a causal, training-free pipeline that adds two temporal components to a frozen MR. Illuminate image prior. Temporal input fusion recursively averages motion-compensated low-light frames before diffusion inversion. Late-start offset propagation runs the full sampling trajectory only on key frames. Each non-key frame inverts the low-noise part of its own trajectory and adds an enhancement offset warped from the latest key frame. At ZVRD's own resolution the pipeline is 261×261\times faster than ZVRD and scores better on all five metrics we report. On 13 held-out SDSD clips at 1280×7201280 \times 720, it improves on framewise eight-step processing by 0.55 dB in PSNR and 0.034 in LPIPS and halves the warping error, in 10% less time. Measurements inside the model show why, and a linear-Gaussian model of inversion explains them. Fusion removes frame-to-frame noise before inversion amplifies it. A flow error perturbs the transported offset ten times less than it perturbs a transported state. The perceptual gain does not transfer to low resolution: at 346×260346 \times 260, LPIPS is worse by 0.028. At 0.65 frames per second, the pipeline is an offline method.

Figures & tables

Explore similar work

Oct 16, 2026

CRISP: Progressive Illumination Curriculum for Recurrent Low-Light Video Enhancement with Semantic Priors

Low-light video enhancement requires the recovery of brightness, color, and fine spatial structures while preserving temporal coherence in the presence of noise and motion. Existing methods often struggle to balance these objectives, particularly in severely degraded regions. This paper presents CRISP, a recurrent framework trained using a progressive illumination curriculum. Its two-frame recurrent architecture propagates information across successive frames to exploit temporal context beyond the immediate input pair. During training, supervision progressively transitions from intermediate targets interpolated between the low-light input and the reference to the full reference, gradually increasing the required brightness and color correction. This curriculum stabilizes recurrent training without introducing additional inference cost and yields the largest performance improvement among the components evaluated in the ablation study. To further support structural reconstruction, the framework optionally incorporates frozen DINOv3 semantic features through adaptive layer normalization (AdaLN)-style modulation, without fine-tuning the foundation model. Experiments on DID and BVI-RLV demonstrate that CRISP achieves the highest PSNR on DID and the highest SSIM on BVI-RLV among the evaluated methods, while maintaining computational efficiency.
Nov 18, 2025

InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior

Video inverse problems are fundamental to streaming, telepresence, and AR/VR, where high perceptual quality must coexist with tight latency constraints. Diffusion-based priors currently deliver state-of-the-art reconstructions, but existing approaches either adapt image diffusion models with ad hoc temporal regularizers - leading to temporal artifacts - or rely on native video diffusion models whose iterative posterior sampling is far too slow for real-time use. We introduce InstantViR, an amortized inference framework for ultra-fast video reconstruction powered by a pre-trained video diffusion prior. We distill a powerful bidirectional video diffusion model (teacher) into a causal autoregressive student that maps a degraded video directly to its restored version in a single forward pass, inheriting the teacher's strong temporal modeling while completely removing iterative test-time optimization. The distillation is prior-driven: it only requires the teacher diffusion model and known degradation operators, and does not rely on externally paired clean/noisy video data. To further boost throughput, we replace the video-diffusion backbone VAE with a high-efficiency LeanVAE via an innovative teacher-space regularized distillation scheme, enabling low-latency latent-space processing. Across streaming random inpainting, Gaussian deblurring and super-resolution, InstantViR matches or surpasses the reconstruction quality of diffusion-based baselines while running at over 35 FPS on NVIDIA A100 GPUs, achieving up to 100 times speedups over iterative video diffusion solvers. These results show that diffusion-based video reconstruction is compatible with real-time, interactive, editable, streaming scenarios, turning high-quality video restoration into a practical component of modern vision systems.
Jun 8, 2026

LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution

Adapting large-scale pre-trained video generators for Video Super-Resolution (VSR) in novel domains remains computationally prohibitive. Methods that reformulate generation as direct Low-Quality to High-Quality mappings deviate from the original generative formulation, demanding extensive fine-tuning. ControlNet-style adapters lose their efficiency under modern Diffusion Transformers since the absence of encoder-decoder hierarchy forces duplication of the entire backbone. We observe that flow matching offers a principled alternative for cross-domain VSR adaptation. By predicting a constant velocity field across all timesteps, the adaptation task reduces to learning a fixed injection pattern rather than time-varying transformations. Building on this insight, we propose LiteVSR, a minimalist framework that performs VSR using a completely frozen Diffusion Transformer with a lightweight State-Aware Adapter. The adapter employs a dual-stream architecture that extracts static structural cues from the LQ input and dynamic cues from intermediate denoising states, aligning them through time-dependent cross-attention to enable adaptive transition from structural alignment to texture refinement as denoising proceeds. LiteVSR achieves competitive restoration quality with only 11.25% trainable parameters and 12 GPU-hours of training on a single A100, while maintaining fast sampling (down to a single step) compatibility.