cs.LGOct 8, 2026

Does an Illumination Prior Help Face-Swap Detection? A Controlled Study of Temporal Self-Blended Images

Authors: Danil Davydov, Bader Rasheed, Dmitriy Vatolin

Organizations: Innopolis University, Innopolis, Russia · Laboratory of Innovative Technologies for Processing Video Content, Innopolis University, Innopolis, Russia

Abstract

Self-blended images are widely used to train face-swap detectors, but primarily capture blending artifacts. We investigate whether adding illumination inconsistencies improves detection. Temporal Self-Blended Images (T-SBI) transfer lighting statistics between frames of the same video, with the mismatch controlled by luminance difference (ΔL). Using five training regimes and a three-seed comparison of high- and low-ΔL training, we find no evidence of illumination-specific improvements. AUC differences remain within seed variability across four datasets, and an analysis of 506,328 attribute-binned samples shows no preferential reduction in errors under harsh lighting. Instead, T-SBI shifts prediction scores, changing optimal thresholds by approximately 0.34 on FaceForensics++ and 0.30 on Celeb-DF, making comparisons at a fixed threshold misleading. However, T-SBI improves robustness to heavy JPEG compression on DFDC (AUC 0.780 versus 0.696), potentially reflecting greater reliance on low-frequency cues. These findings highlight the importance of evaluating training methods against their intended targets and accounting for threshold effects.

Explore similar work

CardsList
  1. Camera-Noise Residuals for Face-Swap Detection: Redundant, Not Complementary, and Why

    Oct 8, 2026Danil Davydov, Bader Rasheed, Dmitriy Vatolin

  2. The Alpha Blending Hypothesis: Compositing Shortcut in Deepfake Detection

    May 11, 2026Andrii Yermakov, Jan Cech, Mario Fritz +1Image Forgery DetectionDeepfake Detection

  3. Towards High Fidelity Face Swapping: A Comprehensive Survey and New Benchmark

    Apr 27, 2026Qi Li, Weining Wang, Shuangjun Du +5Image Generation