cs.CRSep 29, 2026

Forensic-Aware Continual Adaptation for Image Forgery Localization

Authors: Chenqi Kong, Song Xia, Anwei Luo, Peisong He, Alex C. Kot, Yuming Fang

Organizations: School of Computing, National University of Singapore, Singapore. · ROSE Lab, School of EEE, Nanyang Technological University, Singapore. · School of Computing and Artificial Intelligence, Jiangxi University of Finance and Economics, Nanchang, China. · School of Cyber Science and Engineering, Sichuan University, Chengdu, China.

Abstract

The rapid evolution of image manipulation techniques has raised growing public security concerns. Existing Image Forgery Localization (IFL) methods can accurately localize manipulated regions but are often unable to adapt to newly emerging forgeries. In real-world forensic scenarios, data typically arrive sequentially, yet continual model adaptation remains largely unexplored in IFL. To bridge this gap, we introduce the first continual learning framework for IFL and establish a comprehensive benchmark under two realistic data-evolution protocols: cross-dataset and cross-content continual learning. Evaluations of representative state-of-the-art IFL and continual learning methods reveal substantial performance degradation, highlighting two key challenges: (1) adaptively capturing intrinsic forensic traces from incoming data across unseen domains, and (2) preserving previously acquired forensic knowledge during sequential adaptation. To address these challenges, we propose a forensic-aware continual adaptation framework. First, a forensic trace mining module employs Spatial Mixture-of-Forensic-Experts (SMoFE) to dynamically route complementary forensic cues across spatial locations, together with Forensic Evidence-Guided Dense Prompting (FEGDP) to transform low-level forensic traces into structured localization evidence for SAM. Second, Fisher-weighted LoRA Gradient (FLAG) surgery identifies old-task-sensitive adaptation directions and suppresses conflicting updates, mitigating catastrophic forgetting while preserving plasticity for emerging forgery domains. Extensive experiments demonstrate state-of-the-art performance in both pixel-level forgery localization and image-level forgery detection across diverse continual learning scenarios.

Figures & tables

Explore similar work

CardsList
  1. SARIF: Segment Anything for Robust Image Forensics

    Jun 19, 2026Dong-Hyun Moon, Ju-Hyeon Nam, Sang-Chul LeeFace Forgery DetectionMultimedia Forensics

  2. Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries

    Jul 31, 2026Jingyi Hou, Xiaoxia Chen, Leyu Zhou +2ForgeriesLocalization