cs.CVAug 14, 2026

XSA-MAD: Cross-modal Semantic Alignment for Morphing Attack Detection

Authors: Jie Jin, Mahiro Tokumasu, Yu Makino, Masakatsu Nishigaki, Tetsushi Ohki

Organizations: Graduate School of Science and Technology Shizuoka University · Shizuoka University · RIKEN AIP

Abstract

Morphing attacks pose a serious threat to face recognition systems. However, existing image-based morphing attack detection (MAD) methods often generalize poorly to unseen generation techniques because they rely solely on visual cues. We propose XSA-MAD, a CLIP-based multimodal framework that explicitly models semantic inconsistencies between bona-fide and morphed faces. Morphing concepts are decomposed into four interpretable attributes, including identity, facial geometry, texture, and consistency, and are encoded as structured and attribute-aware textual representations. The image encoder is progressively aligned with this discriminative textual space, resulting in a unified semantic representation that captures generation-invariant and concept-level discrepancies between bona-fide and morph images. Experiments on MAD22 and MorDIFF, following training on SMDD, demonstrate strong generalization across diverse morphing principles. In particular, XSA-MAD achieves an equal error rate of 2.92% on GAN-based morphs and consistently outperforms existing methods under high-fidelity generative attacks.

Figures & tables

Explore similar work

CardsList
  1. R-FLoRA: Residual-Statistic-Gated Low-Rank Adaptation for Single-Image Face Morphing Attack Detection

    Apr 19, 2026Raghavendra RamachandraImage Forgery DetectionVision Foundation Model Adaptation

  2. SFDemorpher: Generalizable Face Demorphing for Operational Morphing Attack Detection

    Mar 30, 2026Raul Ismayilov, Luuk SpreeuwersImage Forgery DetectionRepresentation Disentanglement

  3. DCMorph: Face Morphing via Dual-Stream Cross-Attention Diffusion

    Apr 23, 2026Tahar Chettaoui, Eduarda Caldeira, Guray Ozgur +3Identity-Preserving Image GenerationConditional Diffusion Models