Face Re-morphing: Differential Morphing Attack Detection via Feature-Space Similarity Changes
Authors: Jie Jin, Masakatsu Nishigaki, Tetsushi Ohki
Organizations: Graduate School of Science and Technology, Shizuoka University 3-5-1 Johoku, Chuo-ku, Hamamatsu, Shizuoka 432-8011 · RIKEN AIP 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan
Face morphing attacks pose a serious threat to face recognition systems because a single morphed document image can be matched to multiple contributors. Differential morphing attack detection (D-MAD) addresses this threat by comparing a document image with a trusted live image, but existing methods often rely on static feature differences, constituent-face reconstruction, or multi-cue fusion. This paper proposes Face Re-morphing, a D-MAD method that uses the feature-space response to an additional morphing operation as a detection cue. Given a document image and a trusted live image, the proposed method generates a re-morphed image and uses the change between the document--live and live--re-morphed cosine similarities as the detection score. Experiments on FRLL-Morphs and FEI Morph show that the proposed cue is effective across different morphing conditions, re-morphing methods, and face recognition models. Comparisons with existing methods show favorable results on AMSL and indicate that the proposed method performs well under the Criminal condition on FEI Morph Version~1, particularly when using MorDIFF. These results indicate that re-morphing-induced similarity change provides a complementary cue for D-MAD.
Figures & tables
Figure 1: Overview of the proposed method. The proposed framework compares the cosine similarity between the document image and the live image with that between the live image and the re-morphed image, and uses their difference as the detection score.
Setting
Accomplice
Criminal
Both
EER
B 0.01
EER
B 0.01
EER
B 0.01
FRLL-M / MD / IR101
1.1e-2
2.0e-2
3.0e-3
0
7.6e-3
0
FRLL-M / MD / IR50
8.4e-3
0
2.0e-3
0
5.2e-3
0
FRLL-M / MD / ViT-k
9.8e-3
9.8e-3
2.3e-3
0
7.9e-3
0
FRLL-M / MD / ViT
9.8e-3
9.8e-3
2.1e-3
0
7.2e-3
0
FRLL-M / MD / mean
9.7e-3
9.8e-3
2.3e-3
0
7.0e-3
0
Table 1: Detection performance using different feature extractors on FRLL-Morphs and FEI Morph Version 2.
Setting
Accomplice
Criminal
Both
EER
B 0.01
EER
B 0.01
EER
B 0.01
FRLL-M / mean / MD
9.7e-3
9.8e-3
2.3e-3
0
7.0e-3
0
FRLL-M / mean / OCV
1.1e-3
0
9.9e-4
0
1.0e-3
0
FRLL-M / mean / SG2-A
7.9e-2
3.3e-1
5.8e-2
2.7e-1
6.8e-2
3.1e-1
FEI-M2 / mean / MD
1.1e-1
8.0e-1
1.1e-2
1.9e-2
7.2e-2
6.2e-1
FEI-M2 / mean / OCV
1.2e-1
5.6e-1
1.2e-2
3.7e-2
8.6e-2
4.3e-1
Table 2: Average detection performance of different re-morphing methods on FRLL-Morphs and FEI Morph Version 2.
Figure 2: Distributions of Δs for bona-fide and morphed samples using IR101 on FRLL-Morphs and FEI Morph Version 2.
Setting
Score
Accomplice
Criminal
Both
FRLL-M / mean / –
sbase
5.3e-3
1.2e-3
4.3e-3
FRLL-M / mean / MD
Δs
9.7e-3
2.3e-3
7.0e-3
sre
1.5e-1
1.1e-1
1.2e-1
FRLL-M / mean / OCV
Δs
1.1e-3
9.9e-4
1.0e-3
sre
7.9e-2
4.4e-2
6.2e-2
FRLL-M / mean / SG2-A
Δs
7.9e-2
5.8e-2
6.8e-2
Table 3: Comparison of EERs for sbase , Δs , and sre across datasets and re-morphing methods. Since sbase is independent of the re-morphing method, it is reported once per dataset.
Method
Accomplice
Criminal
Both
EER
B 0.01
EER
B 0.01
EER
B 0.01
[ 26 ]
.059
.833
.089
.980
.075
.966
[ 25 ]
.069
.598
.059
.667
.069
.662
[ 28 ]
-
-
-
.031
-
-
[ 27 ]
.003
.020
.000
.000
.001
.020
[ 3 ]
.001
.020
.001
.059
.001
.059
Table 4: Comparison between the proposed method and existing methods on the AMSL dataset. Bold and underlined values indicate the best and second-best results, respectively.
Method
Accomplice
Criminal
Both
EER
B 0.01
EER
B 0.01
EER
B 0.01
[ 11 ]
.160
.618
.027
.050
.111
.522
[ 26 ]
.200
.623
.185
.697
.192
.628
[ 27 ]
.178
.770
.068
.295
.128
.690
[ 3 ]
.153
.563
.061
.370
.115
.515
[ 7 ]
.125
.468
.125
.440
.125
.445
Table 5: Comparison between the proposed method and existing methods on FEI Morph Version 1. Bold and underlined values indicate the best and second-best results, respectively.
Morphing is a challenge to face recognition (FR) for which several morphing attack detection solutions have been proposed. We argue that face recognition and differential morphing attack detection (D-MAD) in principle perform very similar tasks, which we support by comparing an FR system with two existing D-MAD approaches. We also show that currently used decision thresholds inherently lead to FR systems being vulnerable to morphing attacks and that this explains the tradeoff between performance on normal images and vulnerability to morphing attacks. We propose using FR systems that are already in place for morphing detection and introduce a new evaluation threshold that guarantees an upper limit to the vulnerability to morphing attacks - even of unknown types.
Una M. Kelly, Luuk J. Spreeuwers, Raymond N. J. Veldhuis
Data Management and Biometrics, University of Twente, Enschede, the Netherlands · Machine Learning and Data Engineering, University of Münster, Münster, Germany · Department of Information Security and Communication Technology, Norwegian University of Science and Technology, Gjøvik, Norway
Face morphing attacks pose a substantial risk to the reliability of face recognition systems used in passport issuance, border control, and digital identity verification. Detecting morphing attacks from a single facial image remains challenging owing to the lack of a trusted reference and the diversity of attack generation methods. This paper presents a new Single-Image Face Morphing Attack Detection (S-MAD) framework that integrates high-frequency Laplacian residual statistics with representations from a frozen, foundation-scale vision transformer. The approach employs residual-statistic-gated low-rank adapters (R-FLoRA) and feature-wise residual fusion (Res-FiLM) to enhance sensitivity to local morphing artefacts while preserving the semantic context of the backbone. A novel residual-contrastive alignment loss further regularises the fused token space, improving discrimination under unseen morphing conditions. Comprehensive experiments on four ICAO-compliant datasets, encompassing seven morph generation techniques, demonstrate that the proposed method consistently surpasses nine recent state-of-the-art S-MAD algorithms in detection accuracy and cross-domain (or dataset) generalisation. With a frozen backbone and minimal trainable parameters, the model achieves real-time efficiency and interpretability, making it suitable for real-life scenarios in biometric verification systems.
Raghavendra Ramachandra
SAFE Center, Department of Information Security and Communication Technology, Norwegian University of Science and Technology (NTNU), Norway
Advancing face morphing attack techniques is crucial to anticipate evolving threats and develop robust defensive mechanisms for identity verification systems. This work introduces DCMorph, a dual-stream diffusion-based morphing framework that simultaneously operates at both identity conditioning and latent space levels. Unlike image-level methods suffering from blending artifacts or GAN-based approaches with limited reconstruction fidelity, DCMorph leverages identity-conditioned latent diffusion models through two mechanisms: (1) decoupled cross-attention interpolation that injects identity-specific features from both source faces into the denoising process, enabling explicit dual-identity conditioning absent in existing diffusion-based methods, and (2) DDIM inversion with spherical interpolation between inverted latent representations from both source faces, providing geometrically consistent initial latent representation that preserves structural attributes. Vulnerability analyses across four state-of-the-art face recognition systems demonstrate that DCMorph achieves the highest attack success rates compared to existing methods at both operational thresholds, while remaining challenging to detect by current morphing attack detection solutions.
Tahar Chettaoui, Eduarda Caldeira, Guray Ozgur +3
Fraunhofer Institute for Computer Graphics Research IGD, Germany · TU Darmstadt, Germany · Norwegian University of Science and Technology (NTNU), Norway