DGS-MLDG: Domain Gradient Surgery Guided Meta-Learning for Domain Generalization in Speech Deepfake Detection
Organizations: Dept. of Electrical and Electronic Engineering, The Hong Kong Polytechnic University · College of Computing and Data Science, Nanyang Technological University
Abstract
Speech deepfake detection faces significant challenges due to domain shifts. Domain generalization (DG), particularly meta-learning for domain generalization (MLDG), offers a promising solution by simulating and mitigating domain shifts. However, MLDG is often hindered by conflicting gradients between its meta-train and meta-test objectives, leading to suboptimal performance. To address this problem, we propose domain gradient surgery (DGS), a meta-learning method that resolves conflicts through an asymmetric projection strategy. DGS removes the destructive component from the meta-test gradient, ensuring a conflict-free optimization trajectory versus the meta-train gradient. Furthermore, we introduce layer-wise DGS (LW-DGS), an efficient variant of DGS that dynamically identifies and intervenes only conflict-prone layers. Extensive experiments on challenging benchmarks demonstrate that DGS-MLDG and LW-DGS-MLDG achieve an average relative EER reduction of 5.29% and 4.04%, respectively.
Figures & tables
| Methods | ASV21 | ASV5 | CFAD | ADD2023 R1 | ADD2023 R2 | In-the-wild | CodecFake | Avg. Rel. Imp. ( ) |
|---|---|---|---|---|---|---|---|---|
| ERM | 0.92 | 8.57 | 24.33 | 19.16 | 23.23 | 6.71 | 7.66 | - |
| MLDG | 1.05 | 9.69 | 24.16 | 18.14 | 23.03 | 6.47 | 7.24 | 2.53 |
| DGS-MLDG (ours) | 1.00 | 10.24 | 23.86 | 17.76 | 23.19 | 5.23 | 6.76 | 5.29 |
| LW-DGS-MLDG (ours) | 1.02 | 9.55 | 23.83 | 17.88 | 22.68 | 6.15 | 7.27 | 4.04 |
| Experiments | ASV21 | ASV5 | CFAD | ADD2023 R1 | ADD2023 R2 | In-the-wild | CodecFake |
|---|---|---|---|---|---|---|---|
| Ablation ① | 0.97 | 9.82 | 24.27 | 20.43 | 23.68 | 6.15 | 7.27 |
| Ablation ② | 1.16 | 9.57 | 23.93 | 18.03 | 22.75 | 6.58 | 7.27 |
| System | In-the-wild | CodecFake |
|---|---|---|
| XLSR-Mamba | 6.71 | 7.66 |
| w/ MLDG training | 6.47 | 7.24 |
| + DGS (ours) | 5.23 | 6.76 |
| + LW-DGS (ours) | 6.15 | 7.27 |
| + PCGrad | 6.17 | 7.69 |
| + GradVac | 6.34 | 7.40 |