Voice phishing detection faces three critical challenges: real criminal recordings are unavailable due to privacy constraints; when available, only a handful of samples exist, insufficient for fine-tuning; and lightweight acoustic-only detection is needed as an alternative to large self-supervised models. We compare domain-invariant prosodic features and self-supervised representations (HuBERT, wav2vec2.0) through cross-domain evaluation-training on scenario-based actor recordings and testing on authentic criminal calls. Domain-invariant prosodic features achieve 69.5% F1 zero-shot and 71.0% with 5-shot learning. HuBERT achieves highest performance (94.2% F1, 5-shot), while wav2vec2.0 exhibits a precision-oriented detection profile (90.2% F1 with 99.4% precision, 5-shot). These findings reveal fundamental trade-offs: domain-invariant features enable zero-shot deployment when no real data exists, while SSL methods achieve higher performance but require real samples and compute.
Figures & tables
Dataset
Class
Train
Test
Avg (s)
Total (h)
Source domain (scenario-based)
Scenario VP
VP
406
—
506
57.1
Scenario consult.
Non-VP
406
203
220
37.1
Target domain (authentic)
Authentic VP
VP
—
406
327
36.9
Authentic consult.
Non-VP
—
203
104
5.9
Table 1: Dataset composition for cross-domain voice phishing detection. For few-shot adaptation, k∈{0,1,5} support examples are randomly sampled from a 50-utterance authentic criminal VP set, strictly disjoint from the test set. The test set remains fixed at 812 utterances across all conditions. Train/test partitions are sample-disjoint.
Figure 1: RF feature importance vs. Cohen’s d for the Top-20 eGeMAPS candidates. Dashed line: d=0.5 selection threshold; shaded region: selected zone ( d<0.5 ). Four selected features are annotated with RF importance (F.I.) and Cohen’s d .
Method
Features
k -shot
F1
Rec.
Prec.
Prosodic
88 (baseline)
0
3.8
2.0
66.7
1
8.8
4.7
73.1
5
85.2
90.4
80.5
Prosodic
4 (selected)
0
69.5
79.1
62.0
1
68.8
76.8
62.3
5
71.0
81.0
63.1
Table 2: Cross-domain results (LR classifier, %). k : number of authentic VP support samples. Bold: best per metric per k condition.
Figure 2: F1 score vs. number of authentic VP samples (0, 1, 5-shot). Crossover 1: regime transition where HuBERT surpasses domain-invariant Prosodic 4f. Crossover 2: full Prosodic 88f. overtakes Prosodic 4f. with 5-shot adaptation.
mfcc1V
4 features (selected)
k -shot
Sens.
Spec.
Spec. (OOD)
Sens.
Spec.
Spec. (OOD)
0
87.9
52.0
38.4
79.1
51.5
39.9
1
88.2
51.7
37.9
75.9
54.9
38.9
5
87.7
52.0
37.4
76.8
54.7
37.9
Table 3: mfcc1V vs. 4 features (selected) (LR classifier, %). Sens. = VP correct detection rate (Sensitivity); Spec. = Specificity on within- and out-of-distribution Non-VP combined; Spec. (OOD) = Specificity on out-of-distribution Non-VP only (authentic telephone consultation, n =203). Bold: best per metric per condition.
Voice biometric systems face growing threats from spoofing attacks, yet the evaluation of detection models remains inconsistent across datasets. To investigate these unpredictable fluctuations, we conduct a comprehensive benchmark of four self-supervised learning feature extractors paired with four back-end classifiers. We compare the hierarchical local feature extraction of ResNet with the global sequence and relational modeling of attention and graph-based back-ends. Through multi-corpus training across three scenarios and six evaluation datasets, our empirical analysis yields two critical findings. First, we expose a domain bias within the ASVspoof 5 dataset, showing that naive data scaling actively degrades performance. Second, our cross-linguistic analysis reveals that fine-tuning with just 8 hours of target-language data enhances detection robustness. Together, these findings emphasize the critical need for domain-aware and language-specific adaptation in spoofing detection.
Anh-Tuan Dao, Driss Matrouf, Mickael Rouvier +1
Laboratoire Informatique d’Avignon, Avignon Universite, France · EURECOM, Sophia Antipolis, France
Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech models. The system directly predicts a structured 22-dimensional feature vector per frame encoding manner, vowel quality, place, and voicing, instead of deriving features from phoneme outputs. To ensure phonologically coherent predictions, we introduce a manner-conditioned gating mechanism that activates valid feature groups. Evaluated across multiple languages and corpora, PhonoQ-2.0 achieves an average macro-F1 of 91.3% in-domain and 88.9% out-of-domain. Compared to a strong CTC phoneme baseline, it delivers consistent gains of +8.8 F1 in-domain and +8.6 out-of-domain on average. In unseen-language evaluation, PhonoQ-2.0 improves macro-F1 from 66.9% to 73.6% (+6.7 on average), with gains of up to +10.8 points.
Abner Hernandez, Tomás Arias-Vergara, Daiqi Liu +2
Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany · GITA Lab. Facultad de Ingenier´ıa. Universidad de Antioquia UdeA, Medell´ın, Colombia
Audio deepfake detection systems trained on one dataset often fail when deployed on data from different sources due to distributional shifts in recording conditions, synthesis methods, and acoustic environments. We present a modular pipeline for unsupervised domain adaptation that combines pre-trained Wav2Vec 2.0 embeddings with statistical transformations to improve cross-domain generalization without requiring labeled target data. Our approach applies power transformation for feature normalization, ANOVA-based feature selection, joint PCA for domain-agnostic dimensionality reduction, and CORAL alignment to match source and target covariance structures before classification via logistic regression. We evaluate on two cross-domain transfer scenarios: ASVspoof 2019 LA to Fake-or-Real (FoR) and FoR to ASVspoof, achieving 62.7--63.6% accuracy with balanced performance across real and fake classes. Systematic ablation experiments reveal that feature selection (+3.5%) and CORAL alignment (+3.2%) provide the largest individual contributions, with the complete pipeline improving accuracy by 10.7% over baseline. While performance is modest compared to within-domain detection (94-96%), our pipeline offers transparency and modularity, making it suitable for deployment scenarios requiring interpretable decisions.