Robust Generative Audio Quality Assessment: Disentangling Quality from Spurious Correlations
Organizations: Dept. Computer Science and Information Engineering, National Taiwan Normal University, Taiwan · E.SUN Financial Holding Co., Ltd., Taiwan · United Link Co., Ltd., Taiwan · Institute of Computer Science, Academia Sinica, Taiwan
Abstract
The rapid proliferation of AI-Generated Content (AIGC) has necessitated robust metrics for perceptual quality assessment. However, automatic Mean Opinion Score (MOS) prediction models are often compromised by data scarcity, predisposing them to learn spurious correlations-- such as dataset-specific acoustic signatures-- rather than generalized quality features. To address this, we leverage domain adversarial training (DAT) to disentangle true quality perception from these nuisance factors. Unlike prior works that rely on static domain priors, we systematically investigate domain definition strategies ranging from explicit metadata-driven labels to implicit data-driven clusters. Our findings reveal that there is no "one-size-fits-all" domain definition; instead, the optimal strategy is highly dependent on the specific MOS aspect being evaluated. Experimental results demonstrate that our aspect-specific domain strategy effectively mitigates acoustic biases, significantly improving correlation with human ratings and achieving superior generalization on unseen generative scenarios.
Figures & tables
| System / Strategy | PQ (Technical) | PC (Content) | CE (Content) | CU (Functional) | ||||
|---|---|---|---|---|---|---|---|---|
| MSE | SRCC | MSE | SRCC | MSE | SRCC | MSE | SRCC | |
| Existing Baselines (SOTA) | ||||||||
| QAMRO † [ 17 ] | - | 0.883 | - | 0.942 | - | 0.869 | - | 0.852 |
| DRASP † [ 21 ] | - | 0.900 | - | 0.936 | - | 0.890 | - | 0.911 |
| AESA-Net † [ 18 ] | 0.635 | 0.896 | 0.198 | 0.928 | 3.991 | 0.904 | 0.533 | 0.894 |
| MultiGauss [ 4 ] | 0.557 | 0.942 | 1.093 | 0.947 | 1.841 | 0.938 | 0.945 | 0.961 |
| Strategy | Domain Acc. (%, ) | PQ SRCC ( ) | PC SRCC ( ) |
|---|---|---|---|
| Baseline | 90.9 | 0.795 | 0.891 |
| DAT-Source | 87.5 | 0.798 | 0.879 |
| DAT-Kmeans | 92.2 | 0.800 | 0.886 |
Domain Generalization
Domain generalization develops models that perform reliably in new environments without training on target-domain data.
See all 375 papers