BLINC: Blind Calibration For Training-Free Speech Enhancement Adaptation
Organizations: University of Stuttgart, Institute of Signal Processing and System Theory, Stuttgart, Germany
Abstract
Speech enhancement (SE) models degrade under domain shifts and have to adapt to unseen target domains during deployment. Most existing test-time adaptation (TTA) methods for SE do so by adapting a subset of the model weights using a self-supervised loss, which requires backpropagation at test-time and permanently alters the model. We instead recalibrate the prediction itself and propose BLINC, a training-free TTA method that remaps the predicted time-frequency mask onto a bimodal target distribution by histogram matching. At test-time, the target distribution is parameterized from blind features of the noisy recording, so neither a reference distribution from a classical algorithm nor online metric optimization is involved. BLINC improves the overall quality of both evaluated SE models on almost every target condition and matches or exceeds the loss-based TTA baselines at minimal overhead.
Figures & tables
| Source | RemixIT | LaDen | MPol | RaR | BLINC |
|---|---|---|---|---|---|
| 0.003 | 0.014 | 0.372 | 0.032 | 0.903 | 0.003 |
| AM | Source | ||||||
| RemixIT | 7.48 | 12.47 | |||||
| LaDen | |||||||
| MPol | 2.82 | ||||||
| BLINC | 2.17 | 3.21 | 2.66 | ||||
| CMGAN | Source |
| Target | PESQ | SI-SDR |
|---|---|---|
| Source | 2.42 | 11.49 |
| Constant target | 2.45 | 10.73 |
| BLINC | 2.55 | 11.24 |
| BLINC, SI-SDR | 2.29 | 12.21 |
| BLINC, in-domain | 2.65 | 11.02 |
| Sigmoid oracle | 2.75 | 11.02 |
Speech Enhancement
Speech enhancement improves intelligibility and listening quality by suppressing noise, reverberation, and competing speakers in recorded or live audio.
See all 127 papers