DiffVQE2: An Efficient Low-delay Diffusion Model for Acoustic Echo and Noise Control
Organizations: Institute for Communications Technology, Technische Universität Braunschweig, Schleinitzstraße 22, 38106 Braunschweig, Germany · GN Advanced Science, Lautrupbjerg 7, 2750 Ballerup, Denmark
Abstract
Hands-free communication devices and speakerphones are inherently affected by acoustic echo and background noise. To mitigate these impairments, end-to-end discriminatively trained neural networks have emerged as the best-performing approach in research and deployment. While recent advancements in generative methods have provided remarkable results for various speech enhancement tasks, diffusion-based acoustic echo control (AEC) research is still restricted to non-causal, utterance-level processing, thereby not widely applicable in practice. With this work, we are the first to propose low-delay (i.e., causal) diffusion-based joint AEC and noise control models DiffVQE2 / DiffVQE2-S, excelling the so-far state of the art DeepVQE / DeepVQE-S models in multiple objective metrics, and, most importantly, in subjective MOS, respectively. In addition, our models are less complex. Furthermore, we show that a limited lookahead applied to the efficient DiffVQE2-S model allows for an even higher performance. These results have been obtained on the ICASSP 2023 AEC Challenge blind test set. We claim the first streaming-capable, diffusion-based acoustic echo and noise control that excels state-of-the-art discriminative approaches.
Figures & tables
| Method | #Param. (M) | #GFLOPS | ||||||||||||||||||
| Alg. | Look- | DT | DT | DT | DT | DT | STFE | STNE | STNE | STNE | STNE | Avg. | DT | DT | STFE | STNE | Avg. | |||
| Delay | ahead | Echo | Other | OVRL | SIG | BAK | Echo | Other | OVRL | SIG | BAK | Rank | MOS E | MOS O | MOS E | MOS O | MOS | |||
| Unprocessed | - | - | - | - | 1.76 | 4.10 | 2.12 | 3.10 | 2.23 | 2.07 | 3.79 | 2.75 | 3.33 | 3.37 | - | 2.10 | 2.87 | 2.52 | 3.45 | 2.74 |
| DiffVQE [ 19 ] | 5.1 | 5.37 | 4.62 | 4.11 | 2.93 | 3.25 | 3.96 | 4.43 | 4.26 | 3.14 | 3.43 | 4.07 | - | 3.70 | 3.54 | 3.71 | 3.77 | 3.68 | ||
| DeepVQE [ 8 ] | 5.3 | 42.24 | 0 | 4.64 | 3.84 | 2.75 | 3.11 | 3.86 | 4.37 | 3.93 | 2.97 | 3.31 | 4.03 | 1.2 | 3.66 | 3.26 | 3.48 | 3.34 | 3.44 | |
| DiffVQE2 | 5.1 | 5.37 | 0 | 4.48 | 3.76 | 2.67 | 3.00 | 3.86 | 4.46 | 3.88 | 2.98 | 3.28 | 4.02 | 1.7 | 3.76 | 3.39 | 3.77 | 3.39 | 3.58 |
Audio Diffusion Models
Audio diffusion models generate, edit, and restore sound by denoising audio or learned representations under text, audio, or scene conditions.
See all 93 papers