Music Demixing
Music demixing, the separation of individual instruments or vocal tracks from a mixed audio recording, aims to improve audio quality and enable customized listening experiences. Current research focuses on developing robust deep learning models, including transformer-based architectures and variations of convolutional and recurrent neural networks, often employing frequency-domain processing and techniques like band-splitting to enhance separation accuracy. These advancements are evaluated through challenges using benchmark datasets and metrics like signal-to-distortion ratio (SDR), driving improvements in both the objective quality and perceptual experience of separated audio, with applications ranging from hearing aid technology to cinematic audio mastering.
Papers
The Sound Demixing Challenge 2023 $\unicode{x2013}$ Cinematic Demixing Track
Stefan Uhlich, Giorgio Fabbro, Masato Hirano, Shusuke Takahashi, Gordon Wichern, Jonathan Le Roux, Dipam Chakraborty, Sharada Mohanty, Kai Li, Yi Luo, Jianwei Yu, Rongzhi Gu, Roman Solovyev, Alexander Stempkovskiy, Tatiana Habruseva, Mikhail Sukhovei, Yuki Mitsufuji
The Sound Demixing Challenge 2023 $\unicode{x2013}$ Music Demixing Track
Giorgio Fabbro, Stefan Uhlich, Chieh-Hsin Lai, Woosung Choi, Marco Martínez-Ramírez, Weihsiang Liao, Igor Gadelha, Geraldo Ramos, Eddie Hsu, Hugo Rodrigues, Fabian-Robert Stöter, Alexandre Défossez, Yi Luo, Jianwei Yu, Dipam Chakraborty, Sharada Mohanty, Roman Solovyev, Alexander Stempkovskiy, Tatiana Habruseva, Nabarun Goswami, Tatsuya Harada, Minseok Kim, Jun Hyung Lee, Yuanliang Dong, Xinran Zhang, Jiafeng Liu, Yuki Mitsufuji