Online Algorithms for Independent Low-Rank Matrix Analysis and Rank-Constrained Spatial Covariance Matrix Estimation Based on Maximum Weighted Likelihood Estimation
Organizations: Graduate School of Information Science and Technology, The University of Tokyo, Tokyo 113-8656, Japan · National Institute of Technology, Kagawa College, Takamatsu, Kagawa 761-8058, Japan · Yamaha Corporation, Hamamatsu-shi, Shizuoka 430-8650, Japan
Abstract
Real-time multichannel speech extraction (MSE) under diffuse noise conditions is an important task with a wide range of applications, such as speech recognition and hearing aids. In this paper, we propose online algorithms for independent low-rank matrix analysis (ILRMA) and rank-constrained spatial covariance matrix estimation (RCSCME). Previously, we proposed a real-time extension of the RCSCME-based method: an MSE method based on ILRMA and RCSCME using the blockwise batch algorithm. However, it assumes that the spatial characteristics are stationary within a single batch, and thus, in dynamic situations where the target speaker moves, its performance may degrade. To address this problem, we derive the online algorithms for ILRMA and RCSCME in the following three steps. First, we formulate framewise cost functions for ILRMA and RCSCME on the basis of maximum weighted likelihood estimation. Second, we derive the update rules for the framewise cost functions on the basis of auxiliary-function techniques. These naive update rules are computationally costly for real-time execution on a practical machine. Thus, we finally derive the online algorithms by approximating some intermediate parameters with their estimates. Furthermore, we propose stabilization and further acceleration techniques for these online algorithms. In experiments, we simulate situations where a target speaker is stationary or moves and show that the proposed method achieves superior speech extraction performance compared with conventional methods. In addition, using real-world recorded signals, we demonstrate the effectiveness of the proposed method in practical scenarios.
Figures & tables
| RCSCME | |||
| Blockwise batch | Online | ||
| NSR-ILRMA | Blockwise batch | Batch-Batch | Batch-Online |
| Online | Online-Batch | Online-Online | |
Audio Source Separation
Audio source separation isolates individual speakers, instruments, or sound events from mixtures for listening, analysis, and audio editing.
See all 66 papers