stat.MLMar 20, 2026

Model Selection and Parameter Estimation for Multidimensional Gaussian Mixture Models with a Common Covariance Matrix

Authors: Xinyu LiuHai Zhang

Organizations: Department of Mathematics, Hong Kong University of Science and Technology (HKUST) · HKUST-Shenzhen-Hong Kong Collaborative Innovation Research Institute

Abstract

We study model-order selection and component-mean estimation for multidimensional Gaussian mixture models with a known common covariance matrix. Using empirical characteristic-function measurements, we construct Fourier covariance matrices whose population counterparts have rank equal to the number of mixture components. We establish a minimax lower bound showing that distinguishing a separated kk-component mixture from the class of (k1)(k-1)-component mixtures requires Ω(Δ(4k4))Ω(Δ^{-(4k-4)}) samples. We then develop an oracle spectral-thresholding estimator with a sufficient sample size of order Δ(8k8)Δ^{-(8k-8)} for fixed kk, together with a practical singular-value-ratio estimator. Given the model order, we estimate the component means by score-initialized gradient descent on a MUSIC-type projection objective. Under an explicit sample-size condition, a qualifying sample initialization lies in a certified attraction region with high probability, after which the iterates converge linearly. For fixed positive component separation, the resulting mean estimates achieve the parametric rate Op(n1/2)\mathcal{O}_p(n^{-1/2}). Numerical experiments demonstrate competitive accuracy and lower computational cost than expectation-maximization across a range of multidimensional settings.

Explore similar work

CardsList