stat.MLOct 15, 2026

Robust Covariance Estimation for Entry-wise Contaminated and Partially Observed Data via Expectation Maximization Algorithm

Authors: Matys Savidan, Mohammed Nabil El Korso

Organizations: ENS Paris-Saclay, France · Paris Saclay University, France

Abstract

Robust covariance estimation under entry-wise contamination and missing data is challenging in various signal processing applications. Under the Student-tt model, observation-level reweighting induces a uniform attenuation across samples, which can lead to cumulative information loss even when most coordinates remain informative. The alternative Student-t∗t^* model enables coordinate-wise robustness, but its E-step is not available in closed form. We extend inference for the Student-t∗t^* model to incomplete observations through a stochastic approximation EM (SAEM) algorithm operating on a reduced latent space: stochastic updates of the coordinate-wise scales are combined with Rao-Blackwellized Gaussian conditional moments, which avoids explicit sampling of latent Gaussian variables while preserving a likelihood-based framework. Experiments on synthetic and real sensor data show a lower Fisher-Rao error than Gaussian, Student-tt, imputation-based and detect-then-estimate estimators at moderate to high outlier rates under diffuse contamination.

Figures & tables

Explore similar work

CardsList
  1. High-dimensional estimation with missing data: Statistical and computational limits

    Mar 17, 2026Kabir Aladin Verchand, Ankit Pensia, Saminul Haque +1Learning with Missing DataCovariance Estimation

  2. Adversarial Contamination Meets Hard Thresholding: An Iterative Algorithm with Signal Adaptivity and Minimax Optimality

    Jun 26, 2026Shixiang Liu, Hanming YangRobust RegressionSparse Recovery

  3. Stochastic Expectation Maximization for Robust State-Space Radio Interferometric Imaging

    Jun 22, 2026Nawel Arab, Mohammed Nabil El Korso, Isabelle Vin +1Image ReconstructionExpectation-Maximization