stat.MLMar 3, 2026

Low-Degree Method Fails to Predict Robust Subspace Recovery

Authors: He Jia, Aravindan Vijayaraghavan

Organizations: Northwestern University

Abstract

The low-degree polynomial framework has been highly successful in predicting computational versus statistical gaps for high-dimensional problems in average-case analysis and machine learning. This success has led to the low-degree conjecture, which posits that this method captures the power and limitations of efficient algorithms for a wide class of high-dimensional statistical problems. We identify a natural and basic hypothesis testing problem in Rn\mathbb{R}^n which is polynomial time solvable, but for which the low-degree polynomial method fails to predict its computational tractability even up to degree k=nΩ(1)k=n^{Ω(1)}. Moreover, the low-degree moments match exactly up to degree k=O(log⁡n/log⁡log⁡n)k=O(\sqrt{\log n/\log\log n}). Our problem is a special case of the well-studied robust subspace recovery problem. The lower bounds suggest that there is no polynomial time algorithm for this problem. In contrast, we give a simple and robust polynomial time algorithm that solves the problem (and noisy variants of it), leveraging anti-concentration properties of the distribution. Our results suggest that the low-degree method and low-degree moments fail to capture algorithms based on anti-concentration, challenging their universality as a predictor of computational barriers.

Figures & tables

Explore similar work

CardsList
  1. Sharp Low-Degree Thresholds for Planted-vs-Planted Testing

    Jun 3, 2026Anda Skeja, Daniel Gutiérrez Espinoza, Fiona Skerman +1Two-Sample TestingLow-Degree Polynomial Method

  2. The Sharp Phase Transition of Tyler's M-Estimator for Robust Subspace Recovery

    Jun 4, 2026Gilad Lerman, Teng ZhangPhase TransitionsRobust Estimation

  3. Average Gradient Outer Product in kernel regression provably recovers the central subspace for multi-index models

    May 14, 2026Libin Zhu, Damek Davis, Dmitriy Drusvyatskiy +1Kernel Ridge RegressionRepresentation Learning