stat.MLJan 16, 2024

Semidefinite programming relaxations and debiasing for MAXCUT-based clustering

Authors: Shuheng Zhou

Organizations: University of California, Riverside, CA 92521

Abstract

In this paper, we consider the problem of partitioning a small data sample of size nn drawn from a mixture of 22 sub-gaussian distributions in Rp\mathbb{R}^p. We consider semidefinite programming relaxations of an integer quadratic program that is formulated essentially as finding the maximum cut on a graph, where edge weights in the cut represent dissimilarity scores between two nodes based on their pp features. We define the signal-to-noise ratio (SNR) as s2:=min{npγ2,Δ2}s^2 := \min\{n p γ^2, Δ^2\}, where Δ2:=pγΔ^2 := p γ denotes the 22\ell_2^2 distance between the two cluster centers. Our contributions are twofold. First, we provide a unified framework for analyzing three computationally efficient algorithms: SDP1, BalancedSDP, and Spectral clustering, yielding universal polynomial-rate misclassification guarantees for all three algorithms. Moreover, our theory allows for partial recovery (success rate <100%< 100\%) as long as s2s^2 is lower bounded by a constant. Second, we prove that the misclassification errors for SDP1 and BalancedSDP decay exponentially with respect to the SNR s2s^2 and the BalancedSDP requires no explicit debiasing when the two clusters have equal sizes. To our knowledge, this is the first time such results are obtained for semidefinite relaxations of MAX CUT in population clustering. We provide simulation evidence illuminating the theoretical predictions.

Explore similar work

CardsList
  1. Proportionally Representative Clustering

    Apr 27, 2023Haris Aziz, Barton E. Lee, Sean Morota Chu +1Image ClusteringApproximation Algorithms