cs.LGSep 28, 2026

Riemannian Difference-of-Convex Optimization for K-Means Clustering

Authors: Meng Xu, Bo Jiang, Hanfu Zhang, Ya-Feng Liu, Anthony Man-Cho So

Organizations: AMSS, Chinese Academy of Sciences, and University of Chinese Academy of Sciences, Beijing, China · Ministry of Education Key Laboratory of NSLSCS, School of Mathematical Sciences, Nanjing Normal University, Nanjing, China · Ministry of Education Key Laboratory of Mathematics and Information Networks, School of Mathematical Sciences, Beijing University of Posts and Telecommunications, Beijing, China · Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, HKSAR, China

Abstract

K-means is a widely adopted clustering approach in signal processing and machine learning. In this paper, we study K-means clustering through a cardinality-constrained formulation on a compact embedded submanifold. We replace the cardinality constraint with a difference-of-convex (DC) penalty and establish a global error bound to prove that the penalized and constrained formulations share the same global minimizers whenever the penalty parameter exceeds a finite threshold. To solve the resulting nonsmooth Riemannian DC problem, we reformulate it as a minimax problem and propose RADA-DC, a Riemannian alternating descent ascent method combining dual regularization with DC linearization. Under standard assumptions and suitable parameter choices, RADA-DC finds an εε-Riemannian critical point within O(ε−3)O(ε^{-3}) iterations. We conduct experiments on synthetic and real-world datasets to demonstrate that the proposed method outperforms the tested baselines, including K-means++, in solution quality at competitive computational cost when the number of clusters is large.

Figures & tables

Explore similar work

CardsList
  1. Data-Native Global Optimization for Big Data K-means Clustering

    Jul 17, 2026Ravil Mussabayev, Rustam Mussabayev, Zukhra Yerdaliyeva +1K-MeansClustering

  2. Lloyd's KK-Means Clustering Algorithm Is Frank-Wolfe in Disguise

    Jul 28, 2026Michael Pokojovy, J. Marcus Jobe, Simon Lacoste-JulienK-MeansConvex Optimization

  3. T-ARC: Topology-Aware Randomized Clustering via Distributionally Robust Stochastic Block Models

    Sep 30, 2026Serena Grazia De Benedictis, Andersen Ang, Nicoletta Del Buono +2TopologyGeometric Bias