cs.CVNov 17, 2026

Centroid Spectral Coupling: Implicit Alignment and Representation Diversity in Self-Supervised Learning

Authors: M. Hadi Sepanj, Benyamin Ghojogh, Saed Moradi, Paul Fieguth

Organizations: Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada · Department of Electrical and Computer Engineering, University of Waterloo, Waterloo, ON, Canada

Abstract

Self-Supervised Learning (SSL) aims to align augmented views while preserving representation diversity and preventing collapse. Existing non-contrastive methods often address these goals using multiple weighted loss terms. We introduce Centroid Spectral Coupling (CSC), a single-term SSL objective that implicitly couples view alignment, representation diversity, and collapse resistance. CSC constructs centroids from independently normalized augmented-view pairs and applies a ridge-based spectral objective to their uncentered second-moment matrix. Preserving centroid magnitudes encodes view agreement while encouraging balanced representation energy across spectral directions. We establish an exact decomposition into nonnegative alignment and spectral-imbalance components, characterize the geometry of global optima, and derive finite-loss guarantees for alignment and diversity. We also show that complete constant-output collapse is a strict saddle in normalized representation space. Experiments on CIFAR-10, CIFAR-100, and Imagenette show that CSC achieves the highest linear Top-1 accuracy among the evaluated non-contrastive methods on all three benchmarks, and the highest kNN Top-1 accuracy on both CIFAR datasets. A ridge-parameter sensitivity study reveals an empirical alignment--diversity trade-off: increasing κκ strengthens view alignment but reduces representation effective rank. These results show that a unified spectral objective yields competitive visual representations without explicit contrastive negatives or separately weighted alignment and diversity penalties.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Three Necessary Principles for Self-Supervised Visual Representation Learning

    Aug 8, 2026Nikos Giakoumoglou, Paschalis Giakoumoglou, Tania StathakiContrastive LearningRepresentation Collapse

  2. Sharp Regret Bounds and a Task-Covariance Correction for Spectral Representation Learning

    Sep 14, 2026Dier Tang, Jing Yee Tan, Guangyue HanRepresentation LearningSelf-Supervised Learning