Overview

Neural Collapse describes how late-training features can become compact within each class, arrange class means in a regular simplex-like pattern, and align classifier weights with those means. Researchers study when this geometry emerges using theoretical feature models, training-dynamics analyses, and diagnostics across optimizers, architectures, and data regimes. Related methods build prototype-based or contrastive losses around this geometry, with applications including long-tailed classification, few-shot learning, and test-time adaptation. A central open tension is whether collapse is a general property of trained networks or is altered or prevented by factors such as optimization, class imbalance, task structure, and the need to retain contextual information.

Latest papers

CardsList

24 papers5 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. Neural Collapse on Imbalanced Datasets and Open-Set Scenario

    Nov 5, 2026Qiufu Li, Huibing Xiao, Linlin Shen +1Neural CollapseClass-Imbalanced Learning

  2. Comparing Classification and Feature Learning by Analyzing Their Loss Functions in Normalized Spaces with Different Scale Factors

    Nov 5, 2026Qiufu Li, Huibin Xiao, Linlin Shen +3Representation LearningClassification

  3. A Closed Form Depth-Width Law for Neural Collapse in Deep Linear Networks

    Oct 15, 2026Pankhil Gawade, Kirsten Fischer, Guy Wolf +1Neural Representation GeometryNeural Scaling Laws

  4. Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation

    Aug 20, 2026Jia-Qi Lin, Yuangang Pan, Chang-Dong Wang +3Test-Time AdaptationNeural Collapse

  5. Contrastive-Collapsed Loss for Flexible and Geometrically Optimal Embeddings and Faster Convergence

    Jul 14, 2026Blanca Cano-Camarero, Ángela Fernández-Pascual, José R. DorronsoroGeometric Representation LearningNeural Collapse

  6. Beyond Coordinate Gauge: An Audited Protocol for Detecting Donor-Specific Functional Fingerprints after Neural Collapse

    Jul 12, 2026Truong Xuan Khanh, Phan Thanh DucNeural Representation GeometryNeural Collapse

  7. Neural Collapse Is Forbidden: Information Floors in Language Models

    Jul 10, 2026Bruno AbrahaoNeural CollapseRepresentation Geometry in Language Models

  8. Ordinal Neural Collapse as a Representation Prior for Visual Navigation

    Jun 25, 2026E-In Son, Jung-Taak Kim, Seung-Woo SeoRepresentation LearningRobot Navigation

  9. Structure Before Collapse: Transient semantic geometry in next-token prediction

    Jun 25, 2026Yize Zhao, Isabel Papadimitriou, Christos ThrampoulidisAutoregressive Language ModelingNext-Token Prediction

  10. Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic

    Jun 8, 2026Hu Tan, Kuo Gai, Shihua ZhangNeural Representation GeometryClassification

  11. Optical-Guided Neural Collapse for SAR Few-Shot Class Incremental Learning

    Jun 3, 2026Fan Zhang, Sijin Zheng, Fei Ma +4Class-Incremental LearningRemote Sensing

  12. The role of class encoding in neural collapse

    May 29, 2026Bastien Massion, Roy Makhlouf, Estelle MassartNeural Representation GeometryMulticlass Classification

  13. The Implicit Bias of Depth: From Neural Collapse to Softmax Codes

    May 21, 2026Connall Garrod, Jonathan P. Keating, Christos ThrampoulidisDeep Linear NetworksImplicit Bias

  14. Neural Collapse by Design: Learning Class Prototypes on the Hypersphere

    May 19, 2026Panagiotis Koromilas, Theodoros Giannakopoulos, Mihalis A. Nicolaou +1Prototype-Based ClassificationHyperspherical Representation Learning

  15. Optimal Representations for Generalized Contrastive Learning with Imbalanced Datasets

    May 11, 2026Thuan Nguyen, Shuchin Aeron, D. Richard Brown +1Class-Imbalanced LearningContrastive Learning

  16. Flag Varieties: A Geometric Framework for Deep Network Alignment

    May 11, 2026Jingchuan Xiao, Xinyi Sui, Cihan RuanNeural Representation GeometryNeural Collapse

  17. How Label Imbalance Shapes Geometry: A General Spectral Analysis of Multi-Label Neural Collapse

    May 3, 2026Xiaoxuan Ma, Yixuan Yang, Song Li +1Class-Imbalanced LearningMulti-Label Classification

  18. Neural Collapse Dynamics: Depth, Activation, Regularisation, and Feature Norm Threshold

    Mar 31, 2026Anamika Paul RupaNeural CollapseNeural Network Training Dynamics

  19. Neural collapse in the orthoplex regime

    Mar 21, 2026James Alcala, Rayna Andreeva, Vladimir A. Kobzar +4Neural CollapseNeural Representation Geometry

  20. Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning

    Mar 3, 2026Achleshwar Luthra, Yash Salunkhe, Tomer GalantiNeural CollapseTransfer Learning

  21. Optimizer choice matters for the emergence of Neural Collapse

    Feb 18, 2026Jim Zhao, Tin Sum Cheng, Wojciech Masarczyk +1Neural CollapseNeural Network Training Dynamics

  22. Equilibrium contrastive learning for imbalanced image classification

    Feb 10, 2026Sumin Roh, Harim Kim, Ho Yun Lee +1Class-Imbalanced LearningSupervised Contrastive Learning