A Generalized Sparse Fuzzy Clustering Framework with Automated Cluster Cardinality Estimation Ability
Organizations: Department of Informatics and Telecommunications, National and Kapodistrian University of Athens, Athens 16122, Athens, Attica, Greece · Institute for Astronomy Astrophysics Space Applications and Remote Sensing, National Observatory of Athens, Vas. Pavlou & I. Metaxa, 15236, Penteli, Attica, Greece
Abstract
Fuzzy clustering provides a robust framework for handling ambiguous and overlapping data boundaries, yet its traditional formulation generates entirely dense membership assignments that limit noise resilience and prevent estimating the true number of clusters, when it is unknown. To address these limitations, we introduce in this paper the Generalized Sparse Fuzzy Clustering (GSFC) framework, which incorporates a continuous sparsity penalty into the fuzzy objective function. Because closed-form solutions are precluded by the simultaneous presence of fuzzifier and sparsity exponents, we propose an efficient primal-dual bisection search coupled with specialized analytic pathways to rigorously enforce the partition constraint while organically driving trace memberships to exact zero. This mathematically enforced sparsity empowers the algorithm to autonomously estimate the true number of clusters by dynamically pruning redundant clusters, provided that it is initialized by a larger than the true number of clusters. Furthermore, we integrate a virtual noise sink to insulate outliers from the rest of the data points. The usage of the proposed framework is also extended to line segment detection. Extensive empirical evaluations across synthetic toy datasets, high-noise geometric stress tests, and real-world benchmarks (UCI wine dataset and hyperspectral images) demonstrate that GSFC effectively exceeds conventional fuzzy benchmarks while autonomously resolving cluster cardinality. Additionally, it significantly outperforms existing sparse possibilistic and probabilistic soft-clustering alternatives in line detection tasks.
Figures & tables
| Metric | Algorithm | Initial | Estimated | Score (Mean Std) |
| ARI | K-means | 3 | 3 | |
| FCM | 3 | 3 | ||
| GMM | 3 | 3 | ||
| GSFC (Pathway 1) | 6 | 3 | ||
| GSFC (Pathway 2) | 6 | 3 | ||
| NMI | K-means | 3 | 3 |
| Metric | Algorithm | Initial | Estimated | Score (Mean Std) |
| ARI | K-means | 2 | 2 | |
| FCM | 2 | 2 | ||
| GMM | 2 | 2 | ||
| GSFC (Pathway 1) | 6 | 2 | ||
| GSFC (Pathway 2) | 6 | 2 | ||
| NMI | K-means | 2 | 2 |
Clustering
Clustering groups data points by shared structure, developing methods to discover, validate, and interpret groups across diverse data and constraints.
See all 370 papers