One of the main challenges in data mining is choosing the optimal number of clusters without prior information. Notably, existing methods are usually in the philosophy of cluster validation and hence have underlying assumptions on data distribution, which prevents their application to complex data such as large-scale images and high-dimensional data from the real world. In this regard, we propose an approach named CNMBI. Leveraging the distribution information inherent in the data space, we map the target task as a dynamic comparison process between cluster centers regarding positional behavior, without relying on the complete clustering results and designing the complex validity index as before. Bipartite graph theory is then employed to efficiently model this process. Additionally, we find that different samples have different confidence levels and thereby actively remove low-confidence ones, which is, for the first time to our knowledge, considered in cluster number determination. CNMBI is robust and allows for more flexibility in the dimension and shape of the target data (e.g., CIFAR-10 and STL-10). Extensive comparison studies with state-of-the-art competitors on various challenging datasets demonstrate the superiority of our method.
Figures & tables
Figure 1: Density center versus mean center for different cluster number settings.
Figure 3: Plots of k and center pairwise loss on partial image data sets.
Methods
Sμ
Sγ
φ
MNIST
Pointing Data
Ours
✓
✓
✓
NC: 10 ACC: 1
NC: 15 ACC: 1
Method-1
✓
✓
×
NC: 10 ACC: 0.6
NC: 15 ACC: 0.2
Method-2
✓
×
×
NC: 1 ACC: 0
NC: 1 ACC: 0
Method-3
×
✓
×
NC: 10 ACC: 0.3
NC: 15 ACC: 0.1
Method-4
✓
×
✓
NC: 1 ACC: 0
NC: 1 ACC: 0
Method-5
×
✓
✓
NC: 10 ACC: 0.5
NC: 15 ACC: 0.4
Table 3: Ablation study of CNMBI and its degradation methods. Sμ , Sγ and φ denote the Mean center, Denisty center, and boundary filtering, respectively.
Figure 4: Three extreme scenarios in Robustness
Figure 5: Boundary pattern information extraction.
Department of Computer Science Yale University · School of Science & Technology IE University · Depts. of Computer Science and Biomedical Engineering Wu Tsai Institute Yale University
Warsaw University of Technology, Faculty of Mathematics and Information Science, ul. Koszykowa 75, 00-662 Warsaw, Poland · Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, 01-447 Warsaw, Poland