Motivated by a problem in Generative Specification-Producing AIs (SPAIs), we focus on a problem of deep clustering of three-dimensional shapes specified by point clouds. After reviewing clustering and deep clustering, we study the fully unsupervised pipeline in which a FoldingNet autoencoder is first trained for reconstruction and then K-means++ is then applied to the resulting codewords. We report clustering accuracy (ACC), normalized mutual information (NMI) and adjusted Rand index (ARI) on ModelNet10 and ModelNet40 datasets, as a function of the number of clusters K. We also provide t-SNE visualizations of the codewords, and discuss the choice of K.
Figures & tables
Figure 1: Illustrative example of clustering scenario with K=3 clusters.
Figure 2: Some example ModelNet shapes and their labeled category.
Figure 3: Training of the FoldingNet autoencoder on ModelNet10.
Figure 4: Training of the FoldingNet autoencoder on ModelNet40.
Figure 5: t-SNE projection of FoldingNet codewords for ModelNet10, colored by KMeans++ cluster ( K=10 , left) and by true class (right). Monitor, toilet, bathtub and the sub-groups of chair, sofa and bed form compact, well separated groups, whereas desk/table and night stand/dresser overlap in the center of the projection.
# Clusters ( K )
NMI
ARI
ACC
2
0.363
0.179
0.359
4
0.591
0.429
0.549
6
0.734
0.686
0.737
8
0.758
0.757
0.789
10
0.733
0.678
0.796
12
0.721
0.627
0.801
Table 1: Autoencoding/K-Means++ Clustering Results on ModelNet10 (all 4,899 shapes). Best value per column in bold; the boxed K is the elbow (operating point).
Figure 6: NMI, ARI and ACC of KMeans++ on FoldingNet codewords vs. the number of clusters K (ModelNet10). NMI and ARI peak at K=8 ; ACC keeps increasing up to K=20 .
Figure 7: Mean codeword distortion (top) and Gaussian-mixture BIC ( 1 ) (bottom) vs. K on ModelNet10. The solid line marks the label-free knee K=8 , which coincides with the boxed elbow; ( 1 ) has no interior minimum and selects K=20 .
Figure 8: t-SNE projection of FoldingNet codewords for ModelNet40, colored by KMeans++ cluster ( K=40 , left) and by true class (right). Airplane, car, guitar, laptop, chair, toilet and monitor form compact, well separated groups, whereas the box-like furniture classes (night stand, dresser, tv stand, glass box, wardrobe, xbox) and the container-like classes (vase, cup, flower pot, plant) overlap in the center of the projection.
# Clusters ( K )
NMI
ARI
ACC
10
0.563
0.324
0.418
20
0.663
0.522
0.583
30
0.687
0.528
0.658
35
0.691
0.536
0.676
40
0.695
0.526
0.691
45
0.706
0.542
0.712
Table 2: Autoencoding/K-Means++ Clustering Results on ModelNet40 (all 12,311 shapes). Best value per column in bold; the boxed K is the elbow (operating point).
Figure 9: NMI, ARI and ACC of KMeans++ on FoldingNet codewords vs. the number of clusters K (ModelNet40). NMI and ARI peak at K=45 ; the boxed operating point remains K=30 , past which ACC improves only slowly up to K=80 .
Figure 10: Mean codeword distortion (top) and Gaussian-mixture BIC ( 1 ) (bottom) vs. K on ModelNet40. The solid line marks the label-free knee K=35 ; the dashed line is the boxed elbow K=30 . ( 1 ) has no interior minimum and selects K=80 .