Authors: Eraldo Pereira Marinho, Caetano Mazzoni Ranieri, Fabricio Aparecido Breve
Organizations: Department of Statistics, Applied Mathematics and Computing, S˜ao Paulo State University (UNESP), Institute of Geosciences and Exact Sciences, Av. 24-A, 1515, Rio Claro, S˜ao Paulo, Brazil.
We introduce Round-Trip KNN Clustering (RTKNNC), a graph-based method for finding cluster structure at several neighbourhood scales without requiring the number of clusters in advance. Unlike approaches that first make a k-nearest-neighbour (KNN) graph undirected, RTKNNC keeps both directions of the neighbour relation: which points a given point selects and which points select it. Incoming selections are treated as weighted votes that help decide which local connections remain visible during a recursive forward-and-reverse traversal. Repeating the procedure for increasing K reveals how groups persist or merge as the neighbourhood scale grows; for the reference inverse-square model before structural refinement, clusters can merge but do not split. Because graph connectivity can occasionally join distinct groups through a sparse bridge or a small region of overlap, we add an optional label-free refinement. It first tests whether an already formed component is better described by two or three Gaussian subpopulations, and accepts a subdivision only when the proposed groups are large enough and consistent with the visible KNN graph. Across eight synthetic datasets and K=2,…,16, independent C and Python implementations produced identical partitions in all 120 reference runs. Refinement increased adjusted Rand index from 0.7817 to 0.9627 on a variable-density benchmark and from 0.8083 to 0.9853 on a sparse-bridge benchmark. Comparisons with seven external clustering methods show competitive performance while preserving a label-free cluster-construction process.
Figures & tables
Figure 1: Example of a directed KNN graph with K=2 , used to illustrate the proposed mechanism. Arrows represent directed nearest-neighbour choices. The graph encodes neighbourhood connectivity, but its abstract layout does not reproduce the spatial morphology of the original point distribution. Metric distances are stored as edge attributes and are not represented by the drawn edge lengths. The same graph supports reverse-neighbour retrieval and visibility-filtered round-trip expansion.
K
clusters
ARI
NMI
unclustered
2
595
0.0116
0.3991
0
3
277
0.0403
0.4491
0
4
99
0.2809
0.5716
0
5
18
0.6661
0.8017
0
6
6
0.7774
0.8941
0
7
5
0.7805
0.8981
0
Table 1: Unpruned inverse-square regression results for the variable-density blobs dataset. Each K was run independently with K0=K .
Figure 2: Multiscale evolution of the unpruned reference inverse-square model on the variable-density blobs. Every layer is generated independently with K0=K . (a) The cluster count decreases from 595 microclusters at K=2 to four components at K=8 and is plotted on a logarithmic scale; the dashed line is the reference count C∗=5 , used only for evaluation. (b) ARI and NMI against the withheld reference labels. The shaded interval marks the exactly unchanged partition from K=8 through the largest tested value, K=16 . (c) The merge-only transition forest over K=5,6,7,8 . Node and ribbon thicknesses encode point population and overlap count Wab(K,K′) , respectively. Colours identify the four lineages ending at K=8 and do not encode reference labels. The equality m7=C∗ without high ARI and the stable mK=4 plateau demonstrate that cluster-count or partition stability alone does not guarantee recovery of latent classes.
Figure 3: Number of clusters as a function of K for every primary dataset in the controlled, unpruned four-kernel benchmark. Each point is obtained from an independent execution with K0=K , and the ordinate is logarithmic. Lines are evaluated at the integer K values; markers have small horizontal offsets only to expose coincident counts from different kernels. Dashed lines show the reference count C∗ for evaluation only. The Swiss-roll reference comprises artificial bands, and the uniform cloud has no reference partition. Matching C∗ is therefore neither an execution-time selection rule nor evidence of pointwise partition correctness.
Figure 4: Reference labels and the four predicted partitions for the two-moons dataset at the common representative scale K=10 : budget-matched uniform h(u)=1 , inverse-distance h(u)=1/u , reference inverse-square h(u)=1/u2 , and local sigmoid Sα(u) with α=8 . Every source casts the common budget in Eq. ( 20 ); the panels differ only in its allocation among outgoing neighbours. Every vote model recovers the two non-convex components exactly (ARI = NMI = 1). Cluster colours are local to each panel and do not encode a cross-panel label correspondence.
bridge fraction
h(u)=1
h(u)=1/u
h(u)=1/u2
Sα(u)
0.00
>16
>16
>16
>16
0.10
5
5
6
5
0.25
6
6
6
6
0.50
6
6
6
6
0.75
7
7
7
7
1.00
7
7
7
7
Table 2: First K producing a merger of the two dense bridge cores for each of the four vote kernels. A value >16 means that no merger occurred in the tested range.
Figure 5: Native structural pruning of the complete sparse bridge at K=6 under the three weighted allocation shapes. The panels show budget-matched h(u)=1/u , reference h(u)=1/u2 , and budget-matched local sigmoid Sα(u) with α=8 , respectively. Every model produces three clusters. Inverse-square and sigmoid allocation coincide pointwise (ARI 0.98535 , NMI 0.96212 ), while inverse-distance differs from them at four points after label alignment (ARI 0.98532 , NMI 0.96244 ). The accepted subdivisions have 6, 10, and 11 crossing visible connections, and their annotated native unpruned visible-edge counts are 6940, 6928, and 6972, respectively. The distinct unpruned visible graphs yield identical final partitions under inverse-square and sigmoid allocation. Reference labels are used only for external evaluation and colour alignment.
dataset
K
C∗
C0
ARI 0
Cp
ARI p
∣Ecut∣
Variable-density blobs
8
5
4
0.7817
5
0.9627
12
Sparse bridge
6
3
2
0.8083
3
0.9853
10
Sparse bridge
10
3
1
0.0000
3
0.9865
32
Circles
7
2
2
1.0000
2
1.0000
0
Two moons
10
2
2
1.0000
2
1.0000
0
Anisotropic blobs
8
3
3
1.0000
3
1.0000
0
Table 3: Native inverse-square results before and after structural pruning. C∗ is the number of reference classes, C0 and Cp are the unpruned and pruned cluster counts, and ∣Ecut∣ is the number of crossing visible connections in the accepted subdivision (zero when no split is accepted). Labels are used only for the reported ARI and C∗ .
Figure 6: Native structural pruning of the variable-density blobs at K=8 under the three weighted allocation shapes. The three panels show, from left to right, budget-matched h(u)=1/u , reference h(u)=1/u2 , and budget-matched local sigmoid Sα(u) with α=8 . All produce the same pointwise five-cluster partition (ARI 0.96265 , NMI 0.96141 ) after structural refinement; each accepted subdivision has 12 crossing visible connections. The panel annotations expose the distinct native unpruned graphs: ∣Evis∣=9402 , 9365, and 9470 directed edges, respectively. Reference labels are omitted from the mosaic and are used only for colour alignment and external scores; each unpruned C partition was first verified pointwise against its Python kernel definition.
Method
Anisotropic
Equal-density blobs
Variable-density blobs
Sparse bridge
Circles
Two moons
C∗
3
4
5
3
2
2
RTKNNC
1.0000/1.0000
1.0000/1.0000
0.9627/0.9614
0.9865/0.9632
1.0000/1.0000
1.0000/1.0000
Agglom. †
1.0000/1.0000
1.0000/1.0000
0.9306/0.9444
0.9153/0.8580
1.0000/1.0000
1.0000/1.0000
K-means †
1.0000/1.0000
1.0000/1.0000
0.9189/0.9338
0.9342/0.8780
-0.0004/0.0001
0.4800/0.3815
GMM †
1.0000/1.0000
1.0000/1.0000
0.9639/0.9636
0.9831/0.9552
-0.0004/0.0001
0.5096/0.4080
DBSCAN
1.0000/1.0000
1.0000/1.0000
0.7916/0.8044
0.8140/0.7422
1.0000/1.0000
1.0000/1.0000
Table 4: Best label-selected grid result for RTKNNC with structural refinement enabled and external clustering methods. Each cell reports ARI/NMI; bold denotes the highest ARI in the column, including ties. Methods marked † receive the reference cluster count C∗ ; the others do not. Reference labels are used only for scoring and best-of-grid selection, never as clustering features.
Existing graph-clustering methods typically improve clustering performance by optimizing model parameters and node representations. Effective means of further improving the clustering results of an already trained and frozen model, however, remain limited. We study post-processing for frozen graph clustering. After checkpoint fixation, the procedure uses no labels and updates neither model parameters, node representations, nor the original graph structure. Instead, it exploits an attribute hypergraph to supplement higher-order relations that ordinary graphs cannot readily express, thereby refining existing cluster assignments. Because global hypergraph refinement can yield both performance gains and erroneous updates, we propose Selective Hypergraph Refinement (SHR). The method generates candidate residual directions from the hypergraph and evaluates their reliability using graph structure, node attributes, and matched-null evidence. It updates only nodes with sufficient support and otherwise retains their original assignments. Further analysis shows that whether a node changes cluster is jointly governed by its native assignment gap and the directional strength of the refinement. In a controlled common-suite evaluation, 13 of 15 backbone-dataset cells had a positive mean macro gain, one produced exact no-action, and one was negative. The cell-equal macro gain was 0.066 pp (95% bootstrap CI, [0.030, 0.107] pp), while only 0.209% of hard assignments changed on average. A broader 15-combination native-interface evaluation yielded a macro gain of 0.137 pp at a mean change ratio of 0.375%. These results indicate that frozen clustering outputs retain a limited but measurable refinement space after training. The effect is heterogeneous across backbone-dataset pairs, and broader coverage also increases exposure to negative transfer.
Zimo Si
Department of Mathematics, Faculty of Science, University of Macau · Macao SAR, China
We present AdaGraph, a graph-native clustering algorithm born from the Structure-Centric Machine Learning (SC-ML) paradigm -- a new field of unsupervised learning that replaces geometry-centric (distance-based) computation with structure-centric (topology-based) computation, fundamentally dissolving the curse of dimensionality. AdaGraph operates entirely within the kNN graph topology, a representation that retains meaningful relational structure in arbitrarily high dimensions where Euclidean distance metrics become uninformative. AdaGraph requires no a priori specification of the number of clusters k, handles noise natively, and scales via the SLCD (Sample-Learn-Calibrate-Deploy) prototype-deployment framework. As its unsupervised tuning objective, AdaGraph pairs with Graph-SCOPE, the topology-based cluster validity index introduced as a separate SC-ML contribution. On 10 synthetic benchmarks spanning d=10 to d=5000, Graph-SCOPE achieves mean ARI=0.900 and correctly selects k on 9/10 datasets -- outperforming Silhouette, Davies-Bouldin, and Calinski-Harabasz -- while maintaining Kendall tau >= 0.92 with ground-truth cluster quality across all dimensionalities (Silhouette: tau ~= 0.46). We validate AdaGraph across three scientific domains: (1) gene co-expression discovery in hepatocellular carcinoma (GSE14520, 10,000 genes, 488 patients, no dimensionality reduction), where AdaGraph identifies condition-specific gene modules that WGCNA, ICA, NMF, and Spectral Biclustering fail to resolve; (2) natural language text clustering, where AdaGraph achieves ARI=0.751 on 20NG-6cat versus HDBSCAN's 0.464 (62% relative improvement); (3) materials science clustering of superconductors (145-dimensional Magpie features), perovskites, and JARVIS-DFT materials, where AdaGraph achieves the highest Graph-SCOPE on all three datasets.
We introduce Graph Neural Automata Clustering (G-NAC), an unsupervised clustering method in which observations interact as cells on a fixed neighborhood graph. A shared recurrent graph-neural cellular rule evolves latent domain states through local interactions, which are converted into a rank-based spectral affinity for partitioning. Across 73 clustering tasks from 57 benchmark datasets, G-NAC achieved a mean adjusted Rand index (ARI) of 0.7951, comparable to Genie at 0.7941 and higher than the other evaluated baselines. Empirical training time and GPU memory scaled approximately linearly from 5,000 to 100,000 nodes. Learned transition rules also transferred from smaller source graphs to independent 100,000-node samples generated under matched conditions. These results demonstrate a recurrent graph-clustering formulation while identifying dependencies on graph quality, readout design, and source-target similarity.