stat.MLSep 3, 2024

Graphons of Line Graphs

Authors: Sevvandi Kandanaarachchi, Cheng Soon Ong

Abstract

We consider the problem of estimating graph limits, known as graphons, from observations of sequences of sparse finite graphs. In this paper we show a simple method that can shed light on a subset of sparse graphs. The method involves mapping the original graphs to their line graphs. We show that graphs satisfying a particular property, which we call the square-degree property are sparse, but give rise to dense line graphs. This enables the use of results on graph limits of dense graphs to derive convergence. In particular, star graphs satisfy the square-degree property resulting in dense line graphs and non-zero graphons of line graphs. We demonstrate empirically that we can distinguish different numbers of stars (which are sparse) by the graphons of their corresponding line graphs. Whereas in the original graphs, the different number of stars all converge to the zero graphon due to sparsity. Similarly, superlinear preferential attachment graphs give rise to dense line graphs almost surely. In contrast, dense graphs, including Erdos-Renyi graphs make the line graphs sparse, resulting in the zero graphon.

Figures & tables

Explore similar work

Aug 14, 2026

Partially Observed Sparse Graphs: The Unknown Sampling Rate is a Tail Index

A large graph is often available only in part: a crawl stopped by its budget, a panel, a partial dump. When the sampled fraction ss is known by design the total edge count follows from e^=es/s2\hat e=e_s/s^2 and no model is needed. We treat the case where ss is unknown and the population size is known. Our main result is a reduction: under a sparse exchangeable (graphex) model the expected non-isolated fraction obeys ns/n1→s1+σn_s/n_1\to s^{1+σ}, so the sampling rate becomes estimable once the tail index σσ is, and substituting it back gives es(n1/ns)2/(1+σ)e_s(n_1/n_s)^{2/(1+σ)} -- the same estimator, with the design quantity inferred. Estimating global edge cardinality in a sparse graph is therefore, in expectation, tail-index estimation, and the quadratic graphon estimator is the case σ=0σ=0: it fails by an identity rather than by a fit (260%260\% median error against 27%27\%). We bound the finite-size error of the substitution and show the reduction is modular in the tail-index estimator --- filled with a published closed-form one it reaches 21.7%21.7\% over 1313 networks and 3939 sampling budgets with no fitting at all. Fitting a full graphex additionally returns the degree distribution at any size and a generative object, in a representation where sparsity is a coordinate and the interpolation path is dictated rather than chosen. Two limits are exact: rank-one graphexes have transitivity fixed by the degree profile, so high-clustering graphs lie outside the class; and under snowball or random-walk crawls every method here fails, the design-based oracle worst of all (7.8%7.8\% to 588%588\%).
Sep 28, 2026

Attention Graphons: A Graph Limit Perspective on Graph Transformers

Graph Transformers produce, for each attention head, a dense n×nn\times n matrix of learned pairwise interactions. We ask a fundamental question: do these attention-induced graphs converge to a stable limit object as nn grows, or does the learned interaction pattern remain unstructured and size-dependent? We answer this using dense graph limit theory, treating each attention matrix as a finite sample from an underlying kernel---an attention graphon---and studying concentration around this limit under the cut-distance. We derive a worst-case variance bound requiring no assumptions on the graphon, and a sharper regularity-aware bound based on nonparametric estimation theory. To operationalize the theory, we propose a canonicalize-then-block-average pipeline for estimating dataset-level attention graphons, and a variance-based diagnostic for testing whether attention admits a stable continuum description. Experiments across multiple graph benchmarks show that learned attention stabilizes to dataset-specific graphon structure on several datasets; that empirical cut-distance and cut-norm variance decreases with nn consistent with our bounds; and that attention graphons transfer to larger graph sizes with error decreasing in nn.
Jun 12, 2026

Recovery thresholds for hidden weighted sparse graphs

Recovering structural information from noisy high-dimensional data is a fundamental task in statistical inference. We investigate the recovery thresholds for a graph hidden in a randomly weighted complete graph. Specifically, an unknown graph H∗∈HnH^* \in H_n is chosen uniformly at random, and hidden in a complete graph of nn vertices as follows: the weight of an edge e∈He \in H is distributed independently according to PnP_n; otherwise the weight is distributed independently according to QnQ_n. The goal is to recover almost all of HH from these edge weights. Assuming a local Lipschitzness of the Rényi divergence between distributions PnP_n and QnQ_n, and a mild density condition for the graphs HnH_n, we give a unified characterization of the information-theoretic limit for recovering almost all of HH (also known as almost exact recovery). Our characterization connects the KL divergence between PnP_n and QnQ_n to the logarithm of the first moment threshold of HH in the Erdős-Rényi random graph model G(n,p)G(n,p). Our lower bound also extends to the task of partial recovery, in which only a constant λλ-fraction of HH needs to be recovered. Last but not least, for certain Bernoulli and Exponential regimes, and for Gaussian distributions, we are able to show an All-or-Nothing (AoN) threshold phenomenon at the exponential scale.