stat.MLJul 7, 2026
SaveOn the convergence of graph Laplacians with a symmetric divergence
Organizations: Program in Applied and Computational Mathematics, Princeton University
Abstract
When analyzing a manifold learning algorithm for data lying on a smooth, compact, connected Riemannian submanifold of , a key estimate for the geodesic distance is that there exists such that for all . We observe that more generally, when is equipped with a smooth symmetric divergence satisfying a non-degeneracy condition and is given by for all , there exists such that for all . We demonstrate that this is sufficient for the pointwise convergence of graph Laplacians constructed with and discuss examples where is given by the Sinkhorn divergence on a family of probability measures parametrized by a manifold.
Explore similar work
We consider graph diffusion processes constructed from finite i.i.d. samples drawn from an unknown manifold embedded in ambient Euclidean space, where the graph affinity is defined by an ambient Gaussian kernel matrix. We show that the manifold heat semigroup can be approximated directly by iterating the graph transition matrix , under only low regularity assumptions on the test function , including the case . We bound in -norm, with the operator application to properly defined, and we recover the classical graph-Laplacian pointwise rate up to logarithmic factors, for diffusion times up to and longer. The rate holds for in-sample error as well as out-of-sample generalization, where the estimator of at a new point is defined via kernel convolution. To handle non-uniform sampling densities on the manifold, we introduce a right-normalization of the graph transition matrix; under the assumption that the sampling density is and bounded away from zero, the same convergence rates hold. We numerically demonstrate the performance of the proposed estimator on simulated data.
Difference-of-Convex Regularization for Graph Learning by Differentiable Programming
Laplacian-regularized minimization is fundamental in signal processing and machine learning, but is limited by the dense and ill-conditioned nature of the graph Laplacian pseudoinverse. While the Laplacian itself is sparse, its pseudoinverse is dense and often ill-conditioned, rendering direct computation impractical at scale. Moreover, pseudoinverse learning is more challenging than Laplacian learning. To address this challenge, this paper considers the setting where the graph Laplacian is given and proposes a Difference-of-Convex Regularizer (DCR) graph learning framework that approximates the spectral action of the Laplacian pseudoinverse without direct inversion via regularized Maximum Likelihood Estimation (MLE). By reformulating Laplacian-Regularized Nonnegative Least Squares (LR-NNLS) through a dual representation, DCR decouples pseudoinverse learning from instance-specific inference and enables efficient primal solution reconstruction via a differentiable dual-guided learning scheme. We establish theoretical guarantees on stability and the existence of a unique fixed point for DCR algorithm. Numerical experiments demonstrate improved performance over convex solvers and graph filtering baselines and robust performance across diverse graph topologies.
Finsler Geometry, Graph Neural Networks, and You
Graph neural network architectures based on the graph Laplacian approximate the Laplace-Beltrami operator, thus limiting their application to isotropic operators. As a nonlinear alternative to the Laplace-Beltrami operator, we consider estimates of the Finsler Laplacian on point clouds sampled from a manifold. We prove that these discrete estimates converge to the true operator on the manifold as the number of point samples grows. Moreover, we show that this operator can be expressed as a graph neural network layer, which we use to define a family of Finslerian graph neural networks constrained to express Finsler geometry. We show that Finslerian graph neural networks recover the geometry underlying nonlinear diffusion equations in practice.