Overview

Manifold learning seeks compact representations of high-dimensional data by modeling it as lying near a lower-dimensional, possibly curved space, enabling visualization, denoising, scientific analysis, and learning with fewer effective degrees of freedom. Common approaches build neighborhood graphs and optimize UMAP- or t-SNE-style embeddings, recover coordinates or operators with spectral and diffusion methods, or use autoencoders with geometric constraints; Riemannian and optimal-transport methods handle structured objects such as covariance matrices and probability distributions. Work increasingly targets properties beyond nearest-neighbor preservation—including density, geodesic distances, topology, tangent spaces, symmetry, and out-of-sample mapping—in settings from images and single-cell data to networks and dynamical systems. A central challenge is balancing local fidelity against global geometry and computational scale, while noise, sparse or anisotropic sampling, and inconsistent evaluation metrics make it difficult to tell when an embedding reflects the underlying manifold.

Latest papers

124 papers10 papers in the last four weeks, down 23% on the four weeks before. 0.1% of all new papers.

May 30, 2025

Equilibrium Distribution for t-Distributed Stochastic Neighbor Embedding with Generalized Kernels

We extend the results by Auffinger and Fletcher in 2023 on the large-sample limit of t-SNE to a broader class of input and output kernels. We prove that under natural assumptions on the input distribution and the decay of the output kernel, if perplexity scales linearly with data size, the empirical measures and values of minimizers converge to an equilibrium distribution. We conclude with numerical examples comparing different kernels.
Apr 16, 2025

Manifold meta-learning for reduced-complexity neural system identification

System identification has greatly benefited from deep learning techniques, particularly for modeling complex, nonlinear dynamical systems with partially unknown physics where traditional approaches may not be feasible. However, deep learning models often require large datasets and significant computational resources for both training and inference due to their high-dimensional parameterizations. To address this challenge, we propose a meta-learning framework that discovers a low-dimensional manifold within the parameter space of an over-parameterized neural network architecture. This manifold is learned from an abundant meta-dataset of input-output sequences generated by a simulator of the class of systems of interest, and thereafter enables efficient model training while preserving the network's expressive power for the considered system class. Unlike bilevel meta-learning approaches, our method employs an auxiliary neural network to map datasets directly onto the learned manifold, eliminating the need for costly second-order gradient computations during meta-training and generally reducing the number of first-order updates required in inference, which could be expensive for large models. Finally, we derive a probabilistic bound that quantifies the performance gap between training on the learned low-dimensional manifold and the full parameterization. We validate our approach on a family of Bouc-Wen oscillators, which is a well-studied nonlinear system identification benchmark. We demonstrate that we are able to learn accurate models even in small-data scenarios.
Jul 30, 2023

Stay on the Manifold: Hierarchical Bayesian Trajectory-Family Transfer for Sparse-Target Reconstruction and Sampling

Where should reconstructions and new samples lie when a few observations reveal only fragments of a trajectory? We propose hierarchical Bayesian trajectory principal-manifold sampling (HB-TPM), which learns a family of smooth curves from ordered source tasks and adapts it to sparse targets. For unordered vectors, alternating progression assignments and coefficient updates estimate trajectory structure between and beyond the observed shots under the learned source family. Observation-aware extensions connect the trajectory prior to photon arrivals and image-encoded cardiac cycles. Our analysis characterizes the coefficient directions supplied by the prior and bounds sampling error conditional on curve recovery. Across 30 held-out vector tasks, HB-TPM reduces mean sliced-Wasserstein distance by 21.0-41.8% relative to a source-adapted VAE. Prior-strength and sampling ablations identify coefficient shrinkage as the main supported mechanism. On 100 simulated photon records, adaptation lowers mean relative trajectory RMSE by 50.2% versus target-only fitting and 23.6% versus source-mean prediction. Across three training seeds and five folds on 98 cardiac sequences, HB-TPM with latent-MSE training achieves the best mean reconstruction among the tested configurations. Together, the results demonstrate trajectory-family transfer for sparse-target reconstruction and trajectory-centered sampling when source and target tasks share comparable progression structure.
Feb 14, 2023

Linearized Wasserstein dimensionality reduction with approximation guarantees

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability measures rather than points in Rn\mathbb{R}^n, and that finding low-dimensional descriptions of such datasets requires manifold learning algorithms in the Wasserstein space. Most available algorithms are based on computing the pairwise Wasserstein distance matrix, which can be computationally challenging for large datasets in high dimensions. Our algorithm leverages approximation schemes such as Sinkhorn distances and linearized optimal transport to speed-up computations, and in particular, avoids computing a pairwise distance matrix. We provide guarantees on the embedding quality under such approximations, including when explicit descriptions of the probability measures are not available and one must deal with finite samples instead. Experiments demonstrate that LOT Wassmap attains correct embeddings and that the quality improves with increased sample size. We also show how LOT Wassmap significantly reduces the computational cost when compared to algorithms that depend on pairwise distance computations.