Organizations: College of Connected Computing, Vanderbilt University · Toyota Motor North America, InfoTech Labs · Department of Computer Science, University of California, Davis · Department of Mathematics, Purdue University · Department of Mathematics, Florida State University
Many modern learning problems require comparing probability distributions whose individual observations are themselves probability measures, naturally giving rise to meta-measures in P(P(Ω)). However, optimal transport distances on this space can be prohibitively expensive to evaluate. We introduce the vertical sliced Wasserstein (VSW) distance, a scalable metric on P(P(Ω)). Rather than slicing along the transport geometry of P(Ω), VSW projects each inner measure using continuous test functions and compares the resulting one-dimensional distributions with one-dimensional Wasserstein distance. We prove that VSW is a valid metric on P(P(Ω)), metrizes weak convergence, and admits dimension-independent statistical convergence guarantees. Empirically, VSW provides high accuracy and efficiency compared with existing distances for meta-measures. We further derive a practical particle gradient for the empirical VSW22 objective and demonstrate its use for gradient-based transport of meta-measures. VSW provides a simple and scalable alternative for comparing and optimizing distributions of distributions.
Figures & tables
Figure 1: Statistical complexity analysis for empirical meta-measures X,Y . Setup in Appendix F . The outer law has three atoms, so the N−1/2 reference for VSW22 corresponds to the atomic-outer rate (Remark C.2 ). Left: distance error against a 105 -slice reference. Right: X,Y share component labels to isolate inner sampling error.
Figure 2: Pearson and Spearman correlations with exact OTDD versus the number of slices, computed over 30 pairs per dataset. Both sub-datasets in a pair are drawn from the same training set and have equal size ( 5,000 – 10,000 samples); sizes vary across pairs.
Figure 3: Runtime (s) vs the dataset size (each of 2 sets). VSW remains fastest among all methods.
OT-NNA
WoW
DSW
VSW (Ours)
runtime (s)
6077.65†
3094.22†
0.0709±0.00017
0.0125±0.00003
Table 1: Wall-clock time of a single distance evaluation between the 662 ground-truth ShapeNet chairs and 662 generated samples ( 2048 points per cloud). † denotes a single run.
Figure 4: Point cloud comparison metric trends.
Figure 5: Comparing image distributions via patch distributions. VSW remains the fastest method, while achieving the same trend as baselines.
Figure 6: Particle optimization toward fixed ImageNet targets in pixel space (Left) , and in a 2D PCA projection of CLIP ViT-L/14 embeddings (Right) .
Figure 7: Parametric generation on Checkerboard and 8-Gaussians datasets.
Distance
2D Shapes
Animals
FAUST-500
FAUST-1000
MNIST-2000
Acc. (%)
Time (ms)
Acc. (%)
Time (ms)
Acc. (%)
Time (ms)
Acc. (%)
Time (ms)
Acc. (%)
Time (ms)
VSW
97.7±2.6
0.35
99.0±1.3
0.34
39.0±5.5
2.80
41.2±6.0
3.76
96.5±3.4
7.48
SQW
99.4±1.2
0.93
99.3±1.0
0.95
37.5±5.5
6.51
40.8±6.0
10.15
86.0±4.3
18.46
TLB
100.0±0.2
0.91
100.0±0.0
0.97
36.7±5.6
40.96
40.2±6.0
163.06
95.5±3.3
653.84
STLB
98.5±2.0
0.99
99.0±1.3
1.00
35.2±5.5
10.01
38.4±5.9
10.65
82.2±3.8
18.36
AE
99.7±0.8
0.13
97.9±1.8
0.13
37.5±5.7
2.63
42.0±5.9
4.46
93.2±4.0
19.79
Table 2: Shape classification with KNN (Acc., ↑ ) and runtime per distance computation (Time).
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Method
Correlation with OTDD ( ↑ )
Time per evaluation (ms, ↓ )
Pearson
Spearman
5 – 10 k
104
6×104
Matched slicing budget L=S=103
VSW, R=8
0.6030±0.0548
0.6015±0.0695
3.4
3.2
12.8
VSW, R=16
0.7931±0.0362
0.7750±0.0519
3.6
3.8
17.7
VSW, R=32
0.7698±0.0393
0.7623±0.0653
4.6
4.8
25.3
VSW, R=64
0.8044±0.0164
0.8174±0.0309
5.6
6.5
36.4
Appendix
Table 3: Ablation on the number of random Fourier features R on FashionMNIST, at the two matched slicing budgets L=S=103 (top) and L=S=104 (bottom). Each entry is the mean ± standard deviation over 5 independent draws of the features and slices. Times are per distance evaluation: on the 30 pairs at their own sizes, at a fixed size of 104 , and on the full training set of 6×104 .
We introduce the observable Wasserstein distance, a framework for deriving lower bounds on the Wasserstein distance between probability measures on Polish metric spaces, designed to bypass the computational intractability of exact optimal transport in large-scale, non-Euclidean datasets. Analogous to the sliced Wasserstein distance in Rd, our approach projects measures onto the real line via 1-Lipschitz observables and computes the Wasserstein distances between the resulting pushforward distributions. We define a hierarchy of pseudo-metrics by restricting observables to a nested chain of subspaces. A central theoretical contribution is an injectivity result linking the metric covering dimension of the support of a measure to the specific order in the hierarchy that guarantees unique recovery. This serves as a metric-space analogue to the Cramér-Wold Device for Euclidean distributions. We demonstrate that this hierarchy offers a tunable trade-off between sharpness as a lower bound on the Wasserstein distance and computational efficiency. We also present a discrete computational model for finite grids and numerical experiments validating the efficacy and utility of these approximations.
Edivaldo Lopes dos Santos, Leandro Vicente Mauri, Washington Mio +1
1Departamento de Matem´atica, Universidade Federal de S˜ao Carlos, Brazil · Department of Mathematics, Florida State University, USA
The Sliced Wasserstein (SW) distance has emerged as a computationally attractive alternative to the Wasserstein distance by leveraging one-dimensional optimal transport along random projections. Standard estimators of the SW distance rely on Monte Carlo averages of one-dimensional Wasserstein distances computed via quantile functions, which require sorting projected samples and access to full datasets. In this work, we introduce a new class of estimators for the Sliced Wasserstein distance based on cumulative distribution functions (CDFs) of projected measures, that avoid sorting and scale via massive dataset parallelism. This class includes several estimators, some of them being indexed by hyperparameters controlling their variance or smoothness. We show that they are especially well suited to scenarios in which CDFs are more tractable than quantile functions, such as mixtures of Gaussians, and moreover that they are also naturally compatible with federated learning, since CDFs of projected data can be computed and aggregated locally without requiring the exchange of raw samples.
Christophe Vauthier, Quentin Mérigot, Anna Korba
Laboratoire de Mathématiques d’Orsay, Université Paris-Saclay Gif-sur-Yvette, France · Centre de recherche en économie et statistique, ENSAE Palaiseau, France
We propose sliced Orlicz-Wasserstein (SOW) distance which is a generalization of sliced Wasserstein (SW) distance. SOW replaces the Lp norm in SW with a Luxemburg norm cost induced by an Orlicz function φ. First, we prove that SOW distance is a metric on the space of measures with finite Orlicz norm, and show that it recovers the SW distance when the Orlicz function is φ(x)=xp. Next, we derive the topological properties of the SOW distance. In particular, we show that convergence under SOW implies weak convergence, and the converse is true under the compact support condition. We then present the theoretical results for estimating the SOW distance. We derive sample complexity for both the distance itself and the powered functional of the distance, and prove their minimax optimality. In addition, we discuss the computational algorithm for approximating the SOW distance by Monte-Carlo estimation and bisection search, as well as the associated approximation error and computational complexity analysis. Our experimental results reveal the superior computational efficiency of SOW compared with Orlicz-Wasserstein (OW) distance. Also, in the experiments, we demonstrate the favorable flexibility of SOW distance over SW in detecting differences between distributions by comparing their performance in two-sample tests and evaluating generative models on image datasets.
Binh Thuan Tran, Khai Nguyen
LAMA, LIGM, Université Gustave Eiffel · Department of Statistics and Data Science, Texas A&M University