Toscani-Fourier Distance on Probability Measures: Wasserstein Control, Topological Equivalence on Model Classes, and Duality
Organizations: Department of Statistics University of Illinois Urbana-Champaign Champaign, IL 61820, USA
Abstract
Comparing probability measures in machine learning trades transport geometry against computational cost: Wasserstein distances encode the geometry of but require solving a transport problem, while kernel discrepancies are cheap to evaluate yet depend delicately on their test class. We study the Toscani--Fourier family , the weighted norm of the difference of two characteristic functions, as a continuous Fourier-side discrepancy on . For we show that is exactly the window in which is finite on , both endpoints already failing for a pair of Dirac measures, and we establish the metric, embedding, and compactness structure of the resulting space, which we prove to be complete. Duality identifies as an integral probability metric over a homogeneous Fourier--Lebesgue ball, with an explicit extremizer when . We prove the global bound , whose exponent is sharp, show that no global converse of any form can hold, and recover topological equivalence with on bounded-support and uniform-tail classes, together with explicit reverse moduli on bounded-support classes that improve the imported energy-kernel exponent at . There, is a constant multiple of the classical energy distance, which yields an exact finite-sample identity for the mean of the empirical discrepancy; the numerical experiments are otherwise diagnostic.
Figures & tables
| slope vs. | RMSE | slope vs. control | RMSE | ||||
|---|---|---|---|---|---|---|---|
| 2 | 2 | 1.6 | 0.6 | 0.994 | 0.124 | 1.443 | 0.164 |
| 2 | 5 | 1.0 | 0.6 | 0.993 | 0.347 | 1.390 | 0.374 |
| 16 | 2 | 8.6 | 0.6 | 0.987 | 0.153 | 1.645 | 0.153 |
| 16 | 5 | 3.8 | 0.6 | 1.013 | 0.327 | 1.687 | 0.327 |
| theory | fitted | rel. gap in | median / 95% rel. err. | |||
|---|---|---|---|---|---|---|
| 2 | 1.6 | 1.2 | 5.6579 | 5.6145 | 0.0077 | 0.187 / 0.739 |
| 16 | 8.6 | 1.2 | 0.8831 | 0.9291 | 0.0521 | 0.342 / 1.081 |
| N-RMSE Spearman Ordinal agr. 32 32 Pixels 1.01 0.3176 0.8782 0.8403 1.34 0.3043 0.8886 0.8461 1.66 0.3000 0.8919 0.8476 1.99 0.2995 0.8918 0.8467 0.41 0.3057 0.8668 0.8229 0.74 0.2870 0.8861 0.8335 1.06 0.2838 0.8892 0.8358 1.39 0.2847 0.8879 0.8343 | N-RMSE Spearman Ordinal agr. 128 128 Pixels 1.01 0.3359 0.8930 0.8469 1.34 0.3172 0.9055 0.8546 1.66 0.3099 0.9116 0.8580 1.99 0.3077 0.9136 0.8585 0.41 0.3325 0.8830 0.8291 0.74 0.3092 0.9014 0.8394 1.06 0.3026 0.9073 0.8429 1.39 0.3019 0.9086 0.8435 |
| N-RMSE Spearman Ordinal agr. 64 64 Pixels 1.01 0.3495 0.8797 0.8365 1.34 0.3403 0.8901 0.8437 1.66 0.3377 0.8938 0.8460 1.99 0.3376 0.8948 0.8461 0.41 0.3565 0.8681 0.8212 0.74 0.3378 0.8901 0.8341 1.06 0.3323 0.8955 0.8379 1.39 0.3309 0.8966 0.8383 | N-RMSE Spearman Ordinal agr. 256 256 Pixels 1.01 0.3661 0.8413 0.8252 1.34 0.3551 0.8529 0.8320 1.66 0.3511 0.8573 0.8346 1.99 0.3498 0.8590 0.8351 0.41 0.3604 0.8165 0.8071 0.74 0.3421 0.8421 0.8189 1.06 0.3360 0.8491 0.8232 1.39 0.3337 0.8513 0.8236 |
| Method | Rejected pairs | Reject rate | Agreement | |
|---|---|---|---|---|
| Sliced Wasserstein | 13/28 | 46.4% | – | |
| Toscani ( ) | 18/28 | 64.3% | 21/28 (75.0%) | |
| Toscani ( ) | 18/28 | 64.3% | 21/28 (75.0%) | |
| Toscani ( ) | 17/28 | 60.7% | 22/28 (78.6%) | |
| Toscani ( ) | 17/28 | 60.7% | 22/28 (78.6%) | |
| Sliced Wasserstein | 19/28 | 67.9% | – |
| Class pair | Sliced | ||||
|---|---|---|---|---|---|
| ClassicImages vs GRFsmooth | Reject | Non-reject | Non-reject | Non-reject | Non-reject |
| GRFmoderate vs Shapes | Non-reject | Reject | Reject | Reject | Reject |
| GRFsmooth vs MicroscopyImages | Non-reject | Reject | Reject | Reject | Reject |
| GRFsmooth vs Shapes | Non-reject | Reject | Reject | Non-reject | Non-reject |
| LogGRF vs MicroscopyImages | Non-reject | Reject | Reject | Reject | Reject |
| LogGRF vs Shapes | Non-reject | Reject | Reject | Reject | Reject |
| Class pair | Sliced | ||||
|---|---|---|---|---|---|
| ClassicImages vs GRFsmooth | Reject | Non-reject | Non-reject | Non-reject | Non-reject |
| ClassicImages vs LogitGRF | Reject | Non-reject | Non-reject | Non-reject | Non-reject |
| GRFsmooth vs Shapes | Reject | Reject | Non-reject | Non-reject | Non-reject |
| LogitGRF vs MicroscopyImages | Non-reject | Non-reject | Non-reject | Non-reject | Reject |
| MicroscopyImages vs Shapes | Reject | Non-reject | Non-reject | Non-reject | Non-reject |
| Metric | 1D cost | Cost for | Optimization |
|---|---|---|---|
| (exact, discrete) | LP on variables | Yes | |
| Sinkhorn / entropic OT | per iter | per iter | Yes (iterative) |
| Sliced with projections | No (projection sorting) | ||
| (sample-based approx.) | No |
| Resolution | Sliced W | Sinkhorn | |||
|---|---|---|---|---|---|
| 2 | 32 | 1.99 | 0.0118 | 0.0593 | 0.0002 |
| 64 | 1.99 | 0.0593 | 1.5615 | 0.0003 | |
| 128 | 1.99 | 0.2525 | 21.2620 | 0.0012 | |
| 256 | 1.99 | 1.5013 | 0.0037 | ||
| 5 | 32 | 1.39 | 0.0126 | 0.0466 | 0.0001 |
| 64 | 1.39 | 0.0561 | 0.7048 | 0.0002 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Class pair | Metric | Bandwidth | -value | Reject | ||
|---|---|---|---|---|---|---|
| ClassicImages vs GRFmoderate | Sliced W | 11.259 | -0.001 | 0.442 | 0 | |
| ClassicImages vs GRFmoderate | Toscani | 1.01 | 0.310 | -0.011 | 0.641 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 1.34 | 0.985 | -0.013 | 0.625 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 1.66 | 3.035 | -0.014 | 0.633 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 1.99 | 9.883 | -0.015 | 0.628 | 0 |
| ClassicImages vs GRFrough | Sliced W | 6.828 | 0.243 | 4.998e-04 | 1 |
| Class pair | Metric | Bandwidth | -value | Reject | ||
|---|---|---|---|---|---|---|
| ClassicImages vs GRFmoderate | Sliced W | 14.727 | -0.006 | 0.501 | 0 | |
| ClassicImages vs GRFmoderate | Toscani | 0.41 | 0.188 | -0.027 | 0.798 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 0.74 | 0.615 | -0.027 | 0.788 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 1.06 | 1.940 | -0.027 | 0.776 | 0 |
| ClassicImages vs GRFmoderate | Toscani | 1.39 | 6.448 | -0.028 | 0.791 | 0 |
| ClassicImages vs GRFrough | Sliced W | 9.430 | 0.240 | 4.998e-04 | 1 |