stat.MLAug 29, 2026

Uniform Statistical Convergence of Empirical Sinkhorn Potentials with Exponential and Polynomial Dependence on the Regularization Parameter

Authors: Denis Belomestny

Organizations: Department of Mathematics, University of Duisburg-Essen

Abstract

We study the empirical Sinkhorn estimator of the entropic optimal transport potentials under the uniform loss. Since the potentials are only unique up to additive constants, we measure the error using the quotient supremum norm, defined as d∞([u],[v])=inf⁡a∈R∥u−v−a∥∞d_\infty([u],[v]) = \inf_{a\in\mathbb{R}}\|u-v-a\|_\infty. For a fixed regularization parameter ε>0\varepsilon>0, we establish a non-asymptotic statistical rate of n−1/2n^{-1/2}. This is achieved by combining the Birkhoff-Hopf contraction theorem with entropy bounds on normalized kernel sections. However, the constant in this bound grows exponentially with 1/ε1/ε. To improve this, we isolate geometric conditions under which the empirical estimator maintains the n−1/2n^{-1/2} rate but features polynomial dependence on 1/ε1/\varepsilon. The key requirement is a polynomial residual-stability estimate for the population Sinkhorn map. We provide sufficient criteria for this, including a polynomial contraction property and a local inverse estimate. Furthermore, we introduce two rigorously verifiable model classes an ε\varepsilon-weak residual-interaction class obtained after separable centering and another based on connected tight-edge graphs for fixed discrete costs where the polynomial rate is guaranteed without relying on abstract resolvent assumptions. Finally, we establish matching minimax lower bounds demonstrating that the εn−1/2\varepsilon n^{-1/2} rate cannot be uniformly improved in the bounded-interaction regime.

Explore similar work

Sep 22, 2026

Statistical Rates for Entropic Optimal Transport in the Discrete to SubGaussian Regime

We study statistical rates in entropic optimal transport in the semi-discrete regime where one measure has finite support and the other is subGaussian. Our main result establishes parametric convergence rates for the empirical dual potentials to their population counterparts, with no dimension dependence in the leading term. Our result relies on tailored strong concavity analysis of the semi-dual objective, coupled with specialized bounds for the semi-discrete potentials. As a consequence, we obtain fast rates for downstream quantities derived from the optimal coupling. Chiefly, the empirical barycentric projection achieves a squared-error rate n−1n^{-1}, matching the fully compact case and improving over the less favorable n−1/2n^{-1/2} rate known for fully subGaussian settings. Altogether, these results may indicate a lower complexity adaptation phenomenon whereby the statistical complexity of the barycentric projection is governed by the discrete measure. As an application, we analyze Sinkhorn-EM, an EM-type algorithm in which the E-step is replaced by an entropic optimal transport problem. In a well-specified and balanced two-component Gaussian mixture model, we prove n\sqrt{n}-consistency of the empirical iterates to their population counterparts for any fixed number of iterations, matching classical EM rates up to a log⁡n\sqrt{\log n} factor. Simulations support the theory.
Apr 4, 2026

On the Efficiency of Sinkhorn-Knopp for Entropically Regularized Optimal Transport

The Sinkhorn--Knopp (SK) algorithm is a cornerstone method for matrix scaling and entropically regularized optimal transport (EOT). Despite its empirical efficiency, existing theoretical guarantees to achieve a target marginal accuracy ε\varepsilon deteriorate severely in the presence of outliers, bottlenecked either by the global maximum regularized cost η∥C∥∞η\|C\|_\infty (where ηη is the regularization parameter and CC the cost matrix) or the matrix's minimum-to-maximum entry ratio νν. This creates a fundamental disconnect between theory and practice. In this paper, we resolve this discrepancy. For EOT, we introduce the novel concept of well-boundedness, a local bulk mass property that rigorously isolates the well-behaved portion of the data from extreme outliers. We prove that governed by this fundamental notion, SK recovers the target transport plan for a problem of dimension nn in O(log⁡n−log⁡ε)O(\log n - \log \varepsilon) iterations, completely independent of the regularized cost η∥C∥∞η\|C\|_\infty. Furthermore, we show that a virtually cost-free pre-scaling step eliminates the dimensional dependence entirely, accelerating convergence to a strictly dimension-free O(log⁡(1/ε))O(\log(1/\varepsilon)) iterations. Beyond EOT, we establish a sharp phase transition for general (u,v)(\boldsymbol{u},\boldsymbol{v})-scaling governed by a critical matrix density threshold. We prove that when a matrix's density exceeds this threshold, the iteration complexity is strictly independent of νν. Conversely, when the density falls below this threshold, the dependence on νν becomes unavoidable; in this sub-critical regime, we construct instances where SK requires Ω(n/ε)Ω(n/\varepsilon) iterations.
Oct 27, 2026

Second-order Sinkhorn Geometry and n\sqrt{n}-Inference

The Sinkhorn divergence, a debiased form of entropic optimal transport, has been widely used in various scientific disciplines due to its computational and statistical tractability. Unlike the Wasserstein distance, however, the Sinkhorn divergence is not a metric and it does not naturally admit a formal Riemannian structure. These properties are central to many applications of optimal transport methods that utilize interpolation, barycentric averaging, parallel transport or other geometric operations. Recent work addresses these shortcomings by constructing a formal Riemannian tangent space and a metric tensor on the space of probability measures that quadratically approximates the Sinkhorn divergence. In this work, we extend this framework with two major threads of contributions. For a suitable class of finite-smoothness cost functions, we prove Hadamard differentiability of the Sinkhorn metric tensor and we derive the Levi-Civita covariant derivative in this geometry; we then use the covariant derivative to obtain the geodesic and parallel transport equations, each of which amount to an ODE on a fixed Reproducing Kernel Hilbert Space (RKHS) with smooth coefficients. Our second contribution is to linearize the solutions to the geodesic and parallel transport equations using standard tools from Banach space ODE theory. We show that under standard regularity conditions these linearizations imply n\sqrt{n}-limiting Gaussian processes centered at population values for the plugin estimators of the exponential map, the logarithmic map, parallel transport and the induced Sinkhorn distance. Moreover, we show that the nonparametric bootstrap is consistent for all objects mentioned. To the best of our knowledge, these are the first n\sqrt{n}--limit theorems and bootstrap consistency results for canonical geometric operations in a transport-based geometry on the space of probability measures.