stat.MLMar 21, 2026

Sinkhorn Based Associative Memory Retrieval Using Spherical Hellinger Kantorovich Dynamics

Authors: Aratrika Mustafi, Soumya Mukherjee

Organizations: Department of Statistics, Pennsylvania State University

Abstract

We propose a dense associative memory for empirical measures (weighted point clouds). Stored patterns and queries are finitely supported probability measures, and retrieval is defined by minimizing a Hopfield-style log-sum-exp energy built from the debiased Sinkhorn divergence. We derive retrieval dynamics as a spherical Hellinger Kantorovich (SHK) gradient flow, which updates both support locations and weights. Discretizing the flow yields a deterministic algorithm that uses Sinkhorn potentials to compute barycentric transport steps and a multiplicative simplex reweighting. Under local separation and PL-type conditions we prove basin invariance, geometric convergence to a local minimizer, and a bound showing the minimizer remains close to the corresponding stored pattern. Under a random pattern model, we further show that these Sinkhorn basins are disjoint with high probability, implying exponential capacity in the ambient dimension. Experiments on synthetic Gaussian point-cloud memories demonstrate robust recovery from perturbed queries versus a Euclidean Hopfield-type baseline.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Phase Kernel Lifts Capacity of Dense Associative Memory

    Oct 15, 2026Yifei Zhao, Ying TangHopfield NetworksAssociative Memory

  2. Intrinsic Associative Memory on Riemannian Manifolds: Curvature, Capacity, and Emergent Modes

    Sep 28, 2026Krishnakumar Balasubramanian, Zhaoyang ShiAssociative Memory

  3. Geometric Entropy and Retrieval Phase Transitions in Continuous Thermal Dense Associative Memory

    Apr 8, 2026Tatiana Petrova, Evgeny Polyachenko, Radu StateAssociative MemoryHopfield Networks