cs.AIOct 30, 2026

Differential rank preservation manifold learning

Authors: Henry Han, Luyu Niu, Diane Li, Jiacun Wang

Organizations: Data Science and AI Innovation Laboratory, Department of Computer Science, Baylor University, Waco, TX, 76798, USA · Department of Business, Management and Accounting, University of Maryland Eastern Shore, Princess Anne, MD, 21853, USA · Department of Computer Science and Software Engineering, Monmouth University, West Long Branch, NJ, 07764, USA

Abstract

Manifold learning methods like t-SNE and UMAP preserve local neighborhoods, but they do not preserve the ranking of the neighbors inside them. Two embeddings can return the same neighbor set while disagreeing on which point is closest. This loss of order degrades downstream applications that value the order in the embedding. We propose Smooth Rank t-SNE (SR-tSNE), which adds a differentiable rank term to the standard t-SNE loss. To enable efficient training, this term uses a sigmoid rank approximation to explicitly force a point's true high-dimensional neighbors to outrank unrelated intruders and retain their original order. We also introduce Ordinal DLP (O-DLP), an extension of the Degree of Locality Preservation (DLP) metric that credits a neighbor only when it returns at its original rank. Across eight benchmarks spanning image, text, speech, remote-sensing and single-cell data, SR-tSNE outperforms 12 baselines in rank preservation and neighborhood overlap. Ablation studies demonstrate our rank term alone boosts O-DLP by 5% to 28%, a gain not achievable using standard pairwise loss. This advantage transfers to downstream applications. SR-tSNE achieves the best label-transfer performance across seven vision datasets. For cell-type discovery across six single-cell datasets, it ranks first in 17 of 18 dataset-metric combinations, whether clustering resolution is selected with or without cell-type labels. In intraday trading, SR-tSNE achieves higher returns, lower risk, and lower turnover than the baselines. To our knowledge, SR-tSNE is the first t-SNE-family method with explicit order preservation.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. How smoothing the affinity matrix affects neighborhood preservation in t-SNE

    Aug 17, 2026Shirin Mohebi, Guillaume Bied, Jefrey LijffijtDimensionality Reduction

  2. DMT-Dens: Density-preserving manifold visualization for biological data

    Aug 18, 2026Ruizhe Wang, Yixuan Dong, Bolin Yang +3Dimensionality ReductionManifold Learning