Harnessing Data Asymmetry: Manifold Learning in the Finsler World
Organizations: Technion – Israel Institute of Technology · Technical University of Munich · Munich Center for Machine Learning · University of Oxford
Abstract
Manifold learning is a fundamental task at the core of data analysis and visualisation. It aims to capture the simple underlying structure of complex high-dimensional data by preserving pairwise dissimilarities in low-dimensional embeddings. Traditional methods rely on symmetric Riemannian geometry, thus forcing symmetric dissimilarities and embedding spaces, e.g. Euclidean. However, this discards in practice valuable asymmetric information inherent to the non-uniformity of data samples. We suggest to harness this asymmetry by switching to Finsler geometry, an asymmetric generalisation of Riemannian geometry, and propose a Finsler manifold learning pipeline that constructs asymmetric dissimilarities and embeds in a Finsler space. This greatly broadens the applicability of existing asymmetric embedders beyond traditionally directed data to any data. We also modernise asymmetric embedders by generalising current reference methods to asymmetry, like Finsler t-SNE and Finsler Umap. On controlled synthetic and large real datasets, we show that our asymmetric pipeline reveals valuable information lost in the traditional pipeline, e.g. density hierarchies, and consistently provides superior quality embeddings than their Euclidean counterparts.
Figures & tables
| Data | Isomap | t-SNE | Umap | Finsler MDS | Finsler t-SNE | Finsler Umap |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Label-related scores | Label-unrelated scores | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | AMI (+) | ARI (+) | NMI (+) | HOM (+) | COM (+) | V-M (+) | FMI (+) | SIL (+) | DBI (–) | CHI (+) | |
| Iris | Umap | 0,724 ( 0,248) | 0,688 ( 0,241) | 0,728 ( 0,245) | 0,719 ( 0,243) | 0,737 ( 0,247) | 0,728 ( 0,245) | 0,794 ( 0,159) | 0,721 ( 0,019) | 0,389 ( 0,025) | 2526 ( 1202) | |
| Finsler Umap (Ours) | 0,794 ( 0,024) | 0,746 ( 0,032) | 0,796 ( 0,023) | 0,785 ( 0,026) | 0,808 ( 0,020) | 0,796 ( 0,023) | 0,832 ( 0,020) | 0,705 ( 0,036) | 0,412 ( 0,047) | 1471 ( 331) | ||
| MNIST | Umap | 0,847 ( 0,017) | 0,782 ( 0,040) | 0,847 ( 0,017) | 0,839 ( 0,019) | 0,855 ( 0,015) | 0,847 ( 0,017) | 0,805 ( 0,035) | 0,580 ( 0,018) | 0,606 ( 0,033) | 194060 ( 19078) | |
| Finsler Umap (Ours) | 0,858 ( 0,012) | 0,793 ( 0,032) | 0,858 ( 0,012) | 0,848 ( 0,014) | 0,868 ( 0,011) | 0,858 ( 0,012) | 0,816 ( 0,028) | 0,611 ( 0,029) | 0,585 ( 0,060) | 119299 ( 10201) | ||
| Fashion-MNIST | Umap | 0,616 ( 0,009) | 0,445 ( 0,028) | 0,617 ( 0,009) | 0,610 ( 0,011) | 0,623 ( 0,008) | 0,617 ( 0,009) | 0,503 ( 0,024) | 0,491 ( 0,017) | 0,738 ( 0,039) | 173803 ( 3963) | |
| Label-related scores | Label-unrelated scores | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | AMI (+) | ARI (+) | NMI (+) | HOM (+) | COM (+) | V-M (+) | FMI (+) | SIL (+) | DBI (–) | CHI (+) | |
| Iris | t-SNE | 0,829 | 0,851 | 0,831 | 0,831 | 0,831 | 0,831 | 0,900 | 0,665 | 0,453 | 3028 | |
| Finsler t-SNE (Ours) | 0,845 | 0,868 | 0,846 | 0,846 | 0,847 | 0,846 | 0,911 | 0,664 | 0,465 | 4822 | ||
| DTD | t-SNE | 0,498 | 0,288 | 0,581 | 0,578 | 0,584 | 0,581 | 0,303 | 0,402 | 0,804 | 2492 | |
| Finsler t-SNE (Ours) | 0,504 | 0,294 | 0,585 | 0,580 | 0,590 | 0,585 | 0,310 | 0,408 | 0,859 | 1186 | ||
| Caltech101 | t-SNE | 0,804 | 0,377 | 0,830 | 0,865 | 0,798 | 0,830 | 0,428 | 0,547 | 0,610 | 23151 | |
| Supervised Evaluator | Embedding | DTD | Caltech101 | OxfordFlowers102 | OxfordIIITPet | Imagenette |
|---|---|---|---|---|---|---|
| 5-NN classifier | UMAP | 0.51 | 0.87 | 0.55 | 0.92 | 0.98 |
| Finsler UMAP | 0.56 | 0.88 | 0.62 | 0.93 | 0.98 | |
| t-SNE | 0.57 | 0.88 | 0.63 | 0.92 | 0.98 | |
| Finsler t-SNE | 0.58 | 0.88 | 0.62 | 0.92 | 0.98 | |
| Linear classifier | UMAP | 0.34 | 0.53 | 0.37 | 0.80 | 0.97 |
| Finsler UMAP | 0.43 | 0.66 | 0.48 | 0.87 | 0.98 |
| Label-related scores | Label-unrelated scores | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | Dimensionality | AMI (+) | ARI (+) | NMI (+) | HOM (+) | COM (+) | V-M (+) | FMI (+) | SIL (+) | DBI (–) | CHI (+) | |
| CIFAR10 | Umap | 2 | 0,654 ( 0,327) | 0,619 ( 0,310) | 0,654 ( 0,327) | 0,651 ( 0,325) | 0,656 ( 0,328) | 0,654 ( 0,327) | 0,658 ( 0,279) | 0,585 ( 0,115) | 0,570 ( 0,128) | 239743 ( 98339) | |
| Finsler Umap (Ours) | 2 | 0,817 ( 0,009) | 0,767 ( 0,029) | 0,817 ( 0,009) | 0,812 ( 0,013) | 0,822 ( 0,005) | 0,817 ( 0,009) | 0,791 ( 0,024) | 0,647 ( 0,016) | 0,516 ( 0,033) | 187999 ( 11072) | ||
| Umap | 5 | 0,814 ( 0,011) | 0,763 ( 0,023) | 0,814 ( 0,011) | 0,810 ( 0,012) | 0,819 ( 0,009) | 0,814 ( 0,011) | 0,788 ( 0,020) | 0,634 ( 0,013) | 0,546 ( 0,038) | 228691 ( 12209) | ||
| Finsler Umap (Ours) | 5 | 0,815 ( 0,011) | 0,767 ( 0,025) | 0,815 ( 0,011) | 0,811 ( 0,013) | 0,820 ( 0,009) | 0,815 ( 0,011) | 0,791 ( 0,021) | 0,638 ( 0,015) | 0,541 ( 0,045) | 173549 ( 11579) | ||
| Umap | 10 | 0,816 ( 0,010) | 0,770 ( 0,014) | 0,816 ( 0,010) | 0,812 ( 0,010) | 0,820 ( 0,009) | 0,816 ( 0,010) | 0,794 ( 0,012) | 0,637 ( 0,012) | 0,538 ( 0,034) | 233395 ( 9628) | ||
| Label-related scores | Label-unrelated scores | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | AMI (+) | ARI (+) | NMI (+) | HOM (+) | COM (+) | V-M (+) | FMI (+) | SIL (+) | DBI (–) | CHI (+) | ||
| Iris | Umap | — | 0,724 ( 0,248) | 0,688 ( 0,241) | 0,728 ( 0,245) | 0,719 ( 0,243) | 0,737 ( 0,247) | 0,728 ( 0,245) | 0,794 ( 0,159) | 0,721 ( 0,019) | 0,389 ( 0,025) | 2526 ( 1202) | |
| Finsler Umap (Ours) | 0,5 | 0,626 ( 0,313) | 0,584 ( 0,293) | 0,630 ( 0,309) | 0,620 ( 0,304) | 0,641 ( 0,314) | 0,630 ( 0,309) | 0,726 ( 0,194) | 0,742 ( 0,063) | 0,418 ( 0,113) | 912 ( 778) | ||
| Finsler Umap (Ours) | 0,1 | 0,719 ( 0,242) | 0,677 ( 0,228) | 0,723 ( 0,239) | 0,713 ( 0,236) | 0,732 ( 0,242) | 0,723 ( 0,239) | 0,786 ( 0,151) | 0,731 ( 0,021) | 0,382 ( 0,027) | 1760 ( 493) | ||
| Finsler Umap (Ours) | 0,01 | 0,722 ( 0,243) | 0,683 ( 0,230) | 0,726 ( 0,240) | 0,717 ( 0,237) | 0,735 ( 0,243) | 0,726 ( 0,240) | 0,790 ( 0,152) | 0,717 ( 0,018) | 0,402 ( 0,031) | 1485 ( 275) | ||
| Finsler Umap (Ours) | 0,001 | 0,794 ( 0,024) | 0,746 ( 0,032) | 0,796 ( 0,023) | 0,785 ( 0,026) | 0,808 ( 0,020) | 0,796 ( 0,023) | 0,832 ( 0,020) | 0,705 ( 0,036) | 0,412 ( 0,047) | 1471 ( 331) | ||
| Label-related scores | Label-unrelated scores | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dataset | Method | AMI (+) | ARI (+) | NMI (+) | HOM (+) | COM (+) | V-M (+) | FMI (+) | SIL (+) | DBI (–) | CHI (+) | ||
| Iris | t-SNE | — | 0,829 | 0,851 | 0,831 | 0,831 | 0,831 | 0,831 | 0,900 | 0,665 | 0,453 | 3028 | |
| Finsler t-SNE (Ours) | 0,5 | 0,845 | 0,868 | 0,846 | 0,846 | 0,847 | 0,846 | 0,911 | 0,664 | 0,465 | 4822 | ||
| Finsler t-SNE (Ours) | 0,1 | 0,835 | 0,851 | 0,837 | 0,836 | 0,837 | 0,837 | 0,900 | 0,659 | 0,465 | 5092 | ||
| Finsler t-SNE (Ours) | 0,01 | 0,835 | 0,851 | 0,837 | 0,836 | 0,837 | 0,837 | 0,900 | 0,670 | 0,442 | 5063 | ||
| Finsler t-SNE (Ours) | 0,001 | 0,835 | 0,851 | 0,837 | 0,836 | 0,837 | 0,837 | 0,900 | 0,663 | 0,450 | 5263 | ||