Self-Supervised Lexical Representation Learning for Fast, Large-Scale Phylogenetic Inference
Abstract
Computational phylogenetics has become an essential tool in historical linguistics, yet its application at a global scale remains constrained by two factors: the labor-intensive manual annotation of cognacy judgments required for character-based methods and the substantial computational cost of inference on large datasets. This paper introduces a fully self-supervised contrastive learning framework that learns lexical representations directly from raw IPA-transcribed wordlists, without requiring cognacy annotations, alignments, or additional expert input. The model employs a dual contrastive objective: a word-level loss that organizes phonetically similar forms into a coherent space, and an auxiliary language-level loss that encourages the lexical space to reflect broader phonological properties of languages. From the resulting word representations, pairwise language distances are derived and used to infer a global phylogenetic tree of 3,399 language varieties. The inferred tree achieves a generalized quartet distance (GQD) to the Glottolog reference tree competitive with multiple baselines, while requiring only minutes of computation on a standard notebook GPU. Furthermore, the same representations capture diachronic concept stability: variance in pairwise distances across languages yields stability rankings that correlate significantly with established rankings. Ablation studies confirm that both the language-level objective and the use of phonetic feature vectors improved the inferred trees topology with regards to GQD. The framework thus provides a computationally efficient and fully automatic alternative for large-scale phylogenetic inference and offers a unified representation supporting downstream analyses at both the language and concept level.
Figures & tables
| Parameter | Value |
|---|---|
| Embedding dimension | 256 |
| Encoder layers | 1 |
| Encoder heads | 4 |
| Learning rate | 0.001 |
| Number of languages | 32 |
| Number of concepts | 30 |
| Method | GQD | F1 |
|---|---|---|
| LDN | 0.0468 | 0.9639 |
| pHMM | 0.0692 | 0.9636 |
| MSA ( Jäger, 2026 ) | 0.0433 | 0.959 |
| DualCWE (own) | 0.0346 (0.003) | 0.955 |
| Ranking | Overlap | Spearman r | p-value |
|---|---|---|---|
| Holman et al. (2008) + | 69 (100) | ||
| Pagel et al. (2007) - | 97 (200) | ||
| Petroni and Serva (2011) + | 61 (100) | ||
| Peust (2013) - | 101 (185) | ||
| Rama and Borin (2014) - | 69 (100) | ||
| Tadmor (2009) + | 59 (100) |
| Concept | Avg. Rank | Holman | Pagel | P & S | Peust | Rama | inf | Tadmor | Tad. (rep.) | Mean Disagr. |
|---|---|---|---|---|---|---|---|---|---|---|
| FATHER | 1.4 | - | 56 | 26 | 34 | - | 27 | - | 105 | 49.6 |
| MOTHER | 1.6 | - | 59 | 1 | 48 | - | 20 | 84 | 42.4 | |
| I | 3.4 | 2 | -2 | - | 1 | -2 | 1 | 10 | 6 | 2.29 |
| AND | 3.6 | 79 | - | - | - | -3 | - | 65 | 47.0 | |
| HORSE | 6.2 | - | - | - | - | - | 64 | - | 117 | 90.5 |
| FIVE | 6.2 | - | -4 | 20 | -4 | - | 50 | - | 96 | 31.6 |
| Setting | GQD |
|---|---|
| Original | 0.0346 |
| No language encoder | 0.044 |
| No language encoder, 4 epochs, 0.05 temp. | 0.071 |
| No language embeddings | 0.054 |
| ASJP encoding | 0.053 |
| IPA encoding | 0.049 |
Phylogenetic Inference
Phylogenetic inference reconstructs evolutionary relationships and divergence histories from genetic, morphological, linguistic, or other inherited traits.
See all 12 papers