Coupled Usage-Sense Processes: Temporal and Attributable Lexical Semantic Change
Organizations: Graduate School of Information Science and Technology The University of Tokyo · The Canon Institute for Global Studies
Abstract
Lexical semantic change is usually summarized by a scalar distance between independently sampled period distributions. This measures how much a word changed, but does not reveal when it changed, which mechanisms and component movements carried the change, or which usages support the attribution. We introduce Coupled Usage--Sense Processes (CUSP), which derives these answers from a single marginal preserving temporal process. A hierarchical coupling relates contextual distributions through latent usage components, while Markov composition makes adjacent and longer span correspondences compatible. Displacement operators quantify change magnitude and timing, split variation exactly between movement of component centers and reorganization within components, and attribute it to transported component pairs. Word-local modes resolve distinct directions of change and their activity over time, while representative passages from attributed components ground the analysis in text. Under a Gaussian mixture specialization, we prove parametric recovery of the operators and squared distances. Synthetic experiments support the predicted rate. CUSP remains competitive on English and German DWUG and recovers controlled Janus profiles while maintaining compositionally coherent transport. A large corpus of US court opinions demonstrates transition, mode, and passage attribution in unlabeled natural text. CUSP thus makes magnitude, timing, mechanism, movement, modes, and textual evidence compatible views of one lexical history.
Figures & tables
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Notation | Meaning |
|---|---|
| Indices, spaces, and period distributions | |
| Vocabulary, period index set , and contextual-embedding dimension. | |
| Word, periods, period local source and target components, and word-local mode. | |
| Probability measures with finite second moment, and couplings with marginals and . | |
| Contextual embedding of usage , sampled independently from the distribution of word in period . | |
| period specific usage distribution represented as a finite mixture. | |
| Temporal representation | Attribution from that representation | |||||
| Approach | Multi- period | Usage/component correspondence | Compositional coupling | Exact mechanism split | Transition attribution | Temporal modes |
| Dynamic and evolving sense models [ 6 , 7 ] | ✓ | ✓ | – | – | – | |
| WiDiD [ 32 , 8 ] | ✓ | ✓ | – | – | – | |
| Multi-period similarity analysis [ 11 ] | ✓ | – | – | – | – | – |
| SynFlow [ 33 ] | ✓ | – | – | |||
| Pairwise OT [ 5 ] | ✓ | – | – | – | – | |
| Quantity | Log–log slope [95% CI] | Error at |
|---|---|---|
| Prevalence | [ ] | |
| Center | [ ] | |
| Covariance | [ ] | |
| Full operator | [ ] | |
| Mean operator | [ ] | |
| Deviation operator | [ ] |
| Population change | Mean term | Deviation term |
|---|---|---|
| Centers move | 99.89 0.02 | 0.11 0.02 |
| Covariances change | 1.05 0.40 | 98.95 0.40 |
| Prevalences change | 99.95 0.01 | 0.05 0.01 |
| Language | Full | Mean | Dev. | Full | Mean | Dev. | Full | Mean | Dev. |
|---|---|---|---|---|---|---|---|---|---|
| English | |||||||||
| German | |||||||||
| Schedule | Schedule recovery | Pairwise OT | CUSP | |
|---|---|---|---|---|
| Stable | Path length | |||
| Gradual | Profile TV | |||
| Abrupt | Peak accuracy | |||
| Overall | , AUROC |
| Quantity | Count |
|---|---|
| Distinct court opinions represented | |
| Target lemmas | |
| Retained passages before equalization | |
| Passages in the balanced analysis panel | |
| Median passages per lemma–decade | |
| Range of equalized counts across lemmas | – |
| Rank | Lemma | Peak transition ( ) | Pair | ||
|---|---|---|---|---|---|
| 1 | privacy | ( ) | |||
| 2 | search | ( ) | |||
| 3 | standing | ( ) | |||
| 4 | warrant | ( ) | |||
| 5 | trespass | ( ) | |||
| 6 | exercise | ( ) |
| Rank | Lemma | Mode peaks | |||
|---|---|---|---|---|---|
| 1 | privacy | / | |||
| 2 | standing | / | |||
| 3 | effect | / | |||
| 4 | trespass | / | |||
| 5 | taking | / | |||
| 6 | due | / |
Semantic Change Detection
Semantic change detection identifies how meanings, concepts, or scene contents differ across time in text, images, and other data.
See all 63 papers