Location representations provide mobility models with fundamental information about the spatial position, functional characteristics, and relationships of places. However, existing embeddings are often dependent on mobility observations, unable to represent unseen locations, and weakly constrained to retain geographic distance. This limits their reuse across datasets and mobility tasks. To address these limitations, we propose LE4Mob, an inductive, distance-aware, and geography-derived location embedding framework for mobility modelling. LE4Mob extends contrastive language-location pre-training while introducing a distance-aware regularisation objective that encourages the embedding space to preserve spatial relationships. Pre-trained from geographic context, LE4Mob can encode rich spatial-semantic information and generate embeddings for unseen locations inductively. Its independence from downstream mobility task supervision also makes it transferable across different mobility tasks. We evaluate LE4Mob on individual-level next location prediction and population-level commuter flow generation. Experiments across multiple datasets and study areas show that LE4Mob outperforms strong baselines, with particular advantages in inductive settings and when downstream models rely directly on interactions between location embeddings. These findings demonstrate the potential of distance-aware, geography-derived location representations as reusable foundations for human mobility modelling.
Figures & tables
Fig. 1: Framework of LE4Mob. (a) In the pre-training phase, batches of POIs are encoded through a dual-stream architecture that aligns coordinate-based location embeddings with POI-derived textual semantics using contrastive learning, while a distance-preserving loss regularises sampled location pairs to retain geographic distance information. (b) After pre-training, the frozen location encoder generates embeddings for downstream mobility tasks, including individual-level next location prediction and population-level flow generation.
FSQ-NYC
FSQ-TKY
Gowalla-LD
Geolife
#Users
535
1643
68
39
#Days tracked
319
318
367
1703
#Total unique locations
4019
6959
1065
1248
#Stays per user
178.3±206.1
225.1±220.9
127.1±123.3
358.6±383.6
#Stays per user per day
2.1±2.1
2.7±2.7
2.4±3.0
2.4±1.5
#Unique locations per user
34.7±21.4
56.6±33.5
46.3±44.2
61.5±52.8
TABLE I: Basic statistics of the mobility datasets after preprocessing. The mean and standard deviation across users are reported.
Conventional
Inductive
Data
Model
Acc@1 ↑
Acc@5 ↑
nDCG@10 ↑
GDE@1 ↓
mGDE@5 ↓
Acc@1 ↑
Acc@5 ↑
nDCG@10 ↑
GDE@1 ↓
mGDE@5 ↓
FSQ-NYC
Vanilla-E2E
19.94 ± 0.19
46.84 ± 0.44
37.52 ± 0.25
4.45 ± 0.09
5.36 ± 0.10
9.80 ± 1.18
24.41 ± 2.10
19.23 ± 1.93
7.53 ± 0.75
8.47 ± 0.69
Skip-gram
19.81 ± 0.34
45.76 ± 0.19
36.85 ± 0.29
4.43 ± 0.06
5.20 ± 0.03
8.68 ± 1.19
21.71 ± 2.92
17.35 ± 2.40
8.07 ± 0.82
8.96 ± 1.15
POI2Vec
19.62 ± 0.58
44.94 ± 0.71
36.32 ± 0.66
4.53 ± 0.16
5.38 ± 0.12
8.84 ± 1.31
21.80 ± 3.40
17.37 ± 2.70
8.26 ± 0.73
8.74 ± 0.72
Geo-Teaser
19.43 ± 0.73
45.46 ± 0.84
36.48 ± 0.59
4.52 ± 0.08
5.30 ± 0.08
8.08 ± 1.47
20.33 ± 3.13
16.16 ± 2.74
8.77 ± 0.48
9.26 ± 0.61
TALE
20.20 ± 0.40
45.80 ± 0.12
36.98 ± 0.12
4.46 ± 0.06
5.35 ± 0.05
8.52 ± 1.47
21.04 ± 3.41
16.83 ± 2.76
8.23 ± 0.99
9.07 ± 0.99
TABLE II: Performance comparison of different embedding methods on the next location prediction task. The best and second-best performance are marked in bold and underlined , respectively, based on the unrounded mean values. For better readability, the ranking metric values are scaled by a factor of 102 , while GDE and mGDE are reported in kilometres.
DeepGravity
Bilinear
Data
Model
CPC ↑
MAE ↓
RMSE ↓
JSD ↓
CPC ↑
MAE ↓
RMSE ↓
JSD ↓
Manchester
Handcrafted
0.765 ± 0.008
0.693 ± 0.055
0.871 ± 0.083
0.202 ± 0.005
0.757 ± 0.011
0.717 ± 0.063
0.915 ± 0.091
0.207 ± 0.008
LDA
0.784 ± 0.017
0.649 ± 0.080
0.835 ± 0.116
0.183 ± 0.013
0.769 ± 0.021
0.694 ± 0.095
0.904 ± 0.142
0.192 ± 0.019
SPPE
0.778 ± 0.012
0.669 ± 0.066
0.866 ± 0.097
0.189 ± 0.009
0.796 ± 0.009
0.610 ± 0.058
0.795 ± 0.089
0.173 ± 0.006
Urban2Vec
0.769 ± 0.017
0.693 ± 0.083
0.895 ± 0.119
0.196 ± 0.014
0.809 ± 0.017
0.584 ± 0.078
0.793 ± 0.109
0.157 ± 0.012
Space2Vec
0.764 ± 0.016
0.705 ± 0.080
0.903 ± 0.116
0.199 ± 0.013
0.783 ± 0.022
0.660 ± 0.095
0.892 ± 0.140
0.183 ± 0.019
TABLE III: Performance comparison of different embedding methods on the flow generation task. The best and second-best performances are determined using unrounded mean values and marked in bold and underlined , respectively.
Model
Pearson’s r
Spearman’s ρ
CaLLiPer
0.268
0.315
LE4Mob
0.369
0.438
TABLE IV: Correspondence between geographic similarity and embedding cosine similarity for OA pairs in the Greater London test set. All correlations are statistically significant at p<0.0001 .
Fig. 2: Flow generation performance with and without explicit distance inputs in the downstream DeepGravity model. Error bars indicate standard deviations across repeated runs. Percentages denote the relative CPC change after removing the explicit distance feature. HC, U2V, S2V, and CaL denote Hand-Crafted, Urban2Vec, Space2Vec, and CaLLiPer, respectively.