The Privacy-Utility Trade-Off of Location Tracking in Ad Personalization
Organizations: Cornell University
Abstract
Firms collect vast amounts of behavioral and geographical data on individuals. While behavioral data captures an individual's digital footprint, geographical data reflects their physical footprint. Given the significant privacy risks associated with combining these data sources, it is crucial to understand their respective value and whether they act as complements or substitutes in achieving firms' business objectives. In this paper, we combine economic theory, machine learning, and causal inference to quantify the value of geographical data, the extent to which behavioral data can substitute for it, and the mechanisms through which it benefits firms. Using data from a leading in-app advertising platform in a large Asian country, we document that geographical data is most valuable in the early cold-start stage, when behavioral histories are limited. In this stage, geographical data complements behavioral data, improving targeting performance by almost 20%. As users accumulate richer behavioral histories, however, the role of geographical data shifts: it becomes largely substitutable, as behavioral data alone captures the relevant heterogeneity. These results highlight a central privacy-utility trade-off in ad personalization and inform managerial decisions about when location tracking creates value.
Figures & tables
| Variable | Number of categories | Share of top categories | Number of impressions | ||
|---|---|---|---|---|---|
| 1st | 2nd | 3rd | |||
| App | 9,515 | 26.14% | 9.46% | 4.54% | 10,336,703 |
| Ad | 10 | 22.33% | 13.28% | 12.67% | 10,336,703 |
| Unique User | 439,157 | 0.02% | 0.02% | 0.02% | 10,336,703 |
| Smartphone brand | 7 | 41.94% | 30.59% | 9.21% | 10,336,703 |
| Connectivity Type | 2 | 54.65% | 45.35% | 0.00% | 10,336,703 |
| Model | Log Loss | AUC | Relative Information Gain (%) |
|---|---|---|---|
| ( ) | 0.073 | 0.720 | 18.900 |
| ( ) | 0.072 | 0.722 | 19.220 |
| ( ) | 0.014 | 0.809 | 84.180 |
| ( ) | 0.013 | 0.812 | 84.410 |
| Policy | IPS Estimate | 95% CI | t-stat | SE | Lift (%) | ESS |
|---|---|---|---|---|---|---|
| 0.0248 ∗∗∗ | [0.0243, 0.0254] | 27.611 | 0.000 | 41.450 | 760316 | |
| 0.0229 ∗∗∗ | [0.0223, 0.0234] | 19.675 | 0.000 | 30.280 | 555871 | |
| 0.0226 ∗∗∗ | [0.0220, 0.0232] | 16.572 | 0.000 | 28.710 | 592427 | |
| 0.0208 ∗∗∗ | [0.0202, 0.0214] | 18.782 | 0.000 | 20.440 | 542747 |
| Estimate ( ) | Std. Error (clustered) | -stat | 95% Confidence Interval | -value | |
|---|---|---|---|---|---|
| Value | 0.000509 | 0.000334 | 1.526 | [-0.000144, 0.001164] | 0.127 |
| County-level, | County-level, | City-level, | City-level, | |
|---|---|---|---|---|
| Moran’s | 0.122 | 0.084 | 0.055 | -0.001 |
| -value | 0.00006 | 0.00318 | 0.00242 | 0.49156 |
| Geary’s | 0.891 | 0.900 | 0.948 | 0.996 |
| -value | 0.00094 | 0.00162 | 0.01646 | 0.41863 |
| County-level, Sparse | County-level, Rich | City-level, Sparse | City-level, Rich | |
|---|---|---|---|---|
| Moran’s | 0.069 | 0.025 | -0.005 | 0.0005 |
| -value | 0.011 | 0.183 | 0.412 | 0.459 |
| Geary’s | 0.952 | 0.976 | 1.012 | 1.006 |
| -value | 0.072 | 0.225 | 0.285 | 0.403 |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Layer (type) | Output Shape | Param # |
|---|---|---|
| Input Features | [-1, 150, 240] | 0 |
| Time-Gap Projection | [-1, 150, 240] | 57,840 |
| Absolute Positional Embedding | [1, 150, 240] | 36,000 |
| LSTM (4 layers) | [-1, 150, 512] | 4,269,568 |
| Layer Norm (pre-attention) | [-1, 150, 512] | 1,024 |
| Causal Multi-Head Attention | [-1, 150, 512] | 1,049,600 |
| Model | Log Loss | AUC | Relative Information Gain |
|---|---|---|---|
| XGBoost ( ) | 0.0552 | 0.8235 | 37.64% |
| XGBoost ( ) | 0.0549 | 0.8333 | 37.98% |
| LSTM ( ) | 0.0140 | 0.8088 | 84.18% |
| LSTM ( ) | 0.0138 | 0.8115 | 84.41% |
| Policy | IPS Estimate | 95% CI | t-stat | SE | Lift (%) | ESS |
|---|---|---|---|---|---|---|
| LSTM | 0.024883 ∗∗∗ | [0.024366, 0.025401] | 27.611 | 0.000264 | 41.45% | 760316 |
| XGBoost | 0.023531 ∗∗∗ | [0.023056, 0.024006] | 24.521 | 0.000242 | 33.76% | 803214 |
| LSTM | 0.022918 ∗∗∗ | [0.022387, 0.023448] | 19.675 | 0.000271 | 30.28% | 555871 |
| XGBoost | 0.022738 ∗∗∗ | [0.022261, 0.023214] | 21.183 | 0.000243 | 29.25% | 735365 |
| Last-Impr | 95% CI | -stat | (two) | Decision | Signif. | |||
|---|---|---|---|---|---|---|---|---|
| 3 | 0.0006 | [–0.0017, 0.0029] | 0.50 | 0.616 | 0.308 | 0.692 | Inconclusive | none |
| 6 | 0.0033 | [0.0008, 0.0057] | 2.63 | 0.009 | 0.004 | 0.996 | Complement | strong |
| 10 | 0.0023 | [–0.0001, 0.0046] | 1.86 | 0.063 | 0.032 | 0.968 | Complement | mod |
| 16 | 0.0024 | [0.0003, 0.0045] | 2.23 | 0.026 | 0.013 | 0.987 | Complement | mod |
| 24 | 0.0033 | [0.0014, 0.0052] | 3.37 | 0.001 | 0.000 | 1.000 | Complement | strong |
| 35 | –0.0002 | [–0.0021, 0.0017] | –0.20 | 0.839 | 0.581 | 0.419 | Inconclusive | none |
Privacy-Utility Tradeoff
Privacy-utility tradeoffs study how to limit disclosure of sensitive information while preserving useful data, models, and services.
See all 71 papers