Beyond Point Predictions: Uncertainty-Aware Satellite Poverty Mapping for Public Policy
Organizations: Division of Data Science and AI, Department of Computer Science and Engineering, Chalmers University of Technology and the University of Gothenburg, Gothenburg, Sweden · Institute for Analytical Sociology, Linköping University, Norrköping, Sweden · AI & Global Development Lab, Linköping University, Norrköping, Sweden · Geomatics, Department of Environmental and Life Sciences, Karlstad University, Karlstad, Sweden ·
Abstract
Despite their critical importance for policy and research, high-resolution poverty data remain limited across much of Africa. Machine learning (ML) with earth observation (EO) imagery has recently emerged as a way to supplement these data by predicting (i.e., estimating) poverty where it has not been directly measured. Yet to be used reliably, decision-makers and analysts need assurances that they will not be misled by the errors in these predictions. To meet this need, we develop an uncertainty-aware EO-ML method for poverty mapping based on simultaneous quantile regression and a novel form of conformal prediction. Using a spatiotemporal transformer trained on sequences of Landsat and nighttime-light images, we produce prediction intervals for neighborhood-level International Wealth Index estimates across Africa which are statistically guaranteed to achieve their desired coverage rates. While our method's point-prediction performance matches the state of the art, its prediction intervals are wider than might be expected given its high of . However, other models of similar accuracy likely suffer from comparable uncertainty, pointing to an inherent limitation: even with its remarkably high explanatory power, EO-ML cannot naively be relied upon for policy-making, such as when designing poverty-targeting programs. To handle this challenge, we develop a procedure to efficiently allocate aid using both ground-truth surveys and model predictions while provably ensuring the risk of excluding eligible neighborhoods remains below a prespecified level. In simulations, this approach delivers substantially more aid per eligible recipient than other strategies, thereby demonstrating that EO-ML can indeed be a reliable supplement to traditional data sources.
Figures & tables
| Error Rate “Below” | Error Rate “Above” | Decision Coverage | Accuracy | Error Rate | |
| Point prediction | 0.201 | 0.133 | 1.000 | 0.843 | 0.157 |
| Naive intervals | 0.027 | 0.004 | 0.465 | 0.453 | 0.012 |
| CQR intervals | 0.009 | 0.000 | 0.340 | 0.337 | 0.003 |
| CT (ours) | 0.050 | 0.050 | 0.693 | 0.644 | 0.050 |
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| Country | DBScan | First Kmeans | Second Kmeans | Shannon based |
| Angola | 7.21 | 7.21 | 7.21 | 7.21 |
| Burkina Faso | 6.62 | 6.62 | 6.62 | 6.62 |
| Benin | 3.00 | 4.33 | 4.33 | 4.33 |
| Burundi | 0.01 | 1.39 | 2.57 | 3.51 |
| Congo - Kinshasa | 8.39 | 8.41 | 8.43 | 8.43 |
| Central African Republic | 5.03 | 5.03 | 5.03 | 5.03 |
| Fold | Countries |
| A | Cameroon, Chad, Democratic Republic of the Congo, Egypt, Eswatini, Guinea, Mauritania |
| B | Comoros, Gabon, Namibia, Niger, Nigeria, Rwanda, Uganda, Zambia |
| C | Angola, Côte d’Ivoire, Ethiopia, Kenya, Liberia, Mali, Togo |
| D | Burundi, Gambia, Ghana, Madagascar, Morocco, Sierra Leone, Tanzania, Zimbabwe |
| E | Benin, Burkina Faso, Central African Republic, Lesotho, Malawi, Mozambique, Senegal, South Africa |
| Paper | Model type | Covariates | |
| Pettersson et al. [26] | CNN + LSTM | 0.76 | Landsat + NL |
| Marty and Duhaut [25] | XGBoost | 0.75 | EO + other sources |
| Wang and Li [34] | RF | 0.70 | NL |
| Zheng et al. [36] | SwinV2-T | 0.69 | Landsat |
| Yeh et al. [35] | CNN | 0.67 | Landsat + NL |
| Sherman et al. [29] | MOSAIKS | 0.67 | MOSAIKS |
Regression Prediction Intervals
Regression prediction intervals quantify plausible ranges for outcomes while balancing reliable coverage against interval width.
See all 101 papers