DySENSE: Dynamic Spatiotemporal ENergy Synthesis and Emulation with Satellite Imagery
Organizations: SMART, Singapore · Massachusetts Institute of Technology, Cambridge, MA, USA · National University of Singapore, Singapore · University of Florida, Gainesville, FL, USA
Abstract
Cities account for over two-thirds of the world's energy and more than 70% of global carbon dioxide emissions. City energy is essential for achieving the 2050 net-zero target and the UN's Sustainable Development Goals 7 and 11. Although existing studies have made progress, they are limited by data and methodological gaps. Existing studies are largely predictive for existing cities rather than generative for future cities; fine-grained, aligned monthly dynamic energy data are scarce; and existing GenAI models struggle to generate dynamic urban functional monthly energy. We present DySENSE, a joint multimodal GenAI framework that synthesizes static urban satellite imagery together with spatially aligned, dynamic monthly building energy consumption maps. We decouple long-term static urban morphology from short-term dynamic energy consumption. By conditioning on static urban land use, DySENSE can generate realistic, diverse and new static urban imagery with aligned energy maps. By conditioning on dynamic monthly and climate prompts, DySENSE can jointly generate dynamic, monthly energy consumption maps while keeping the urban morphology static. Experiments across four cities (New York, Washington, Norfolk, Busan) demonstrated that DySENSE can generate annotated high-fidelity synthetic energy data using less than 25% labelled data, boosting downstream prediction performance by 8% mIoU, and achieving strong energy dynamic consistency. Compared to existing methods, DySENSE significantly improved prediction performance (8.7% accuracy) and reduced prediction error (9%-18% CVRMSE, ASHRAE). DySENSE offers an effective foundation for energy-efficient cities, peak-load analysis, building performance simulation and dynamic demand response for city, energy, and building science. The data and code: https://huggingface.co/datasets/skl24/MUSE2 and https://github.com/kailaisun/DySENSE
Figures & tables
| Method | Training Data | Acc | mIoU | NMBE | CVRMSE |
| Yap et al. (2025) | Strategy A1: Real | 0.5343 | 0.3687 | 6.02% | 33.58% |
| Yap et al. (2025) | Strategy A2: Real duplication | 0.5340 | 0.3686 | 7.73% | 32.56% |
| Yap et al. (2025) | Strategy A3: Real augmentation | 0.5462 | 0.3712 | 5.57% | 30.70% |
| Yap et al. (2025) + Ours | Strategy B1: Static Mix | 0.6034 | 0.4364 | 3.37% | 16.91% |
| Yap et al. (2025) + Ours | Strategy B2: Dynamic Mix | 0.6217 | 0.4555 | 2.82% | 15.31% |
| Diff ( | Ours | - | Baseline | ) | +0.0874 | +0.0868 | -3.20% | -18.27% |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameter | 4 cities, 10-class |
| in channels | 4 |
| intermediate channels | 512 |
| out channels | 10 |
| block out channels | (128, 256, 512, 512) |
| resolution | 512 |
| training augmentation | Resize, RandomCrop, RandomHorizontalFlip |
| Hyperparameter | 4 cities, 10-class |
| resolution | 512 |
| sequence length | 2206 |
| batch size | 12 |
| epoch | 80 |
| learning rate | 5e-5 |
| lr scheduler | cosine (500 warmup steps) |
| Metric | RemoteCLIP | CLIP |
| FID | 36.7362 | 37.4800 |
| PSNR | 11.5177 | 10.9076 |
| LPIPS | 0.5604 | 0.5695 |
| Ratio | mIoU | NMBE (%) | CVRMSE (%) | |||
| RemoteCLIP | CLIP | RemoteCLIP | CLIP | RemoteCLIP | CLIP | |
| Strategy A: Real Only | ||||||
| 1/16 | 18.50 | 18.92 | 17.96 | 28.93 | 82.30 | 103.12 |
| 1/8 | 29.30 | 29.36 | 13.68 | 16.99 | 53.70 | 61.96 |
| 1/4 | 36.90 | 35.68 | 6.02 | 7.32 | 33.60 | 33.43 |
| 1/2 | 49.50 | 48.59 | 2.63 | 3.18 | 14.70 | 13.13 |
| City | Satellite imagery | Urban density | Original energy map | Filtered energy map | Used energy map |
| New York City | 1589 | 1589 | 1589 | 579 | 500 |
| Busan | 1438 | 1438 | 1438 | 996 | 500 |
| Washington, D.C. | 1914 | 1914 | 1914 | 500 | 500 |
| Norfolk | 1328 | 1328 | 1328 | 490 | 490 |
| Method | Training Data | IoU (per class) | Acc (per class) | ||||||||||||||||
| C1 | C2 | C3 | C4 | C5 | C6 | C7 | C8 | C9 | C1 | C2 | C3 | C4 | C5 | C6 | C7 | C8 | C9 | ||
| Yap et al. (2025) | Strategy A: real | 0.5106 | 0.3666 | 0.3188 | 0.2930 | 0.3059 | 0.2938 | 0.3121 | 0.3684 | 0.5488 | 0.6731 | 0.5189 | 0.4780 | 0.4395 | 0.5033 | 0.4353 | 0.4495 | 0.5643 | 0.7470 |
| Yap et al. (2025) + Ours | Strategy B1: Static Mix | 0.5790 | 0.4304 | 0.3857 | 0.3706 | 0.3609 | 0.3637 | 0.3873 | 0.4319 | 0.6179 | 0.7350 | 0.5899 | 0.5375 | 0.5676 | 0.5165 | 0.5195 | 0.5596 | 0.6141 | 0.7903 |
| Yap et al. (2025) + Ours | Strategy B2: Dynamic Mix | 0.5911 | 0.4544 | 0.3997 | 0.3821 | 0.3857 | 0.3927 | 0.4104 | 0.4545 | 0.6285 | 0.7278 | 0.6303 | 0.5589 | 0.5485 | 0.5481 | 0.5759 | 0.5844 | 0.6229 | 0.7983 |
| Mayer et al. (2023) | Strategy A: real | 0.5592 | 0.4261 | 0.3735 | 0.3463 | 0.3541 | 0.3576 | 0.3710 | 0.4164 | 0.5866 | 0.6988 | 0.6127 | 0.5509 | 0.5066 | 0.5192 | 0.5169 | 0.5236 | 0.6041 | 0.7649 |
| Mayer et al. (2023) + Ours | Strategy B1: Static Mix | 0.5925 | 0.4496 | 0.4016 | 0.3773 | 0.3791 | 0.3824 | 0.3976 | 0.4447 | 0.6225 | 0.7323 | 0.6179 | 0.5737 | 0.5403 | 0.5456 | 0.5608 | 0.5543 | 0.6184 | 0.8036 |
| Class | Busan | New York City | Norfolk | Washington | ||||
| kBtu | kBtu | kBtu | kBtu | |||||
| 0 | 0.00 | 0.000 | 0.00 | 0.000 | 0.00 | 0.000 | 0.00 | 0.000 |
| 1 | 1693.45 | 7.435 | 42538.34 | 10.658 | 229.11 | 5.439 | 63285.79 | 11.055 |
| 2 | 7777.19 | 8.959 | 111640.48 | 11.623 | 855.97 | 6.753 | 140097.29 | 11.850 |
| 3 | 19192.97 | 9.862 | 185658.64 | 12.132 | 2370.11 | 7.771 | 228871.67 | 12.341 |
| 4 | 40711.96 | 10.614 | 276446.47 | 12.530 | 5495.96 | 8.612 | 349862.14 | 12.765 |
Synthetic Data Generation
Synthetic data generation creates artificial examples, simulations, and datasets to train, test, or protect machine-learning systems.
See all 660 papers