cs.LGJan 29, 2026

SmartMeterFM: Flow Matching for Smart Meter Data Generation, Imputation, and Super-Resolution Without Retraining

Authors: Nan Lin, Yanbo Wang, Jacco Heres, Peter Palensky, Pedro P. Vergara

Organizations: Intelligent Electrical Power Grids Group, Delft University of Technology, 2628 CD Delft, The Netherlands · Signal Processing Systems Group, Delft University of Technology · Alliander N.V., 6812 AH Arnhem, The Netherlands

Abstract

Distribution system operators need realistic load and generation profiles when measurements are unavailable, incomplete, or too coarse for the intended analysis. Training separate models for synthetic data generation, imputation, and super-resolution can duplicate modeling effort as observation requirements change. This paper presents SmartMeterFM, a conditional flow matching model trained once on monthly smart meter profiles at 15 min resolution. Customer and calendar attributes condition the model during training, while numerical profile constraints, observed intervals, and coarse measurements are incorporated through projection-based guidance at inference. The same weights serve all tasks without task-specific retraining and preserve temporal patterns and extreme values while producing profiles consistent with the supplied observations. A large-scale case study using Dutch consumption and photovoltaic generation profiles reports lower mean Continuous Ranked Probability Score (CRPS) than the selected task-specific baselines for imputation and 16-fold super-resolution. On a public dataset of 2,400 residential meters, the same weights match the imputation CRPS of a task-trained diffusion model when sampled ancestrally, attain a 4.5% lower super-resolution CRPS with the default sampler, and meet the specified monthly maximum and mean power within 0.01 kW.

Figures & tables

Explore similar work

Sep 10, 2026

LoaDiff: Conditional Generation of Electricity Consumption Time Series for Energy Analytics

The energy transition is reshaping residential electricity consumption through the increasing adoption of distributed generation, electrified appliances, and demand-response programs. Understanding these evolving behaviors requires access to granular smart-meter data for applications such as load forecasting, appliance detection, and demand-side flexibility analysis. However, such data are subject to strict access restrictions and data-protection regulations. Thus, realistic synthetic alternatives are necessary. In this paper, we introduce LoaDiff, a diffusion-based generative model for year-long, sub-hourly smart-meter load curves. LoaDiff supports flexible conditioning on static household attributes, such as appliance ownership, and dynamic contextual variables, including calendar information and outdoor temperature. We evaluate the model against multiple generative baselines on three residential electricity-consumption datasets. Our experiments assess four complementary dimensions: fidelity and diversity, training-record memorization risk, downstream utility for load forecasting and appliance detection, and conditional controllability under alternative temperature conditions. The results show that LoaDiff generates realistic and diverse load profiles, achieves a favorable trade-off between generation quality and limited evidence of memorization, preserves information useful for downstream energy applications, and responds coherently to changes in conditioning variables.
Aug 21, 2026

Large-Scale Evaluation of Advanced Imputation Methods for Missing Values in Smart Meter Data

Accurate and reliable collection of electricity consumption data through Advanced Metering Infrastructure (AMI) is of great importance for the operation of smart grids, especially for the detection of non-technical losses (NTL). However, real-world datasets frequently suffer from missing values due to communication failures. This paper presents an empirical evaluation of three advanced algorithms for large-scale data imputation: the Optimally Weighted Average (OWA) method, Low-Rank Matrix Completion via SoftImpute, and a Shape-Modeling Autoencoder. Existing studies on missing value imputation in electricity consumption data often lack validation on larger datasets. Therefore, the goal of this paper is to validate the selected algorithms on a large-scale real-world electricity consumption dataset from North Macedonia that includes 17,428 commercial smart meters over two years. The robustness of each algorithm is evaluated by simulating continuous gaps in the data ranging from 1 to 168 hours. The results indicate that OWA provides the lowest overall reconstruction error across the evaluated gap sizes and strong stability in worst-case scenarios for gaps of up to one week. In contrast, the autoencoder exhibits higher variance, while SoftImpute has stable but inferior accuracy. These findings suggest that imputation methods should be selected based on the characteristics of load curve data and highlight the potential for hybrid algorithmic architectures in future grid management systems.
Apr 30, 2026

SPLICE: Latent Diffusion over JEPA Embeddings for Conformal Time-Series Inpainting

Generative models for time-series imputation achieve strong reconstruction accuracy, yet provide no finite-sample reliability guarantees, a critical limitation in power systems where imputed values inform dispatch and planning. We introduce SPLICE (Self-supervised Predictive Latent Inpainting with Conformal Envelopes), a modular framework coupling latent generative imputation with distribution-free, online-adaptive prediction intervals. A JEPA encoder maps daily load segments into a 64-dimensional latent space; a conditional latent bridge with four sampling modes generates candidate gap trajectories; an hourly-conditioned decoder maps back to signal space; and Adaptive Conformal Inference (ACI) wraps the output with coverage-guaranteed prediction bands. The flow-matching variant achieves comparable quality to DDIM in 5--10 ODE steps (5-10x speedup). On thirteen load datasets (nine proprietary, three UCI Electricity, ETTh1), SPLICE achieves the lowest mean Load-only MSE (0.056), winning 9/12 non-degenerate datasets at 91-day gaps and 18/32 across all gap lengths vs. five established baselines, and produces the best CRPS (0.161, -18.3% vs. the strongest competitor). ACI delivers 93--95% empirical coverage, correcting under-coverage failures of up to 7.5 pp observed with static conformal prediction. A pooled JEPA encoder trained on nine feeds transfers to four unseen domains, matching or exceeding per-dataset oracles with only a quick bridge fine-tuning.