ClusLoad: Cluster-Guided Model Sharing for Scalable Distribution Transformer Load Forecasting
Organizations: School of Electrical Engineering, Wuhan University, No. 299 Bayi Road, Wuchang District, Wuhan, 430072, Hubei, China · Institute of Industrial Science, The University of Tokyo, 4-6-1 Komaba, Meguro-ku, Tokyo, 153-8505, Tokyo, Japan · School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
Abstract
Large-scale device-level load forecasting for distribution transformers is challenged by substantial cross-device heterogeneity and the deployment burden of maintaining device-specific forecasting models. Existing approaches typically rely either on device-specific models, which are difficult to scale to large transformer populations, or on global models, which reduce deployment complexity but may overlook heterogeneous load patterns across devices. To address this trade-off, this study develops a trend-clustered forecasting framework that enables model sharing among transformers with similar temporal behaviors. Representation Learning for Time Series using Time-Embeddings (T-Rep) is employed to learn compact temporal representations of transformer load series, which are subsequently grouped using a Gaussian mixture model (GMM). Representative transformers are sampled within each cluster to train cluster-specific Patch Time Series Transformer (PatchTST) models while retaining device-level predictions. The framework is evaluated using real-world 15-min operational data from nearly one thousand distribution transformers. The proposed framework reduces mean absolute error (MAE) by approximately 20% relative to the direct PatchTST baseline, achieves a high-load warning accuracy of 95.66%, while requiring only seven cluster-specific forecasting models. These results demonstrate that behavior-based device organization provides an effective balance between forecasting accuracy, deployment scalability, and risk-oriented operational support for distribution transformer management.
Figures & tables
| Research direction | Representative studies | Core idea | Main limitation |
| Deep forecasting models | Informer [ 20 ] ; FEDformer [ 22 ] ; TimesNet [ 24 ] ; iTransformer [ 26 ] ; PatchTST [ 27 ] | Model temporal dependencies using attention, frequency-domain methods, or patch-based representations. | Focus mainly on forecasting architectures rather than organizing heterogeneous devices. |
| Load-profile clustering | Rhodes et al. [ 28 ] ; Motlagh et al. [ 8 ] ; Michalakopoulos et al. [ 9 ] | Group loads according to similarities in their consumption patterns. | Clustering raw profiles or handcrafted features can be sensitive to noise, scale, and dimensionality. |
| Time-series representation learning | TS2Vec [ 10 ] ; T-Rep [ 11 ] | Map long time series into compact latent representations of temporal behavior. | Does not by itself determine how forecasting models should be shared across devices. |
| Transfer and personalized learning | Fan et al. [ 31 ] ; Fan et al. [ 12 ] ; Choi et al. [ 13 ] | Share or transfer knowledge across related forecasting targets while accounting for heterogeneity. | Often requires source selection, personalization, or device-specific adaptation. |
| Cluster-based representative forecasting | Li et al. [ 29 ] ; Dong et al. [ 30 ] ; Ramos et al. [ 14 ] | Group similar loads and use representative devices or cluster-level information for forecasting. | Few studies jointly address learned clustering, scalable transformer-level forecasting, and model sharing. |
| Symbol | Definition |
| Number of transformers used for model construction and forecasting | |
| Historical sequence length used for temporal representation learning | |
| Forecasting input-window length | |
| Forecasting horizon | |
| Number of input variables for one transformer | |
| Dimension of the T-Rep device representation |
| Characteristic | Description |
| Study area | Undisclosed region in China |
| Number of transformers | 998 |
| Observation period | May 1, 2024 – August 31, 2025 |
| Load measurement | Transformer apparent power (kVA) |
| Rated capacity | Device-specific rated capacity (kVA) |
| Load sampling interval | 15 minutes |
| Validation MAE | |
| 3 | 22.3216 |
| 5 | 20.7749 |
| 7 | 18.2854 |
| 10 | 20.3691 |
| Method | MAE | MSE | RMSE | MAPE | MSPE | Accuracy(%) |
| iTransformer | 24.4000 | 1227.8754 | 31.8579 | 0.1347 | 0.2732 | 87.21 |
| FiLM | 22.7600 | 975.4483 | 29.5460 | 0.1344 | 0.5081 | 88.30 |
| TimesNet | 22.5500 | 974.5294 | 29.4536 | 0.1165 | 0.0555 | 87.37 |
| Pyraformer | 23.4730 | 1048.8007 | 30.5759 | 0.1202 | 0.0552 | 86.64 |
| FEDformer | 22.6800 | 969.9426 | 29.4284 | 0.1250 | 0.2111 | 87.78 |
| DLinear | 30.3174 | 1812.8382 | 42.5774 | 0.2337 | 0.1316 | 86.10 |
| MAE | MSE | RMSE | MAPE | MSPE | |
| 3 | 21.1800 | 843.5056 | 27.5411 | 0.1866 | 0.7467 |
| 5 | 20.6024 | 869.8537 | 27.0686 | 0.1716 | 0.6872 |
| 7 | 18.7997 | 746.7468 | 24.6080 | 0.0950 | 0.0125 |
| 10 | 19.9582 | 762.6748 | 26.1099 | 0.2288 | 4.8760 |
| Method | MAE | MSE | RMSE | MAPE | MSPE | |
| Random grouping | 3 | 24.0932 | 1115.9785 | 31.4118 | 0.1636 | 0.8028 |
| ClusLoad | 3 | 21.1800 | 843.5056 | 27.5411 | 0.1866 | 0.7467 |
| Random grouping | 5 | 20.9016 | 834.7437 | 27.1660 | 0.1754 | 0.6772 |
| ClusLoad | 5 | 20.6024 | 869.8537 | 27.0686 | 0.1716 | 0.6872 |
| Random grouping | 7 | 22.7040 | 990.5914 | 29.5407 | 0.2006 | 2.0924 |
| ClusLoad | 7 | 18.7997 | 746.7468 | 24.6080 | 0.0950 | 0.0125 |
Electricity Load Forecasting
Electricity load forecasting predicts future power demand to support grid operation, planning, and energy management.
See all 52 papers