Lightweight and Scalable Transfer Learning Framework for Load Disaggregation
Authors: L. E. Garcia-Marrero, G. Petrone, E. Monmasson
Organizations: Systèmes et Applications des Technologies de l’Information et de l’Energie laboratory, Cergy-Pontoise · Dipartimento di Ingegneria dell’Informazione ed Elettrica e Matematica Applicata/DIEM, University of Salerno, 84084 Fisciano
Non-Intrusive Load Monitoring (NILM) aims to estimate appliance-level consumption from aggregate electrical signals recorded at a single measurement point. In recent years, the field has increasingly adopted deep learning approaches; however, cross-domain generalization remains a persistent challenge due to variations in appliance characteristics, usage patterns, and background loads across homes. Transfer learning provides a practical paradigm to adapt models with limited target data. However, existing methods often assume a fixed appliance set, lack flexibility for evolving real-world deployments, remain unsuitable for edge devices, or scale poorly for real-time operation. This paper proposes RefQuery, a scalable multi-appliance, multi-task NILM framework that conditions disaggregation on compact appliance fingerprints, allowing one shared model to serve many appliances without a fixed output set. RefQuery keeps a pretrained disaggregation network fully frozen and adapts to a target home by learning only a per-appliance embedding during a lightweight backpropagation stage. Experiments on three public datasets demonstrate that RefQuery delivers a strong accuracy-efficiency trade-off against single-appliance and multi-appliance baselines, including modern Transformer-based methods. These results support RefQuery as a practical path toward scalable, real-time NILM on resource-constrained edge devices.
Figures & tables
Fig. 1: Three-stage RefQuery framework. Stage I: the model is trained on multiple source buildings using several appliances per building with joint power (MSE) and state (BCE) supervision; Stage II: in the target domain, the model is frozen and a target-specific reference embedding is learned per appliance using joint power (MSE) and state (BCE) supervision; Stage III: target mains is disaggregated into per-appliance state and power using the learned embeddings.
Fig. 2: Compact 1D CNN feature extractor for embedding generation.
Fig. 3: Multitask head architecture. Given the reference and query embeddings er,eq∈RE , the interaction module constructs a joint representation by concatenating [er,eq,(eq−er)2,eq⊙er] , where ⊙ denotes element-wise multiplication. The resulting 4E -dimensional vector is processed by two shared fully connected layers with ReLU activations and width H to produce a shared representation. Two task-specific branches are then applied: a classification head (dense + sigmoid) predicts the state probability y^state∈R , and a regression head (dense + ReLU) estimates a non-negative magnitude Δz∈R . The final standardized power estimate is computed through a gated transformation y^z=Δzy^state+boff , where boff=−μ/σ anchors the OFF operating point in z -space.
Metric
Method
UK-DALE (% change)
F
DW
MW
WM
K
Ave
Δ MAE
SA-S2P
41.2
165.1
6.7
65.9
118.3
63.5
MA-CNN
52.3
132.5
39.0
96.0
81.8
70.5
MA-TRF
7.8
54.6
3.9
30.4
60.9
23.3
RefQuery
22.1
18.1
-1.3
15.6
14.9
16.1
Δ F1
SA-S2P
-15.9
-40.2
87.5
-26.1
-40.2
-23.6
TABLE V: Relative changes on UK-DALE (Limited Data vs. Normal) for House 1, in %. Positive Δ MAE indicates worse error; negative Δ F1 indicates worse accuracy. Best (per appliance/column) is in bold.
Metric
Method
REDD House 1 (% change)
F
DW
MW
WM
Ave
Δ MAE
SA-S2P
30.7
47.3
12.5
8.3
21.3
MA-CNN
26.5
103.8
69.3
-8.1
31.2
MA-TRF
15.1
6.8
19.6
19.3
16.2
RefQuery
16.2
12.4
38.4
8.5
18.9
Δ F1
SA-S2P
-7.4
-12.3
-17.8
-50.8
-19.9
TABLE VII: Relative changes on REDD (Limited Data vs. Normal) for House 1, in %. Positive Δ MAE indicates worse error; negative Δ F1 indicates worse accuracy. Best (per appliance/column) is in bold.
Method
Storage (MB) ↓
Adaptation (s) ↓
Inference (s) ↓
SA-S2P
334.50
5400.3
391.07
MA-CNN
2.38
4950.5
115.11
MA-TRF
11.81
4429.5
248.86
RefQuery
1.18
63.2
42.41
TABLE VIII: Computational comparison of the methods for single-appliance adaptation using 7 days of data, followed by one-month offline inference, evaluated under a CPU-only constrained execution regime (process affinity limited to two CPU cores and thread-level parallelism limited to two threads).
Method
ΔW (KB) ↓
Incremental?
Inference scaling (MFLOPs) ↓
SA-S2P
3.4×105
Yes a
0.000+K⋅101.289
MA-CNN
≈1
No c
13.295+K⋅0.000129
MA-TRF
4.6×103
Yes b
889.560+K⋅1142.726
RefQuery
≈1
Yes
4.145+K⋅0.165
TABLE IX: Scalability with number of appliances K . ΔW is the additional storage per added appliance. “Incremental” means adding an appliance without updating shared parameters. Inference scaling is reported in MFLOPs/(mains window) as b+K⋅m , where b is the K -independent compute (shared cost) and m is the additional MFLOPs per added appliance.
Non-intrusive load monitoring (NILM) estimates appliance-level consumption from a whole-home meter, but appliance-specific models and fixed output inventories make coverage costly to extend. We present FM4NILM (Foundation Model for NILM), a single prompt-programmable model that estimates a requested appliance's power trajectory from aggregate measurements, a natural-language description, and optional activation exemplars. A lightweight cadence-aware transformer is pretrained by masked reconstruction on 645k sequences from seven public corpora spanning 1-60 s sampling intervals, then aligned with appliance requests using observation-masked losses for partially labeled households. A Bernoulli-lognormal decoder separates activity detection from conditional power estimation. On held-out households and time periods from REDD, UK-DALE, and REFIT, one frozen text-prompted model serves twelve appliance-corpus requests, achieving 0.556 event F1, 0.625 AUPRC, and the lowest active-window MAE (251.8 W) among seven appliance-specific baselines. Streaming score aggregation raises event F1 to 0.582 with a 60 s aggregation delay. In a separate category-held-out evaluation, adding ten activation exemplars raises microwave AUPRC from 0.132 to 0.214 without parameter updates. Input-intervention ablations probe the model's dependence on appliance requests and aggregate measurements. These results demonstrate competitive disaggregation with one shared model and support extending appliance coverage through prompts and examples rather than additional specialist networks.
Xudong Wang, Jiacheng Cui, Junyu Xue +2
The Chinese University of Hong Kong, Shenzhen · The Hong Kong University of Science and Technology (Guangzhou) · Southern University of Science and Technology
Non-Intrusive Load Monitoring (NILM) offers a cost-effective method to obtain fine-grained appliance-level energy consumption in smart homes and building applications. However, the increasing adoption of behind-the-meter (BTM) energy sources such as solar panels and battery storage poses new challenges for conventional NILM methods that rely solely on at-the-meter data. The energy injected from the BTM sources can obscure the power signatures of individual appliances, leading to a significant decrease in NILM performance. To address this challenge, we present DualNILM, a deep multi-task learning framework designed for the dual tasks of appliance state recognition and injected energy identification. Using a Transformer-based architecture that integrates sequence-to-point and sequence-to-sequence strategies, DualNILM effectively captures multiscale temporal dependencies in the aggregate power consumption patterns, allowing for accurate appliance state recognition and energy injection identification. Extensive evaluation on self-collected and synthesized datasets demonstrates that DualNILM maintains an excellent performance for dual tasks in NILM, much outperforming conventional methods. Our work underscores the framework's potential for robust energy disaggregation in modern energy systems with renewable penetration. Synthetic photovoltaic augmented datasets with realistic injection simulation methodology are open-sourced at https://github.com/MathAdventurer/PV-Augmented-NILM-Datasets.
Xudong Wang, Guoming Tang, Junyu Xue +3
The Chinese University of Hong Kong, Shenzhen · The Hong Kong University of Science and Technology (Guangzhou) · Southern University of Science and Technology +1
Non-intrusive load monitoring (NILM) estimates appliance power sequences from aggregate power, but models trained on source households commonly lose accuracy in unseen households. Aggregate power also contains loads from other appliances and measurement error, so predictions may depend on the residual background that co-occurs with source-household targets. Time-aligned submetered measurements and the additive decomposition of aggregate power expose a relation unused by window-wise supervision: an aggregate window can be recomposed by replacing only its residual background while preserving all modeled target-appliance power sequences pointwise. We combine label-preserving aggregate recomposition with prediction consistency. Both windows receive complete power and operating-state supervision. For each appliance, disagreement between the two power predictions is penalized only when both satisfy a fixed reliability criterion and only to the extent that it exceeds a fixed margin. The proposed method is implemented using a multi-appliance architecture with two-stage shared-to-specific mixture-of-experts routing. On REDD, UK-DALE, and REFIT, the proposed method lowers appliance-averaged mean absolute error relative to single-window training from 14.75 to 13.14 W, from 8.88 to 8.51 W, and from 15.83 to 14.55 W. Label-preserving aggregate recomposition and prediction consistency are used only during training, and add no inference-time module or parameter.
Jiangfeng Liu, Yanfang Fan
School of Electrical Engineering, Xinjiang University, Urumqi, Xinjiang 830047, China