Choosing an energy-efficient software architecture for building system diagnostic support
Organizations: Graz University of Technology Institute of Software Engineering and Artificial Intelligence Inffeldgasse 16b/2, A-8010 Graz, Austria
Abstract
Around 30% of global energy expenditure can be attributed to the building sector, where a large portion of energy-consumption could be avoided by repairing existing faults. Fault detection and diagnosis (FDD) software addresses this issue; however, its creation and operation also have an environmental impact. The magnitude of this impact is influenced by the diagnosis architecture, as different architectures and methods have different energy demands. Yet, simply considering the energy consumed by the software itself is not sufficient to assess its overall environmental impact, since the diagnostic performance, e.g., number of detected faults or number of faults missed, also contributes to its ecological footprint. In this paper, we propose an energy-consumption model that considers FDD performance and energy spend directly by the diagnosis software. In an initial experiment, we compare several FDD architecture families, i.e., rule-based, model-based, classical machine learning, and large-language-model-based, in simulation using performance and energy-consumption values collected from prior literature. The results show that considering the computational energy and accuracy of FDD can change the relative benefit of the different approaches. Computationally efficient machine learning methods, such as random forest, provide the largest net savings on smaller buildings, whereas more resource-intensive approaches, such as fine-tuned large language models, become advantageous as building size increases. Our findings suggest that overall energy efficiency depends not only on the computational demand of the FDD software, but also on its diagnostic performance and the scale of the building.
Figures & tables
| Parameter | Explanation | Unit | Range |
|---|---|---|---|
| Energy use intensity per year | kWh/(m year) | [0, ) | |
| Area of building | m 2 | [0, ) | |
| Fraction of energy-consumption used for HVAC | 1 | [0,1] | |
| Fraction of HVAC energy-consumption in case of faults | 1 | [0,1] | |
| Annual true positive rate of diagnosis method | 1 | [0,1] | |
| Annual false positive rate of diagnosis method | 1 | [0,1] |
| Parameter | Explanation | Unit | Range |
|---|---|---|---|
| Degree to which the model is used exclusively for diagnosis | 1 | (0,1] | |
| Number of additional model retrainings within the considered year | 1 | ||
| Energy-consumption of one inference operation | kWh/inference | ||
| Number of inference operations within the considered year | inferences/year |
| Diagnosis method | TPR | FPR | ||||
|---|---|---|---|---|---|---|
| Min | Max | Avg. | Min | Max | Avg. | |
| RB | 0.11 | 0.39 | 0.25 | 0.00 | 0.05 | 0.03 ∗ |
| (Hybrid)MBD | 0.20 a | 1.00 a | 0.60 | 0.00 | 0.07 | 0.03 |
| DT | 0.17 | 1.00 | 0.61 | 0.03 c | 0.01 | |
| RF | 0.17 | 1.00 | 0.69 | |||
| LR | 0.38 | 0.44 | 0.41 ∗ | 0.00 e | 0.53 f | 0.27 ∗ |
| Diagnosis method | Ref. | |||||
|---|---|---|---|---|---|---|
| Min | Max | Min | Max | |||
| RB a | 0 | 0 | 1 | [ 34 ] | ||
| MBD a | 0 | 0 | 1 | [ 33 ] | ||
| DT | 1 | [ 22 ] | ||||
| RF | 1 | [ 56 ] | ||||
| LR | 1 | [ 56 ] | ||||
| Method | |||||||
|---|---|---|---|---|---|---|---|
| 1 | 1000.00 | RB | 140584.96 | 133715.29 | 133715.30 | 4.89 | 4.89 |
| 2 | 1000.00 | MBD | 140584.96 | 123932.96 | 123946.20 | 11.84 | 11.84 |
| 3 | 1000.00 | DT | 140584.96 | 124226.09 | 124230.61 | 11.64 | 11.63 |
| 4 | 1000.00 | RF | 140584.96 | 124133.26 | 124133.26 | 11.70 | 11.70 |
| 5 | 1000.00 | LR | 140584.96 | 130696.54 | 130696.55 | 7.03 | 7.03 |
| 6 | 1000.00 | SVM | 140584.96 | 125138.82 | 125138.89 | 10.99 | 10.99 |
| Method | ||||||
|---|---|---|---|---|---|---|
| 1 | RB | 774327.98 | 736628.85 | 736628.86 | 4.87 | 4.87 |
| 2 | MBD | 774327.98 | 682419.45 | 682428.60 | 11.87 | 11.87 |
| 3 | DT | 774327.98 | 680189.37 | 680192.49 | 12.16 | 12.16 |
| 4 | RF | 774327.98 | 667458.02 | 667458.03 | 13.80 | 13.80 |
| 5 | LR | 774327.98 | 720022.36 | 720022.36 | 7.01 | 7.01 |
| 6 | SVM | 774327.98 | 666806.41 | 666806.46 | 13.89 | 13.89 |
| Method | ||||||
|---|---|---|---|---|---|---|
| 1 | RB | 8531.38 | 8115.97 | 8115.97 | 4.87 | 4.87 |
| 2 | MBD | 8531.38 | 7518.62 | 7527.77 | 11.87 | 11.76 |
| 3 | DT | 8531.38 | 7494.05 | 7497.18 | 12.16 | 12.12 |
| 4 | RF | 8531.38 | 7353.76 | 7353.76 | 13.80 | 13.80 |
| 5 | LR | 8531.38 | 7932.98 | 7932.98 | 7.01 | 7.01 |
| 6 | SVM | 8531.38 | 7346.58 | 7346.63 | 13.89 | 13.89 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Paper ID | Chiller/ AHU | Summary | Method | TPR/Recall | TPR note | FPR | FPR note | TN | TP | FN | FP |
|---|---|---|---|---|---|---|---|---|---|---|---|
| [ 47 ] | Chiller | Centrifugal chiller (ASHRAE benchmark); nominal operation and 8 single-fault conditions at multiple severities and operating conditions. Generalized likelihood ratio test (GLRT) performs detection; SVM, principal component analysis (PCA), and partial least squares (PLS) are used for fault classification. Reported: Classification Rate/Accuracy, average % errors | SVM fault classifier (variant/kernel not reported) | NR | NR | NR | NR | NR | NR | NR | NR |
| [ 72 ] | Chiller | ASHRAE RP-1043 90-ton chiller; five faults at 10–40% severity; Compares direct SVM, regression-residual+SVM, auto-regressive moving-average model with exogenous variables (ARX)+MLP, and ARX+SVM | SVM (RBF) | NR | NR | 0.20 | Paper reports false-alarm value 20.22 | NR | NR | NR | NR |
| regression-residual+SVM | NR | NR | 0.07 | Paper reports false-alarm value 7.38 | NR | NR | NR | NR | |||
| ARX+MLP | NR | NR | 0.02 | Paper reports false-alarm value 1.83 | NR | NR | NR | NR | |||
| ARX+ SVM | NR | NR | ¡ 0.00 | Paper reports false-alarm value 0.11 | NR | NR | NR | NR | |||
| [ 46 ] | AHU | ASHRAE RP-1312 AHU; 11 faults. ReliefF feature selection, ARX parameters, SVM( RBF kernel +C-support vector classification (C-SVC)); Compares to raw-data ML baselines. | SVM (RBF+C-SVC) + ReliefF + ARX | 0.921 | Over all 11 fault classes | NR | NR | NR | NR | NR | NR |
| Paper ID | Chiller/ AHU | Summary | Method | TPR/Recall | TPR note | FPR | FPR note | TN | TP | FN | FP |
|---|---|---|---|---|---|---|---|---|---|---|---|
| [ 10 ] | Chiller | ASHRAE RP-1043 centrifugal chiller. Model-based with adaptive fault detection threshold estimator. Five fault types over four severity levels. | MBD | 0.51, 0.62, 0.20, 0.69, 1.00 | Detection rates for: reduced evaporator-water flow, refrigerant leakage, excess oil, condenser fouling, and non-condensables | NR | The paper reports a “false alarm rate”, but its denominator is not sufficiently clear to treat it as FPR. | NR | NR | NR | NR |
| [ 49 ] | Chiller | Real-building BMS chiller data; Logistic-circuit decision tree to determine patterns predicts alarms. | Decision tree | 0.76 | Reported | 0.000385 | Computed | 83061 | 162 | 51 | 32 |
| [ 44 ] | AHU | UT Austin main-campus BAS data; chilled-water leakage classification; final tuned model. | Decision tree (chilled water) | 0.990361 | Computed | 0.012251 | Computed | 13061 | 8322 | 81 | 162 |
| Decision tree (steam) | 0.966288 | Computed | 0.026026 | Computed | 50745 | 40272 | 1405 | 1356 | |||
| [ 40 ] | Chiller | EnergyPlus-Modelica SDAHU dataset; single-fault binary classification | LLM (fine-tuned) - Fine-tuned DistilBERT | 0.98 | Derived from reported FNR | 0.02 | Reported | NR | NR | NR | NR |
| AHU | EnergyPlus-Modelica SDAHU dataset; single-fault binary classification | LLM (fine-tuned) - Fine-tuned DistilBERT | 0.99 | Derived from reported FNR | 0.01 | Reported | NR | NR | NR | NR |