SMT-AD: a scalable quantum-inspired anomaly detection approach
Organizations: Science, Mathematics and Technology Cluster, Singapore University of Technology and Design, 8 Somapah Road, 487372 Singapore · Centre for Quantum Technologies, National University of Singapore 117543, Singapore · Artificial Intelligence and Data Analytics Strategic Technology Centre, ST Engineering · Home Team Science and Technology Agency, 1 Stars Ave, 138507 Singapore · Engineering Product Development Pillar, Singapore University of Technology and Design, 8 Somapah Road, 487372 Singapore
Abstract
Quantum-inspired tensor networks algorithms have shown to be effective and efficient models for machine learning tasks, including anomaly detection. Here, we propose a highly parallelizable quantum-inspired approach which we call SMT-AD from Superposition of Multiresolution Tensors for Anomaly Detection. It is based upon the superposition of bond-dimension-1 matrix product operators to transform the input data with Fourier-assisted feature embedding, where the number of learnable parameters grows linearly with feature size, embedding resolutions, and the number of additional components in the matrix product operators structure. We demonstrate successful anomaly detection when applied to standard datasets, including credit card transactions, and find that, even with minimal configurations, it achieves competitive performance against established anomaly detection baselines. Furthermore, it provides a straightforward way to reduce the weight of the model and even improve the performance by highlighting the most relevant input features.
Figures & tables
| Dataset | #Training | #Test | #Feature | |
|---|---|---|---|---|
| Normal | Anomalous | |||
| Wine | 59 | 60 (85.7%) | 10 (14.3%) | 13 |
| Lympho | 71 | 71 (92.2%) | 6 (7.8 %) | 18 |
| Thyroid | 1839 | 1840 (95.2%) | 93 (4.8%) | 6 |
| Satellite | 2199 | 2200 (51.9%) | 2036 (48.1%) | 36 |
| Credit Card | 142403 | 142404 (99.83%) | 492 (0.17%) | 30 |
| Dataset | AUROC | AUPRC | ||||||
|---|---|---|---|---|---|---|---|---|
| OC-SVM | IF | TNAD | SMT-AD | OC-SVM | IF | TNAD | SMT-AD | |
| Wine | ||||||||
| Lympho | ||||||||
| Thyroid | ||||||||
| Satellite | ||||||||
| Credit Card | ||||||||
| AUROC | AUPRC | |
|---|---|---|
| Full features | ||
| Features selection |
| Model | #Parameter | Time ( ∗ per epoch) | Hyperparameters | #Parameter | Training time (s) | Infer time ( s) |
|---|---|---|---|---|---|---|
| OC-SVM | 45075 | 35.83 53.86 | 115.64 155.21 | |||
| IF | (expected) | 20348 | 0.21 0.01 | 4.29 0.06 | ||
| TNAD | 17280 | 1415.28 142.51 | 319.71 35.00 | |||
| SMT-AD | 620 | 864.48 109.29 | 45.41 7.25 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Hyperparameters | AUROC | AUPRC | |||
|---|---|---|---|---|---|
| TNAD | SMT-AD | TNAD | SMT-AD | TNAD | SMT-AD |
| 97.8 0.2 | 79.4 0.1 | 98.6 0.1 | 22.3 0.1 | ||