Trivial Graph Features and Classical Learning are Enough to Detect Random Anomalies
Organizations: CNRS, LIP6 Sorbonne Universit´e Paris, France · Efrei Research Lab Efrei Paris Panth´eon-Assas Universit´e Villejuif, France
Abstract
Detecting anomalies in link streams that represent various kinds of interactions is an important research topic with crucial applications. Because of the lack of ground truth data, proposed methods are mostly evaluated through their ability to detect randomly injected links. In contrast with most proposed methods, that rely on complex approaches raising computational and/or interpretability issues, we show here that trivial graph features and classical learning techniques are sufficient to detect such anomalies extremely well. This basic approach has very low computational costs and it leads to easily interpretable results. It also has many other desirable properties that we study through an extensive set of experiments. We conclude that detection methods should now target more complex kinds of anomalies.
Figures & tables
| Dataset | |||
|---|---|---|---|
| Bitcoin-Alpha | 3,783 | 14,124 | 24,186 |
| Bitcoin-OTC | 5,881 | 21,492 | 35,592 |
| DNC Emails | 1,866 | 5,517 | 37,421 |
| UCI Messages | 1,899 | 13,838 | 59,835 |
| Digg | 30,360 | 85,151 | 86,199 |
| Internet Topo. | 34,761 | 107,720 | 171,403 |
| UCI Messages | Digg | DNC Emails | Bitcoin-Alpha | Bitcoin-OTC | Internet Topology | |||||||||||||
| 1% | 5% | 10% | 1% | 5% | 10% | 1% | 5% | 10% | 1% | 5% | 10% | 1% | 5% | 10% | 1% | 5% | 10% | |
| SedanSpot | 0.7342 | 0.7156 | 0.7061 | 0.6976 | 0.6784 | 0.6396 | 0.7427 | 0.7362 | 0.7235 | 0.7380 | 0.7264 | 0.7085 | 0.7346 | 0.7284 | 0.7156 | 0.6873 | 0.6742 | 0.6672 |
| CM-Sketch | 0.7320 | 0.6968 | 0.6835 | 0.6884 | 0.6675 | 0.6358 | 0.7053 | 0.6946 | 0.6876 | 0.7146 | 0.7015 | 0.6887 | 0.7412 | 0.7338 | 0.7242 | 0.6687 | 0.6605 | 0.6558 |
| Node2Vec | 0.7371 | 0.7433 | 0.6960 | 0.7364 | 0.7081 | 0.6508 | 0.7391 | 0.7284 | 0.7103 | 0.6910 | 0.6802 | 0.6785 | 0.6951 | 0.6883 | 0.6745 | 0.6821 | 0.6752 | 0.6668 |
| DeepWalk | 0.7514 | 0.7391 | 0.6979 | 0.7080 | 0.6881 | 0.6396 | 0.7481 | 0.7303 | 0.7197 | 0.6985 | 0.6874 | 0.6793 | 0.7423 | 0.7356 | 0.7287 | 0.6844 | 0.6793 | 0.6682 |
| NetWalk | 0.7758 | 0.7647 | 0.7226 | 0.7563 | 0.7176 | 0.6837 | 0.8105 | 0.8371 | 0.8305 | 0.8385 | 0.8357 | 0.8350 | 0.7785 | 0.7694 | 0.7534 | 0.8018 | 0.8066 | 0.8058 |
| 1% | 5% | 10% | ||
|---|---|---|---|---|
| Bitcoin-Alpha | SLADE | 0 2 21 | 0 2 35 | 0 2 39 |
| TGF | 0 0 5.56 | 0 0 5.55 | 0 0 5.53 | |
| Bitcoin-OTC | SLADE | 0 5 30 | 0 6 3 | 0 6 29 |
| TGF | 0 0 11.82 | 0 0 12.89 | 0 0 16.71 | |
| Digg | SLADE | 0 41 38 | 0 44 55 | 0 47 56 |
| TGF | 0 0 19.89 | 0 0 24.76 | 0 0 27.37 | |
Anomaly Detection
Anomaly detection finds rare or unexpected patterns in data, from defective products and system faults to fraud and security threats.
See all 631 papers