Motion Semantics Guided Normalizing Flow for Privacy-Preserving Video Anomaly Detection
Organizations: Tongji Univ. · SJTU · Shanghai Creative Studies Institute · UBC · Fudan Univ. · Cardiff Univ. · DKU
Abstract
As embodied perception systems increasingly bridge digital and physical realms in interactive multimedia applications, the need for privacy-preserving approaches to understand human activities in physical environments has become paramount. Video anomaly detection is a critical task in such embodied multimedia systems for intelligent surveillance and forensic analysis. Skeleton-based approaches have emerged as a privacy-preserving alternative that processes physical world information through abstract human pose representations while discarding sensitive visual attributes such as identity and facial features. However, existing skeleton-based methods predominantly model continuous motion trajectories in a monolithic manner, failing to capture the hierarchical nature of human activities composed of discrete semantic primitives and fine-grained kinematic details, which leads to reduced discriminability when anomalies manifest at different abstraction levels. In this regard, we propose Motion Semantics Guided Normalizing Flow (MSG-Flow) that decomposes skeleton-based VAD into hierarchical motion semantics modeling. It employs vector quantized variational auto-encoder to discretize continuous motion into interpretable primitives, an autoregressive Transformer to model semantic-level temporal dependencies, and a conditional normalizing flow to capture detail-level pose variations. Extensive experiments on benchmarks (HR-ShanghaiTech & HR-UBnormal) demonstrate that MSG-Flow achieves state-of-the-art performance with 88.1% and 75.8% AUC respectively.
Figures & tables
| Method | Venue | HR-STC (%) | HR-UBnormal (%) |
|---|---|---|---|
| MPED-RNN [ 22 ] | CVPR’19 | 75.4 | 61.2 |
| GEPC [ 23 ] | CVPR’20 | 74.8 | 55.2 |
| Multi-Time [ 25 ] | WACV’20 | 77.0 | – |
| MoCoDAD [ 41 ] | ICCV’23 | 77.6 | 68.4 |
| STG-NF [ 21 ] | ICCV’23 | 87.4 | 71.8 |
| COSKAD-Eucl [ 38 ] | PR’24 | 77.1 | 65.0 |
| Variant | HR-STC (%) | HR-UBnormal (%) | Params (M) |
|---|---|---|---|
| VQ-VAE Only | 82.3 | 68.5 | 4.9 |
| w/o Primitive Flow | 85.2 | 72.1 | 5.3 |
| w/o Detail Flow | 83.7 | 69.8 | 5.3 |
| Fixed | 87.4 | 74.9 | 10.3 |
| Full Model | 88.1 | 75.8 | 10.3 |
| Config. | HR-STC (%) | HR-UBnormal (%) | Codebook Usage (%) |
|---|---|---|---|
| w/o | 86.5 | 73.8 | 62.3 |
| w/o | 85.9 | 72.4 | 89.7 |
| 87.6 | 75.2 | 78.4 | |
| 87.3 | 74.7 | 91.2 | |
| Full ( ) | 88.1 | 75.8 | 85.5 |