Weakly supervised video anomaly detection aims to detect anomalies and identify abnormal categories with only video-level labels. We propose CPL-VAD, a dual-branch framework with cross pseudo labeling. The binary anomaly detection branch focuses on snippet-level anomaly localization, while the category classification branch leverages vision-language alignment to recognize abnormal event categories. By exchanging pseudo labels, the two branches transfer complementary strengths, combining temporal precision with semantic discrimination. Experiments on XD-Violence and UCF-Crime demonstrate that CPL-VAD achieves state-of-the-art performance in both anomaly detection and abnormal category classification.
Figures & tables
Figure 1: Cross pseudo labeling framework.
Figure 2: The framework of CPL-VAD and Consistency-Aware Refinement module.
Figure 3: Qualitative results of CPL-VAD on XD-Violence.
Dataset@Metric
Method
XD@AP(%)
UCF@AUC(%)
MSLNET [ 4 ]
78.59
85.62
Zhang et al. [ 15 ]
78.74
86.22
OVVAD [ 12 ]
66.53
86.40
CLIP-TSA [ 2 ]
82.19
87.58
IFS-VAD [ 18 ]
83.14
86.57
Table 1: Coarse-grained comparisons on XD-Violence and UCF-Crime.
mAP@IoU
Method
0.1
0.2
0.3
0.4
0.5
Avg
RAD [ 7 ]
22.72
15.57
9.98
6.20
3.78
11.65
AVVD [ 11 ]
30.51
25.75
20.18
14.83
9.79
20.21
XD
VadCLIP [ 13 ]
37.03
30.84
23.38
17.90
14.31
24.70
CPL-VAD
45.89
40.28
33.49
27.59
20.40
33.53
RAD [ 7 ]
5.73
4.41
2.69
1.93
1.44
3.24
Table 2: Fine-grained comparisons on XD-Violence and UCF-Crime.
Pseudo label
Dataset
B → C
C → B
self
CAR
XD@AP, mAP(%)
UCF@AUC, mAP(%)
76.50, 29.97
86.60, 6.68
✓
✓
83.70, 31.47
87.34, 7.43
✓
✓
83.30, 32.43
87.04, 7.29
✓
✓
88.28, 27.75
87.61, 6.79
✓
✓
78.91, 31.86
86.42, 8.30
Table 3: Ablation studies of pseudo label structure and consistency-aware refinement module.
Figure 4: Comparison of qualitative results without and with cross pseudo labeling.
Recent weakly supervised video anomaly detection methods have achieved significant advances by employing unified frameworks for joint optimization. However, this paradigm is limited by a fundamental sensitivity-stability trade-off, as the conflicting objectives for detecting transient and sustained anomalies lead to either fragmented predictions or over-smoothed responses. To address this limitation, we propose DeSC, a novel Decoupled Sensitivity-Consistency framework that trains two specialized streams using distinct optimization strategies. The temporal sensitivity stream adopts an aggressive optimization strategy to capture high-frequency abrupt changes, whereas the semantic consistency stream applies robust constraints to maintain long-term coherence and reduce noise. Their complementary strengths are fused through a collaborative inference mechanism that reduces individual biases and produces balanced predictions. Extensive experiments demonstrate that DeSC establishes new state-of-the-art performance by achieving 89.37% AUC on UCF-Crime (+1.29%) and 87.18% AP on XD-Violence (+2.22%). Code is available at https://github.com/imzht/DeSC.
Hantao Zheng, Ning Han, Yawen Zeng +1
School of Computer Science, Hunan University, China · School of Computer Science, Xiangtan University, China
Weakly supervised video anomaly detection (WS-VAD) involves identifying the temporal intervals that contain anomalous events in untrimmed videos, where only video-level annotations are provided as supervisory signals. However, a key limitation persists in WS-VAD, as dense frame-level annotations are absent, which often leaves existing methods struggling to learn anomaly semantics effectively. To address this issue, we propose a novel framework named LAS-VAD, short for Learning Anomaly Semantics for WS-VAD, which integrates anomaly-connected component mechanism and intention awareness mechanism. The former is designed to assign video frames into distinct semantic groups within a video, and frame segments within the same group are deemed to share identical semantic information. The latter leverages an intention-aware strategy to distinguish between similar normal and abnormal behaviors (e.g., taking items and stealing). To further model the semantic information of anomalies, as anomaly occurrence is accompanied by distinct characteristic attributes (i.e., explosions are characterized by flames and thick smoke), we additionally incorporate anomaly attribute information to guide accurate detection. Extensive experiments on two benchmark datasets, XD-Violence and UCF-Crime, demonstrate that our LAS-VAD outperforms current state-of-the-art methods with remarkable gains.
Yu Wang, Shengjie Zhao
School of Computer Science and Technology, Tongji University, Shanghai, China
Weakly supervised video anomaly detection relies solely on video-level labels for training, making it difficult to accurately localize anomalous events in complex scenes. In real-world videos, anomalous behaviors exhibit large variations in appearance and temporal duration, while scene appearance and action dynamics are often tightly entangled. Consequently, existing models tend to rely on scene-related statistical cues rather than true behavioral deviations, resulting in unstable detection performance. To address this challenge, we propose a Structured Evidence Selection framework (SESAD) that reformulates anomaly detection as a structured reasoning process over clip-level visual evidence. Instead of directly mapping aggregated features to anomaly scores, SESAD reorganizes clip representations into semantically structured candidate evidence and performs context-conditioned selection under scene and action constraints. This mechanism adaptively emphasizes anomaly-relevant semantics while suppressing scene interference, thereby alleviating semantic entanglement under weak supervision. Furthermore, we introduce a lightweight geometric discrimination module that constructs a dual-prototype structure in the embedding space, enabling anomaly decisions through relative geometric relations. Extensive experiments on UBnormal, ShanghaiTech, and UCF-Crime show that SESAD achieves 67.92, 97.99, and 88.46 AUC, respectively, while maintaining high computational efficiency and overall consistently stable anomaly discrimination.
Chenglizhao Chen, Tianxiang Nan, Wen Li +4
China University of Petroleum (East China) Qingdao, China