Recent weakly supervised video anomaly detection methods have achieved significant advances by employing unified frameworks for joint optimization. However, this paradigm is limited by a fundamental sensitivity-stability trade-off, as the conflicting objectives for detecting transient and sustained anomalies lead to either fragmented predictions or over-smoothed responses. To address this limitation, we propose DeSC, a novel Decoupled Sensitivity-Consistency framework that trains two specialized streams using distinct optimization strategies. The temporal sensitivity stream adopts an aggressive optimization strategy to capture high-frequency abrupt changes, whereas the semantic consistency stream applies robust constraints to maintain long-term coherence and reduce noise. Their complementary strengths are fused through a collaborative inference mechanism that reduces individual biases and produces balanced predictions. Extensive experiments demonstrate that DeSC establishes new state-of-the-art performance by achieving 89.37% AUC on UCF-Crime (+1.29%) and 87.18% AP on XD-Violence (+2.22%). Code is available at https://github.com/imzht/DeSC.
Figures & tables
Fig. 1: The sensitivity–stability trade-off. (a) Unified Optimization Dilemma. Prioritizing sensitivity yields fragmented predictions (bottom), whereas enforcing stability leads to over-smoothed responses (top). (b) DeSC resolves this via two decoupled and collaborative streams. GT denotes ground truth.
Fig. 2: Overview of the DeSC framework. DeSC uses frozen CLIP features and two decoupled streams optimized with distinct objectives. The Temporal Sensitivity Stream applies an acausal TCN and graph transformer to capture transient anomalies under aggressive optimization, while the Semantic Consistency Stream uses a local transformer, global GCN, and multimodal Gaussian prior to maintain stable long-range semantics under robust optimization. Sliding-window test-time augmentation and collaborative fusion integrate both outputs for final anomaly scores.
Method
Feature
UCF (AUC %)
XD (AP %)
Sultani et al. [ 7 ]
I3D
75.41
73.20
RTFM [ 8 ]
I3D
84.30
77.81
LA-Net [ 6 ]
I3D
85.12
80.72
MSL [ 4 ]
I3D
85.30
78.28
MGFN [ 1 ]
I3D
86.98
80.11
UR-DMU [ 16 ]
I3D
86.97
81.66
TABLE I: Comparison with state-of-the-art methods on UCF-Crime and XD-Violence datasets. Best results are in bold .
Method
Opt. Strategy
UCF (AUC %)
XD (AP %)
Unified
Joint
86.18
80.22
Temp. Stream
Decoupled
88.46
85.04
Sem. Stream
Decoupled
88.35
85.48
DeSC
Collaborative
89.37
87.18
TABLE II: Ablation study on the optimization paradigm. We compare the joint training strategy against our decoupled optimization strategy. “Unified” denotes training the TCN, GT, and GMP modules jointly. “Temp.” and “Sem.” denote the Temporal Sensitivity and Semantic Consistency streams.
Method
Inference Strategy
UCF (AUC %)
XD (AP %)
DeSC
Basic Ensemble
89.13
86.47
DeSC
w/ TTA (Sliding Window)
89.37
87.18
TABLE III: Effectiveness of the collaborative inference strategy. We compare the basic ensemble with the proposed test-time augmentation (TTA) using sliding windows.
Module Configuration
UCF (AUC %)
XD (AP %)
Temporal Sensitivity Stream
TCN Only
85.80
79.78
Graph Transformer (GT) Only
86.26
84.55
Parallel TCN + GT (Ours)
88.46
85.04
Semantic Consistency Stream
GCN Baseline (w/o GMP)
87.70
84.67
TABLE IV: Ablation study on internal module designs. We evaluate the contribution of key components within each stream using their respective optimal training protocols.
Fig. 3: Qualitative comparison on XD-Violence and UCF-Crime. Curves show anomaly scores from the Temporal Sensitivity Stream ( blue ), the Semantic Consistency Stream ( yellow ), and their fusion in DeSC ( red ). Color bars below display binary detections aligned with the ground truth ( grey ).
Weakly supervised video anomaly detection relies solely on video-level labels for training, making it difficult to accurately localize anomalous events in complex scenes. In real-world videos, anomalous behaviors exhibit large variations in appearance and temporal duration, while scene appearance and action dynamics are often tightly entangled. Consequently, existing models tend to rely on scene-related statistical cues rather than true behavioral deviations, resulting in unstable detection performance. To address this challenge, we propose a Structured Evidence Selection framework (SESAD) that reformulates anomaly detection as a structured reasoning process over clip-level visual evidence. Instead of directly mapping aggregated features to anomaly scores, SESAD reorganizes clip representations into semantically structured candidate evidence and performs context-conditioned selection under scene and action constraints. This mechanism adaptively emphasizes anomaly-relevant semantics while suppressing scene interference, thereby alleviating semantic entanglement under weak supervision. Furthermore, we introduce a lightweight geometric discrimination module that constructs a dual-prototype structure in the embedding space, enabling anomaly decisions through relative geometric relations. Extensive experiments on UBnormal, ShanghaiTech, and UCF-Crime show that SESAD achieves 67.92, 97.99, and 88.46 AUC, respectively, while maintaining high computational efficiency and overall consistently stable anomaly discrimination.
Chenglizhao Chen, Tianxiang Nan, Wen Li +4
China University of Petroleum (East China) Qingdao, China
Weakly supervised video anomaly detection aims to detect anomalies and identify abnormal categories with only video-level labels. We propose CPL-VAD, a dual-branch framework with cross pseudo labeling. The binary anomaly detection branch focuses on snippet-level anomaly localization, while the category classification branch leverages vision-language alignment to recognize abnormal event categories. By exchanging pseudo labels, the two branches transfer complementary strengths, combining temporal precision with semantic discrimination. Experiments on XD-Violence and UCF-Crime demonstrate that CPL-VAD achieves state-of-the-art performance in both anomaly detection and abnormal category classification.
Dayeon Lee, Donghyeong Kim, Chaewon Park +2
Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Korea · Samsung Electronics, Suwon, Korea
Weakly supervised video anomaly detection (WS-VAD) involves identifying the temporal intervals that contain anomalous events in untrimmed videos, where only video-level annotations are provided as supervisory signals. However, a key limitation persists in WS-VAD, as dense frame-level annotations are absent, which often leaves existing methods struggling to learn anomaly semantics effectively. To address this issue, we propose a novel framework named LAS-VAD, short for Learning Anomaly Semantics for WS-VAD, which integrates anomaly-connected component mechanism and intention awareness mechanism. The former is designed to assign video frames into distinct semantic groups within a video, and frame segments within the same group are deemed to share identical semantic information. The latter leverages an intention-aware strategy to distinguish between similar normal and abnormal behaviors (e.g., taking items and stealing). To further model the semantic information of anomalies, as anomaly occurrence is accompanied by distinct characteristic attributes (i.e., explosions are characterized by flames and thick smoke), we additionally incorporate anomaly attribute information to guide accurate detection. Extensive experiments on two benchmark datasets, XD-Violence and UCF-Crime, demonstrate that our LAS-VAD outperforms current state-of-the-art methods with remarkable gains.
Yu Wang, Shengjie Zhao
School of Computer Science and Technology, Tongji University, Shanghai, China