Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection
Authors: Ali Zia, Usman Ali, Muhammad Umer Ramzan, Hamza Abid, Abdul Rehman, Wei Xiang
Organizations: School of Computing, Engineering & Mathematical Sciences, La Trobe University, Melbourne, Australia · School of Engineering and Applied Sciences, GIFT University, Gujranwala 52250, Pakistan
Training-free video anomaly detection (VAD) has recently emerged as a scalable alternative to supervised approaches, yet existing methods largely rely on static prompting and geometry-agnostic feature fusion. As a result, anomaly inference is often reduced to shallow similarity matching over Euclidean embeddings, leading to unstable predictions and limited interpretability, especially in complex or hierarchically structured scenes. We introduce MM-VAD, a geometry-aware semantic reasoning framework for training free VAD that reframes anomaly detection as adaptive test-time inference rather than fixed feature comparison. Our approach projects caption-derived scene representations into hyperbolic space to better preserve hierarchical structure and performs anomaly assessment through an adaptive question answering process over a frozen large language model. A lightweight, learnable prompt is optimised at test time using an unsupervised confidence-sparsity objective, enabling context-specific calibration without updating any backbone parameters. To further ground semantic predictions in visual evidence, we incorporate a covariance-aware Mahalanobis refinement that stabilises cross-modal alignment. Across four benchmarks, MM-VAD consistently improves over prior training-free methods, achieving 90.03% AUC on XD-Violence and 83.24%, 96.95%, and 98.81% on UCF-Crime, ShanghaiTech, and UCSD Ped2, respectively. Our results demonstrate that geometry-aware representation and adaptive semantic calibration provide a principled and effective alternative to static Euclidean matching in training-free VAD.
Figures & tables
Figure 1: Comparison of prior VAD architectures and our modality-agnostic MM-VAD, which introduces adaptive query optimisation and hyperbolic fusion for zero-shot, explainable anomaly detection.
Figure 2: An overview of our MM-VAD framework. Visual captions Cvis and audio captions Caud are fused in hyperbolic space, and the fused features drive unsupervised refinement of the anomaly query from Qt to Qt+1 . A LLaMA-based scorer then evaluates textual video summaries against Qt+1 , and a cross-modal refinement step produces the final anomaly scores.
Dataset
LAVAD [ 48 ]
MM-VAD
ShanghaiTech [ 26 ]
94.55
96.95
UCSD Ped2 [ 24 ]
96.11
98.81
Table 2: Comparison of frame-level AUC (%) for training-free methods on ShanghaiTech and UCSD Ped2.
Figure 3: Overview of MM-VAD on XD-Violence. (a) MM-VAD outperforms LAVAD with sharper anomaly localisation and richer action-aware descriptions. (b) Adaptive prompts ( t0 – t4 ) for frozen-LLM querying. (c) Euclidean embeddings. (d) Hyperbolic embeddings with clearer structure and better separation.
Cvis
Caud
C′vis
zt(F)
DM
Qt+1
XD-Violence
UCF-Crime
AUC (%)
AUC (%)
✓
✓
✗
✗
✓
✗
74.56
70.10
✓
✓
✓
✗
✓
✗
80.05
77.80
✓
✓
✗
✓
✓
✗
81.97
78.87
✓
✗
✗
✓
✓
✓
83.24
79.75
✓
✗
✓
✓
✓
✗
85.53
80.41
Table 3: Ablation study of MM-VAD’s components
Table 4: Controlled component and model ablations. (a) Cross-combination study between LAVAD and MM-VAD under different captioning and LLM backbones. (b) LLM ablation with VLRM fixed to isolate the effect of the language model.
Method
Frame
Audio
A-Cap
I-Cap
Idx 1
Clean
Summ
Sco
Idx 2
Refine
Batch
Sec/Frame
LAVAD [ 48 ]
0.2
0.0
0.0
1.3
1.0
4.0
13.0
7.0
1.0
5.0
32.5
2.03
MM-VAD
0.2
0.3
1.0
1.0
1.0
4.0
9.0
4.0
1.0
5.5
27.0
1.69
Table 5: Per-step runtime comparison between MM-VAD and LAVAD . Lower values indicate faster processing and are preferred. The best runtime for each step is highlighted in bold . Shortened headers: A-Cap = Audio-caption, I-Cap = Image caption, Clean = Image caption clean, Summ = LLM-based summary generation, Sco = anomaly score, Refine = Score Refinement, and Batch = Time/Batch (16 frames).
Video anomaly detection (VAD) aims to automatically identify events that deviate from normal patterns in untrimmed surveillance videos. Existing methods universally depend on large-scale annotations or task-specific training procedures, severely limiting their rapid deployment to novel scenes. We observe that intermediate-layer features of pre-trained multimodal large language models (MLLMs) already encode rich anomaly semantics, yet existing approaches rely on the language output pathway and fail to exploit the geometric discriminability latent in these representations. Based on this finding, we propose SphereVAD, a fully training-free, zero-shot VAD framework that recasts anomaly discrimination as von Mises-Fisher (vMF) likelihood-ratio geodesic inference on the unit hypersphere, unleashing latent discriminability through principled geometric reasoning rather than learning new representations. Specifically, SphereVAD first applies Frechet mean centering to unfold feature distributions and eliminate domain biases, then employs Holistic Scene Attention (HSA) to reinforce feature consistency using cross-video priors, and finally performs vMF-guided Spherical Geodesic Pulling (SGP) to align ambiguous segments with directional prototypes on the spherical manifold. This training-free pipeline requires only minimal synthetic images for calibration. SphereVAD establishes new state-of-the-art results among training-free approaches on three major benchmarks and remains competitive with fully supervised baselines. Code will be available upon acceptance.
Chao Huang, Pengfei Wei, Wei Wang +5
Shenzhen Campus of Sun Yat-sen University · Harbin Institute of Technology, Shenzhen
Training-free language-based video anomaly detection (VAD) uses frozen vision--language models (VLMs) and large language models (LLMs) to localize abnormal events without task-specific model-weight optimization. Existing approaches increasingly exploit broader temporal and semantic context, yet generic context does not necessarily foreground abnormal events or specify how video-level semantics should modify local anomaly scores. We introduce a training-free semantic feedback framework that uses VAD-guided active observation for video anomaly understanding (VAU) and returns the resulting anomaly-focused description to refine temporal detection. Starting from an upstream anomaly-score curve, we adapt reasoning-based iterative frame selection: high-score regions seed the observations, and anomaly scores together with VLM relevance assessments guide subsequent temporal exploration. A frozen video-language model generates a single open-ended anomaly description from the selected frames. The description is returned through two complementary feedback levels: video-level feedback determines whether the score distribution should be suppressed, preserved, or sharpened, with selective visual rechecking, while local feedback retrieves event-related windows and promotes scores only after target-local visual verification. All model weights remain frozen, and feedback is applied once without regenerating the description. On the HIVAU video-summary evaluations of UCF-Crime and XD-Violence, VAD-guided observation improves GPT-rated reasonability, detail, and consistency over the matched CLIP-guided variant. For VAD, semantic feedback improves the re-evaluated upstream detector from 84.36% to 86.25% AUC on UCF-Crime and from 68.07% to 72.58% AP on XD-Violence, where the final AUC is 91.74%.
Hangil Park, Seungheon Kim, Tae-Kyun Kim
Korea Advanced Institute of Science and Technology (KAIST)
Video anomaly detection (VAD) aims to identify and temporally localize abnormal events in videos. Supervised methods learn anomaly decision boundaries from target-domain annotations but require substantial in-domain data. Existing training-free methods leverage the rich semantic knowledge and reasoning capabilities of pretrained models to interpret visual content, yet these capabilities do not directly define an anomaly decision criterion: richer anomaly descriptions better capture hazard resemblance without resolving abnormality. To this end, we propose Contrastive Event Adjudication for training-free Video Anomaly Detection (CEAVAD), which shifts the unit of inference from isolated anomaly concepts to falsifiable event hypotheses and establishes an inference-time explanatory boundary through the interaction between competing explanations and video evidence. Specifically, CEAVAD first uses public-safety knowledge to construct hazard-benign event contrasts, pairing each hazard mechanism with a generic normal account and a mechanism-specific benign counterpart. It then determines whether the target interval better supports a hazard explanation or its benign competitor, yielding a revisable contrastive boundary proposal for the target. Finally, CEAVAD adjudicates between the competing explanations to determine whether the hazard hypothesis survives the video evidence, supporting both temporally localized anomaly detection and evidence-grounded explanations. Experiments on three widely used VAD benchmarks demonstrate that CEAVAD achieves state-of-the-art performance under the training-free paradigm.
Wenti Yin, Xiang Wang, Huaxin Zhang +4
Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology · Alibaba Group · The Hong Kong University of Science and Technology (Guangzhou)