Multimodal Anomaly Detection

Ask about this topic

Overview

The field studies how to detect and locate events or objects that differ from normal behavior by combining signals that may reveal different aspects of an anomaly. Common approaches model normality through reconstruction or feature distributions, compare modalities for inconsistencies, and fuse image, depth, point-cloud, video, text, or sensor features; newer methods also adapt vision-language models for grounded detection and explanation. Applications range from industrial defect inspection to surveillance, medical imaging, robotics, and monitoring complex systems, with evaluation spanning image- and pixel-level benchmarks as well as time-series and video tasks. A central challenge is making fusion reliable when modalities are noisy, missing, or unevenly informative, while ensuring that language-guided reasoning and benchmark performance reflect genuine visual or sensor evidence and transfer across settings.

Latest papers

CardsList

97 papers14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. Do Words Matter? What Text Contributes to Few and Full-Shot Vision-Language Anomaly Detection

    Oct 25, 2026Arda Baris Basaran, Mesut Ceylan, Elgar Fleisch +1Multimodal Anomaly DetectionRepresentation Geometry in VLMs

    ETH Zurich · University of St. Gallen

  2. Autoregressive Multimodal Anomaly Detection with Large Language Models for Microservice Systems

    Oct 22, 2026Yixiang Tang, Fagui Liu, Guoxiang Zhong +2Multimodal Anomaly DetectionAnomaly Detection

    School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China · Department of New Networks, Peng Cheng Laboratory, Shenzhen 518000, China

  3. AnomalyJev: Towards Evaluating Image Anomaly Explanations via Claim-Level Verification

    Oct 20, 2026Qizhou Wang, Jiawen Zhu, Guansong Pang +1Explainability EvaluationInterpretable Anomaly Detection

    The University of Melbourne · Singapore Management University

  4. BEACON: Bridging Multimodal Semantics and Asynchronous Propagation for Cloud System Anomaly Detection

    Oct 20, 2026Zhe Li, Tengxue Zhang, Yang Shu +4Anomaly DetectionMultimodal Anomaly Detection

    East China Normal University · Alibaba Cloud Computing · Aalborg University

  5. KPI-Aware Multimodal Anomaly Detection for 5G and Open RAN Telemetry

    Oct 18, 2026Chiman Salavati, Liang Wu, Kelly Wan +2Multimodal Anomaly DetectionTime-Series Anomaly Detection

    University of Connecticut, Storrs, Connecticut, USA · Nokia, Sunnyvale, California, USA

  6. MAIA: Anticipating Interaction Anomalies in Contact-Rich Manipulation via Multimodal World Models

    Oct 15, 2026Yi Qiao, Maolin Zheng, Haoran Sun +2Anomaly DetectionContact-Rich Robotic Manipulation

    School of Artificial Intelligence, Shanghai Jiao Tong University

  7. Text-Informed Training Data Filtering for Enhanced Virtual Flow Meter Performance

    Oct 14, 2026Kristoffer Hjelmen Nesland, Bjarne Grimstad, Antorweep Chakravorty +1Training Data CurationIndustrial Anomaly Detection

    University of Stavanger, Stavanger, Norway · Solution Seeker AS, Oslo, Norway

  8. Bidirectional Adaptive Transformers for Multimodal Anomaly Detection

    Oct 10, 2026Yuxin Jiang, Yunkang Cao, Weiming ShenMultimodal Anomaly DetectionMultimodal Fusion

    School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, 430000, Hubei, China

  9. Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?

    Oct 8, 2026Xingwu Zhang, Duanyang Du, Huiling Zhu +5Industrial Anomaly DetectionMultimodal Anomaly Detection

    Hunan University · University of Aberdeen · South China Normal University +1

  10. GRC-Net: Global Representation Consistency Network for Unsupervised Multimodal Anomaly Detection

    Oct 7, 2026Seyoung Jeong, Jong Pil Yun, Sang Jun LeeAnomaly DetectionIndustrial Anomaly Detection

    Jeonbuk National University, Jeonju, Republic of Korea · Korea Institute of Industrial Technology (KITECH), Incheon, Republic of Korea · Chung-Ang University, Seoul, Republic of Korea

  11. WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents

    Sep 30, 2026Ziyan Jiang, Jingbo Yang, Jiabao Ji +5Multimodal Anomaly DetectionMultimodal Agents

    UC Santa Barbara · MIT CSAIL · MIT-IBM Watson AI Lab

  12. TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization

    Sep 30, 2026JinYoung Kim, Geonho Kim, GiJeong Park +2Domain GeneralizationAnomaly Localization

    Department of Artificial Intelligence, Chung-Ang University, Seoul, Korea · SNUAILAB Co., Ltd., Seoul, Korea

  13. LEARN-TS: LLM-Enhanced Alignment and Reconstruction with Normality Guidance for Multivariate Time-Series Anomaly Detection

    Sep 30, 2026Jahyeob Koo, Kio Yun, Byoungmo Koo +1LLM-Based Time Series Anomaly DetectionAnomaly Localization

    Department of Industrial and Management Engineering, Korea University Seoul, Republic of Korea

  14. VD-DeepStack: Bridging Visual Comparison and Language Reasoning for Few-Shot Anomaly Detection

    Sep 28, 2026Mengyang Zhao, Zhuolin He, Haiyang Yu +9Few-Shot Anomaly DetectionVisual Reasoning

    Fudan University · University of Southern California · Fuzhou University +1

  15. Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space

    Sep 24, 2026Jaron Yeh, Yen-Wei Chang, Jiang Liu +1Industrial Anomaly DetectionAnomaly Localization

    National Taiwan University · AMD GenAI

  16. When Point Clouds Outperform Pixels: Rethinking Zero-Shot Multimodal Anomaly Detection

    Sep 22, 2026Chenglin Ye, Lupeng Liu, Dongbo Yu +2Multimodal Anomaly DetectionPoint Cloud Anomaly Detection

    School of Artificial Intelligence, University of Chinese Academy of Sciences

  17. Robust Fault Detection in Mechanical Multimodal Time Series via Self-Supervised Cross-Modal Reconstruction

    Sep 14, 2026Magnus Munk Jensen, Dorte Hammershøi, Rafał Wiśniewski +1Multimodal RobustnessIndustrial Anomaly Detection

    Automation and Control, Aalborg University, Aalborg, Denmark · Intelligent Maintenance and Operations Systems, EPFL, Lausanne, Switzerland

  18. STAR: Adaptive Spatial-Temporal Normalization for Unified Microservice Incident Management

    Sep 12, 2026Xinhua Miao, Linyu Zhu, Bowei Yang +1Self-Supervised Time Series Representation LearningMultimodal Anomaly Detection

    School of Software Technology, Zhejiang University, Ningbo, China · School of Aeronautics and Astronautics, Zhejiang University, Hangzhou, China

  19. SHIFT-M3: Pre-fusion Alignment-based Consistency Screening for Multimodal ECG Record Integrity

    Sep 12, 2026Md Ashik Khan, Md Nahid SiddiqueMultimodal Anomaly DetectionCross-Modal Alignment

    Department of Computer Science and Engineering Indian Institute of Technology Kharagpur Kharagpur, India · Knight Foundation School of Computing and Information Sciences Florida International University Miami, FL, USA

  20. Parser-Free VLM Verification for Federated Weakly Supervised Video Anomaly Detection

    Sep 7, 2026Sébastien Thuau, Amira Gran, Siba Haidar +1Multimodal Anomaly DetectionWeakly Supervised Video Anomaly Detection

    esieaLab, ESIEA, Paris, France · ETIS Laboratory, CNRS, UMR8051, CY Cergy Paris University, Paris, France

  21. GLASS: Graph-Language Alignment with Spherical Scoring for Transferable Graph-Level Anomaly Detection

    Sep 4, 2026Xudong Wang, Chris Ding, Tongxin Li +1Few-Shot Anomaly DetectionGraph-Based Anomaly Detection

    School of Data Science, The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen), China

  22. Real-Time Video Anomaly Detection Using YOLO Pose Estimation and CLIP-Based Semantic Scoring

    Aug 31, 2026Vanodhya G. Warnasooriya, Amir Hajian, Watchara Ruangsang +1Multimodal Anomaly DetectionVideo Anomaly Detection

    Dept. of Electrical Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok 10330, Thailand · Media Technology Program, King Mongkut’s Univ. of Technology Thonburi, Bangkok 10150, Thailand

  23. A Data-Driven Multimodal Method for Early Detection of Coordinated Abnormal Behaviors in Live-Streaming Platforms

    Aug 30, 2026Jingwen Luo, Pinrui Zhu, Yiyan Wang +4Anomaly DetectionMultimodal Anomaly Detection

    National School of Development, Peking University, Beijing 100871, China · College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China · School of Foreign Studies, Beijing Language and Culture University, Beijing 100083, China +1

  24. Multi-Modal Anomaly Detection: A Survey

    Aug 24, 2026Xudong Mou, Zexin Wu, Chuan Luo +4Multimodal Anomaly DetectionIndustrial Anomaly Detection

    School of Computer Science and Engineering, Beihang University, Beijing 100191, China · School of Software, Beihang University, Beijing 100191, China · Shandong Inspur Intelligent Production Technology Co., Ltd, Jinan, 250101, China

  25. Rethinking Auxiliary Modalities in Multimodal Zero-shot Anomaly Detection: From Semantic Fusion to Conditional Modulation

    Aug 14, 2026Peng Wu, Xin Ge, Yujia Sun +1Zero-Shot Anomaly DetectionMultimodal Anomaly Detection

    School of Computer Science, Northwestern Polytechnical University, China · School of Artificial Intelligence, Xidian University, China · School of Computing and Information Systems, Singapore Management University, Singapore

  26. Dual Anchors, Do It Better: Hierarchical Group Merging for Zero-Shot Anomaly Detection

    Aug 12, 2026Jimin Roh, DongKyu Kim, Suk-Ju KangVLM AdaptationMultimodal Anomaly Detection

    Sogang University · LG Electronics · NAVER Cloud

  27. Label-Free Parkinson's Disease Screening from Face and Voice through Mechanistic Interpretability

    Aug 10, 2026Jiaheng Su, Yu SunMechanistic InterpretabilityMultimodal Anomaly Detection

    Independent Researcher, Los Angeles, CA, USA · California State Polytechnic University, Pomona, CA, USA

  28. Agentic Anomaly Detection with ORCA-Style Dynamic Inductive Bias Adaptation in Multimodal Wearable Time Series Data

    Aug 9, 2026Anushka Roy, Jyotirmoy Singh, Shreea Bose +1Multimodal Anomaly DetectionTime-Series Anomaly Detection

    Department of Electrical and Electronics Engineering BITS Pilani, Hyderabad Campus · Department of Computer Science & Information Systems BITS Pilani, Hyderabad Campus · Department of Computer Science & Information Systems2026 BITS Pilani, Hyderabad Campus

  29. LIBAD: A Multimodal Anomaly Detection Benchmark for Li-Ion Battery Electrode Manufacturing

    Aug 8, 2026Wenbo Sui, Daniel Lichau, Harold Phelippeau +1Industrial Anomaly DetectionMultimodal Anomaly Detection

    Thermo Fisher Scientific, 39 Rue d’Armagnac, Bordeaux, 33800, France · DTU Energy, Technical University of Denmark, Fysikvej 310, Kgs. Lyngby, 2800, Denmark · Thermo Fisher Scientific, 5350 NE Dawson Creek Dr, Hillsboro, OR 97124, USA

  30. LDU-Bench: Multimodal LLM Evaluation for Lithography Defect Understanding under Layout-Varying Circuit Backgrounds

    Aug 4, 2026Huanglong Ji, Botong Zhao, Shujing Lv +1Semiconductor ManufacturingMultimodal Large Language Models