Multimodal Anomaly Detection

Ask about this topic

Overview

The field studies how to detect and locate events or objects that differ from normal behavior by combining signals that may reveal different aspects of an anomaly. Common approaches model normality through reconstruction or feature distributions, compare modalities for inconsistencies, and fuse image, depth, point-cloud, video, text, or sensor features; newer methods also adapt vision-language models for grounded detection and explanation. Applications range from industrial defect inspection to surveillance, medical imaging, robotics, and monitoring complex systems, with evaluation spanning image- and pixel-level benchmarks as well as time-series and video tasks. A central challenge is making fusion reliable when modalities are noisy, missing, or unevenly informative, while ensuring that language-guided reasoning and benchmark performance reflect genuine visual or sensor evidence and transfer across settings.

Latest papers

CardsList

97 papers14 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

  1. Real-IAD MVN: A Multi-View Normal Vector Dataset and Benchmark for High-Fidelity Industrial Anomaly Detection

    May 8, 2026Wenbing Zhu, Jianing Liang, Linjie Cheng +7Industrial Anomaly DetectionMultimodal Anomaly Detection

    1Fudan University · 4Rongcheer Co., Ltd. · 3Donghua University +1

  2. Align3D-AD: Cross-Modal Feature Alignment and Dual-Prompt Learning for Zero-shot 3D Anomaly Detection

    May 7, 2026Letian Bai, Xuanming Cao, Juan Du +1Prompt LearningCross-Modal Alignment

    Smart Manufacturing Thrust, The Hong Kong University of Science and Technology (Guangzhou) · The Hong Kong University of Science and Technology · College of Mechanical and Vehicle Engineering, Hunan University

  3. Text-Guided Multimodal Unified Industrial Anomaly Detection

    Apr 24, 2026Zewen Li, Shuo Ye, Zitong Yu +2Unified Multimodal ModelsIndustrial Anomaly Detection

    School of Computer Science & Software Engineering, Shenzhen University, China, 518060 · School of Computing and Information Technology, Great Bay University, Dongguan, 523000,China

  4. ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection

    Apr 20, 2026Qiuhui Chen, Jiaxiang Song, Shuai Tan +1Multimodal GroundingInterpretable Anomaly Detection

    School of Information Science and Engineering, East China University of Science and Technology, Shanghai, China

  5. Out of Context: Reliability in Multimodal Anomaly Detection Requires Contextual Inference

    Apr 14, 2026Kevin Wilkinghoff, Neelu Madan, Juan Miguel Valverde +6Anomaly DetectionMultimodal Anomaly Detection

    Aalborg University, Denmark · Pioneer Centre for Artificial Intelligence, Denmark · Technical University of Denmark, Denmark +3

  6. IAD-Unify: Task-Specific Interfaces for Industrial Anomaly Understanding, Segmentation, and Generation

    Apr 14, 2026Haoyu Zheng, Jiang Liu, Jiaqi Zhu +3Industrial Anomaly DetectionMultimodal Anomaly Detection

    Zhejiang University, China · National University of Singapore, Singapore · Cornell University, USA

  7. MMR-AD: A Large-Scale Multimodal Dataset for Benchmarking General Anomaly Detection with Multimodal Large Language Models

    Apr 13, 2026Xincheng Yao, Zefeng Qian, Chao Shi +2Anomaly DetectionIndustrial Anomaly Detection

    School of Information Science and Electronic Engineering, Shanghai Jiao Tong University · MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University

  8. Multimodal Anomaly Detection for Human-Robot Interaction

    Apr 10, 2026Guilherme Ribeiro, Iordanis Antypas, Leonardo Bizzaro +2Multimodal Anomaly DetectionReconstruction-Based Anomaly Detection

    LASIGE, Faculty of Sciences, U. Lisboa, Portugal · Dep. of Information Engineering, University of Padova, Padova, Italy

  9. Latent Anomaly Knowledge Excavation: Unveiling Sparse Sensitive Neurons in Vision-Language Models

    Apr 9, 2026Shaotian Li, Shangze Li, Chuancheng Shi +5Multimodal Anomaly DetectionZero-Shot Anomaly Detection

    Macquarie University · Nanjing University of Science and Technology · The University of Sydney +1

  10. SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detection

    Apr 7, 2026Letian Bai, Chengyu Tao, Juan DuAnomaly DetectionMultimodal Anomaly Detection

    Smart Manufacturing Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, 511453, China · College of Mechanical and Vehicle Engineering, Hunan University, Changsha, 410082, China · The Hong Kong University of Science and Technology, Hong Kong SAR, 999077, China

  11. ATSS: Detecting AI-Generated Videos via Anomalous Temporal Self-Similarity

    Apr 5, 2026Hang Wang, Chao Shen, Lei Zhang +1Deepfake DetectionMultimodal Anomaly Detection

    Xi’an Jiaotong University, Xi’an, China · The Hong Kong Polytechnic University, Hong Kong, China · School of Engineering and Technology, University of Washington, Tacoma, WA 98402, USA

  12. Modulate-and-Map: Crossmodal Feature Mapping with Cross-View Modulation for 3D Anomaly Detection

    Apr 2, 2026Alex Costanzino, Pierluigi Zama Ramirez, Giuseppe Lisanti +1Multimodal Anomaly DetectionMulti-View Learning

    CVLab, University of Bologna · Ca’ Foscari University of Venice

  13. mmAnomaly: Leveraging Visual Context for Robust Anomaly Detection in the Non-Visual World with mmWave Radar

    Apr 1, 2026Tarik Reza Toha, Shao-Jung, Lu +2Anomaly DetectionAnomaly Localization

    Louie · University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA

  14. Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervision

    Mar 28, 2026Yizhou Jin, Yuezhu Feng, Jinjin Zhang +3Anomaly LocalizationMultimodal Anomaly Detection

    State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China · Hangzhou Innovation Institute, Beihang University, Hangzhou, China

  15. Collision-Aware Vision-Language Learning for End-to-End Driving with Multimodal Infraction Datasets

    Mar 26, 2026Alex Koran, Dimitrios Sinodinos, Hadi Hojjati +3End-to-End Autonomous DrivingTraffic Accident Anticipation

    McGill University, Montréal, Canada · Mila - Québec AI Institute, Montréal, Canada · Nissan Motor Corporation, Yokohama, Japan

  16. ARMOR: A Robust Self-Supervised Framework for Root Cause Analysis in Microservices under Missing Modality

    Mar 26, 2026Wenzhuo Qian, Hailiang Zhao, Ziqi Wang +4Root Cause AnalysisMultimodal Anomaly Detection

    Zhejiang University, Hangzhou, China

  17. Layer-Specific Lipschitz Modulation for Fault-Tolerant Multimodal Representation Learning

    Mar 26, 2026Diyar Altinses, Andreas SchwungMultimodal LearningMultimodal Anomaly Detection

    Department of Automation Technology and Learning Systems, South Westphalia University of Applied Sciences, Soest, Germany

  18. Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interaction

    Mar 23, 2026Shiyan Hu, Jianxin Jin, Yang Shu +3Multimodal Anomaly DetectionTime-Series Anomaly Detection

    East China Normal University

  19. Exploring Multimodal Prompts For Unsupervised Continuous Anomaly Detection

    Mar 23, 2026Mingle Zhou, Jiahui Liu, Jin Wan +2Continual Anomaly DetectionUnsupervised Anomaly Detection

    Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences), Jinan, China · Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science, Jinan, China · Faculty of Data Science, City University of Macau, Macau, China

  20. An Edge-Cloud Collaborative Architecture for Proactive Elderly Care: Real-Time Risk Assessment and Three-Level Emergency Response

    Mar 20, 2026Lijie Zhou, Luran WangHealthcareEdge-Cloud Computing

    School of Computer Science, University of Nottingham Ningbo China, Ningbo, China · School of Mathematical Sciences, University of Nottingham Ningbo China, Ningbo, China

  21. BUSSARD: Normalizing Flows for Bijective Universal Scene-Specific Anomalous Relationship Detection

    Mar 17, 2026Melissa Schween, Mathis Kruse, Bodo RosenhahnAnomaly DetectionGraph-Based Anomaly Detection

    Institute for Information Processing, L3S - Leibniz University Hannover

  22. Vision-Language Based Expert Reporting for Painting Authentication and Defect Detection

    Mar 13, 2026Eman Ouda, Mohammed Salah, Arsenii O. Chulkov +4Thermal ImagingAnomaly Detection

    Khalifa University of Science and Technology, Department of Aerospace Engineering, Abu Dhabi, United Arab Emirates · National Research Tomsk Polytechnic University, Russia · Academy of Fine Arts of Naples, Naples, Italy +3

  23. Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection

    Mar 10, 2026Ali Zia, Usman Ali, Muhammad Umer Ramzan +3Training-Free Video Anomaly DetectionVideo Anomaly Detection

    School of Computing, Engineering & Mathematical Sciences, La Trobe University, Melbourne, Australia · School of Engineering and Applied Sciences, GIFT University, Gujranwala 52250, Pakistan

  24. Foundational World Models Accurately Detect Bimanual Manipulator Failures

    Mar 7, 2026Isaac R. Ward, Michelle Ho, Houjun Liu +7Robotic Anomaly DetectionRobotic Manipulation

    Stanford University, Stanford, California, 94305, USA. · Watney Robotics, San Francisco, California, 94110, USA.

  25. Cross-Modal Mapping and Dual-Branch Reconstruction for 2D-3D Multimodal Industrial Anomaly Detection

    Mar 4, 2026Radia Daci, Vito Renò, Cosimo Patruno +4Industrial Anomaly DetectionMultimodal Anomaly Detection

    CNR-ISASI, Institute of Applied Sciences and Intelligent Systems / National Research Council of Italy, via Monteroni snc, Lecce, 73100, Italy · CNR-STIIMA, Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, Via G. Amendola 122 D/O, Bari, 70126, Italy · Institute d’Electronique de Microelectronique et de Nanotechnologie (IEMN) / Universite Polytechnique Hauts de France; Universite de Lille; CNRS, UMR 8520, City, 59313, France

  26. Towards an Incremental Unified Multimodal Anomaly Detection: Augmenting Multimodal Denoising From an Information Bottleneck Perspective

    Mar 3, 2026Kaifang Long, Lianbo Ma, Jiaqi Liu +2Multimodal Anomaly DetectionUnified Multimodal Models

    Software College, Northeastern University, China · Independent Researcher · CATL, China

  27. Adaptive Confidence Regularization for Multimodal Failure Detection

    Mar 2, 2026Moru Liu, Hao Dong, Olga Fink +1Multimodal RobustnessMultimodal Anomaly Detection

    Technical University of Munich · ETH Zürich · EPFL +1

  28. AG-VAS: Anchor-Guided Zero-Shot Visual Anomaly Segmentation with Large Multimodal Models

    Mar 1, 2026Zhen Qu, Xian Tao, Xiaoyi Bao +4Zero-Shot Anomaly DetectionMultimodal Anomaly Detection

    Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Casivision +1

  29. Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection

    Feb 27, 2026Zhaolin Cai, Fan Li, Huiyu Duan +2Video Anomaly DetectionMultimodal Anomaly Detection

    Xinjiang University · Xi’an Jiao Tong University · Shanghai Jiao Tong University +1

  30. GS-CLIP: Zero-shot 3D Anomaly Detection by Geometry-Aware Prompt and Synergistic View Representation Learning

    Feb 22, 2026Zehao Deng, An Liu, Yan WangZero-Shot Anomaly DetectionPoint Cloud Anomaly Detection

    School of Computer Science and Technology, Soochow University · Institute for AI Industry Research (AIR), Tsinghua University