Multimodal Robustness

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 120% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 183

All topics

Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment
May 22, 2026Haoyuan Wang, Xiaohao Liu, Jiajie Su +2Multimodal Robustness Adversarial Robustness
Zhejiang University · National University of Singapore · Jiangxi Normal University
Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization
May 22, 2026Jiayu Xiong, Jing Wang, Qi Zhang +2Cross-Modal Learning Multimodal Robustness
Department of Computer Science and Techonology, Huaqiao University · Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University · Tongji University +1
MetaRA: Metamorphic Robustness Assessment for Multimodal Large Language Model-based Visual Question Answering Systems
May 19, 2026Quanxing Xu, Yuhao Tian, Ling Zhou +4Visual Question Answering Automated Software Testing
School of Computer Science and Engineering, Macau University of Science and Technology, Macao SAR 999078, China · Hubei Key Laboratory of Transportation Internet of Things, School of Computer Science and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, China · State Key Laboratory of Maritime Technology and Safety, Wuhan University of Technology, Wuhan 430063, China +3
MedFM-Robust: Benchmarking Robustness of Medical Foundation Models
May 18, 2026Xiangxiang Cui, Tianjin Huang, Yifang Wang +2Multimodal Robustness Neural Network Robustness
Beijing Normal University, China · University of Exeter, United Kingdom · University College London, United Kingdom +2
Surviving the Unseen: Predictive Defense for Novel Multi-Turn Multimodal Attacks
May 18, 2026Doohee YouAdversarial Attacks on VLMs Multimodal Robustness
Trust and Safety, Google
CAM-VFD: Cross-Attention Multimodal Video Forgery Detection
May 16, 2026Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy +1Multimodal Robustness Deepfake Detection
Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria, Egypt
Ranking-Aware Calibration for Reliable Multimodal Reinforcement Learning
May 16, 2026Peng Cui, Boyao Yang, Jun ZhuMultimodal Robustness VLM Reasoning
Dept. of Comp. Sci. & Tech., Institute for AI, BNRist Center, Tsinghua-Bosch Joint ML Center, THBI Lab, Tsinghua University, Beijing 100084, China · Dept. of Automation, Tsinghua University, Beijing 100084, China
Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Missing-Modality Learning Multimodal Robustness
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China) · Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software · The Hong Kong University of Science and Technology (Guangzhou)
Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learning
May 16, 2026Wen-Hsin Tsai, Chia-Ming Lee, Yuk-Ying TungCross-Modal Learning Multimodal Robustness
Institute of Education, National Cheng Kung University · Institute of Intelligent System, National Yang Ming Chiao Tung University · Department of Computer Science, University at Albany, State University of New York
MedMIX: Modality-Internal Expert Fusion for Multimodal Medical Diagnosis
May 15, 2026Seungik Cho, Anqi Li, Wei QiuMissing-Modality Learning Multimodal Robustness
Department of Electrical and Computer Engineering Rice University Houston, TX 77005
WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction
May 15, 2026A. Enes Doruk, Abdelaziz Hussein, Hasan F. AtesMultimodal Robustness Camera-LiDAR Fusion
Department of Artificial Intelligence and Data Engineering Ozyegin University Istanbul, Türkiye
Decision-Level Fusion for Robust Wearable Affect Recognition
May 14, 2026Lokesh Singh, Athina Georgara, Jayati Deshmukh +2Multimodal Robustness Frequency-Domain Feature Learning
University of Southampton · Southampton, United Kingdom
Beyond Instance-Level Self-Supervision in 3D Multi-Modal Medical Imaging
May 14, 2026Tan Pan, Shuhao Mei, Yixuan Sun +8Representation Learning Multimodal Robustness
Fudan University, China · Shanghai Academy of AI for Science, China · Bioinformatics Institute (BII), Agency for Science, Technology and Research (A*STAR), Singapore +2
To See is Not to Learn: Protecting Multimodal Data from Unauthorized Fine-Tuning of Large Vision-Language Model
May 14, 2026Chengshuai Zhao, Zhen Tan, Dawei Li +2VLM Robustness Multimodal Robustness
School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA · Department of Computer Science and Engineering, Texas A&M University, College Station, TX, USA.
MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusion
May 13, 2026Wugeng Zheng, Ziwen Kan, Tianlong Chen +2Missing-Modality Learning Multimodal Robustness
University of Central Florida · University of North Carolina at Chapel Hill
Hierarchical Attacks for Multi-Modal Multi-Agent Reasoning
May 13, 2026Hao Zhou, Tiru Wu, Yan Jiang +3Multimodal Robustness Adversarial Attacks
PRA-PoE: Robust Multimodal Alzheimer's Diagnosis with Arbitrary Missing Modalities
May 13, 2026Guangqian Yang, Ye Du, Wenlong Hou +2Missing-Modality Learning Alzheimer's Disease
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China · Department of Technology Management for Innovation, The University of Tokyo,2026 Japan · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China
VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
May 13, 2026Yuxuan Weng, Wenhan Luo, Qijia ShaoMissing-Modality Learning Disentangled Representation Learning
The Hong Kong University of Science and Technology (HKUST)
WinDeskGround: A Benchmark for Robust GUI Grounding in Complex Multi-Window Desktop Environments
May 13, 2026Haoren Zhao, Tianyi Chen, Zhen WangMultimodal Robustness GUI Agents
School of Cyberspace, Hangzhou Dianzi University, Hangzhou, China · 2Microsoft
Certified Robustness under Heterogeneous Perturbations via Hybrid Randomized Smoothing
May 13, 2026Blaise Delattre, Hengyu Wu, Paul Caillon +2Multimodal Robustness Randomized Smoothing
Department of Computer Science, School of Computing, Institute of Science Tokyo, Tokyo, Japan · PSL University, Paris, France · College of Computing and Data Science, Nanyang Technological University, Singapore
Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity
May 12, 2026Sirui Zhang, Haonan Wang, Xunkai Li +5Multimodal Federated Learning Missing-Modality Learning
Beijing Institute of Technology
Resilient Vision-Tabular Multimodal Learning under Modality Missingness
May 12, 2026Camillo Maria Caruso, Valerio Guarrasi, Paolo SodaMissing-Modality Learning Multimodal Robustness
Research Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Roma, Italy, Europe · Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Umeå, Sweden, Europe
SB-BEVFusion: Enhancing the Robustness against Sensor Malfunction and Corruptions
May 12, 2026Markus Essl, Marta Moscati, Mubashir Noman +4Multimodal Robustness Camera-LiDAR Fusion
Johannes Kepler University Linz, Austria · MBZUAI, UAE · Macquarie University, Sydney, Australia +1
SafeSteer: A Decoding-level Defense Mechanism for Multimodal Large Language Models
May 12, 2026Xinyi Zeng, Xue Yang, Jingyuan Zhang +5Adversarial Attacks on VLMs Multimodal Robustness
Tsinghua University, Beijing, China · Shanghai Jiao Tong University · Kuaishou Technology, Beijing, China +4
UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition
May 8, 2026Shuai Zhang, Zhecheng Shi, Zhuxiao Li +4Disentangled Representation Learning Multimodal Robustness
1HKUST(GZ) · 2HKUST
Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study
May 7, 2026Hao Dong, Hongzhao Li, Shupan Li +3Multimodal Robustness Domain Generalization
ETH Zürich · Zhengzhou University · MBZUAI +1
Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attacks
May 7, 2026Guanmeng Xian, Ning Yang, Philip S. YuAdversarial Training Multimodal Robustness
Sichuan University, Chengdu, China · University of Illinois at Chicago, USA
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity
May 7, 2026Zheyuan Yang, Liqiang Shang, Junjie Chen +6Multimodal Robustness Multimodal Reasoning
Tongji University · University of Bristol · Tianjin University +1
The Cost of Context: Mitigating Textual Bias in Multimodal Retrieval-Augmented Generation
May 7, 2026Hoin Jung, Xiaoqian WangMultimodal RAG Multimodal Grounding
Elmore Family School of Electrical and Computer Engineering Purdue University West Lafayette, IN 47907
To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognition
May 6, 2026Yangchen Yu, Qian Chen, Jia Li +5Cross-Modal Learning Multimodal Robustness
School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China · School of Computing and Information Systems, Singapore Management University, Singapore · College of Computing and Data Science, Nanyang Technological University, Singapore +1

May 22, 2026, cs.AIJ/K move · Enter open · S save

Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment

Haoyuan Wang, Xiaohao Liu, Jiajie Su, Jianmao Xiao+1

Zhejiang University · National University of Singapore · Jiangxi Normal University

Multimodal Robustness Adversarial Robustness Multimodal Large Language Models Model Editing

Open paper AskPDF arXiv

Multimodal large language models (MLLMs) need efficient mechanisms to update knowledge without degrading existing capabilities. While intrinsic multimodal knowledge editing achieves strong reliability and locality, it often exhibits limited generality, failing to propagate edits across semantically equivalent visual and linguistic variations. This issue arises from the lack of explicit semantic supervision, rigid editing scopes, and biased anchoring to individual samples in high-dimensional multimodal spaces. We address robust intrinsic multimodal knowledge editing by explicitly targeting generalization. We formalize robustness through knowledge units that group semantically equivalent multimodal inputs and define generality as consistent predictions within each unit. To expose fragile semantic regions, we introduce Latent Adversarial Robustification (LAR), which generates adversarial yet semantically coherent variants in the joint latent space. We further propose Rank-Constrained Subspace Learning (RCSL), enforcing low-rank alignment of adversarial representations at the edit layer via a singular value-based objective. Extensive analysis demonstrates the effectiveness of ASAM empirically.

Momentum

Related topics

Latest papers 183