Overview

Multimodal robustness asks whether systems that combine images, text, audio, medical data, or sensors can still make reliable predictions when some inputs are missing, corrupted, or in conflict. Common approaches include modality dropout, reliability-aware gating and expert routing, uncertainty estimation, and methods that separate shared information from modality-specific or spurious features. Researchers evaluate these methods on tasks such as medical segmentation, sentiment analysis, autonomous driving, and multimodal language-model reasoning, using corruption, missing-input, domain-shift, and adversarial benchmarks. A central tension is that adding modalities can improve performance when evidence is complementary but can also introduce interference or overreliance, and gains on controlled benchmarks do not always carry over to real deployment conditions.

Latest papers

CardsList

279 papers26 papers in the last four weeks, down 10% on the four weeks before. 0.2% of all new papers.

  1. EgoAdapt: Enhancing Robustness in Egocentric Interactive Speaker Detection Under Missing Modalities

    Mar 18, 2026Xinyuan Qian, Xinjia Zhu, Alessio Brutti +1Multimodal RobustnessEgocentric Video Understanding

  2. Anchoring Emotions in Text: Robust Multimodal Fusion for Mimicry Intensity Estimation

    Mar 16, 2026Lingsi Zhu, Yuefeng Zou, Yunxiang Zhang +7Multimodal FusionMultimodal Emotion Recognition

  3. AURORA-KITTI: Any-Weather Depth Completion and Denoising

    Mar 16, 2026Yiting Wang, Tim Brödermann, Hamed Haghighi +4Depth CompletionMultimodal Robustness

  4. FBCIR: Balancing Cross-Modal Focuses in Composed Image Retrieval

    Mar 12, 2026Chenchen Zhao, Jianhuan Zhuo, Muxi Chen +6Modality Reliance in Multimodal ModelsComposed Image Retrieval

  5. CLoE: Expert Consistency Learning for Robust Missing Modality Segmentation

    Mar 10, 2026Xinyu Tong, Meihua Zhou, Bowu Fan +1Missing-Modality Medical Image SegmentationMedical Image Segmentation

  6. RTFDNet: Fusion-Decoupling for Robust RGB-T Segmentation

    Mar 10, 2026Kunyu Tan, Mingjian LiangSemantic SegmentationMultimodal Robustness

  7. SiMO: Single-Modality-Operable Multimodal Collaborative Perception

    Mar 9, 2026Jiageng Wen, Shengjie Zhao, Bing Li +3Cooperative PerceptionMultimodal Sensor Fusion

  8. Multi-Modal Decouple and Recouple Network for Robust 3D Object Detection

    Mar 8, 2026Rui Ding, Zhaonian Kuang, Yuzhe Ji +33D Object DetectionMultimodal Object Detection

  9. When One Modality Rules Them All: Backdoor Modality Collapse in Multimodal Diffusion Models

    Mar 6, 2026Qitong Wang, Haoran Dai, Haotian Zhang +2Backdoor AttacksMultimodal Diffusion Models

  10. Post Fusion Bird's Eye View Feature Stabilization for Robust Multimodal 3D Detection

    Mar 5, 2026Trung Tien Dong, Dev Thakkar, Arman Sargolzaei +1Multimodal Robustness3D Object Detection

  11. SarcasmMiner: A Dual-Track Post-Training Framework for Robust Audio-Visual Sarcasm Reasoning

    Mar 5, 2026Zhu Li, Yongjian Chen, Huiyuan Lai +3Sarcasm DetectionMultimodal Reasoning

  12. Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks

    Mar 4, 2026Haoyu Liu, Dingcheng Li, Lukas Rutishauser +1Adversarial TrainingMultimodal Robustness

  13. Towards Generalized Multimodal Homography Estimation

    Mar 4, 2026Jinkun You, Jiaxin Cheng, Jie Zhang +1Multimodal Domain GeneralizationCross-Domain Generalization

  14. CoRe-BT: A Multimodal Radiology-Pathology-Text Benchmark for Robust Brain Tumor Typing

    Mar 4, 2026Juampablo E. Heras Rivera, Daniel K. Low, Xavier Xiong +5Brain Tumor ClassificationMedical Image Benchmarks

  15. Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Data

    Mar 3, 2026Sijie Mai, Shiqin Han, Haifeng HuMultimodal RobustnessMissing-Modality Learning

  16. Adaptive Confidence Regularization for Multimodal Failure Detection

    Mar 2, 2026Moru Liu, Hao Dong, Olga Fink +1Multimodal RobustnessMultimodal Anomaly Detection

  17. Multimodal Adversarial Quality Policy for Safe Grasping

    Mar 2, 2026Kunlin Xie, Chenghao Li, Haolan Zhang +1Safe Robot ManipulationRobotic Grasping

  18. Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model

    Feb 28, 2026Zihang Wang, Xu Li, Benwu Wang +7Autonomous Driving PlanningOff-Road Robot Navigation

  19. Adversarial Patch Generation for Visual-Infrared Dense Prediction Tasks via Joint Position-Color Optimization

    Feb 27, 2026He Li, Wenyue He, Weihang Kong +1Adversarial Patch AttacksAdversarial Examples

  20. Induced Numerical Instability: Hidden Costs in Multimodal Large Language Models

    Feb 27, 2026Wai Tuck Wong, Jun Sun, Arunesh SinhaMultimodal Large Language ModelsMultimodal Robustness

  21. Towards Multimodal Domain Generalization with Few Labels

    Feb 26, 2026Hongzhao Li, Hao Dong, Hualei Wan +3Multimodal Domain GeneralizationMultimodal Learning

  22. Plug, Play, and Fortify: A Low-Cost Module for Robust Multimodal Image Understanding Models

    Feb 26, 2026Siqi Lu, Wanying Xu, Yongbin Zheng +3Missing-Modality LearningMultimodal Learning

  23. BiCLIP: Bidirectional and Consistent Language-Image Processing for Robust Medical Image Segmentation

    Feb 25, 2026Saivan Talaei, Fatemeh Daneshfar, Abdulhady Abas Abdullah +1Multimodal RobustnessMedical VLMs

  24. SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Prediction

    Feb 25, 2026Haoxiang Fu, Lingfeng Zhang, Hao Li +7Camera-LiDAR FusionMultimodal Robustness

  25. BriMA: Bridged Modality Adaptation for Multi-Modal Continual Action Quality Assessment

    Feb 22, 2026Kanglei Zhou, Chang Li, Qingyi Pan +1Action Quality AssessmentMultimodal Robustness

  26. Robust Self-Supervised Cross-Modal Super-Resolution against Real-World Misaligned Observations

    Feb 21, 2026Xiaoyu Dong, Jiahuan Li, Ziteng Cui +1Image Super-ResolutionCross-Modal Alignment

  27. BadCLIP++: Stealthy and Persistent Backdoors in Multimodal Contrastive Learning

    Feb 19, 2026Siyuan Liang, Yongcheng Jing, Yingjie Wang +3Backdoor Attacks on VLMsMultimodal Contrastive Learning

  28. ModalImmune: Immunity Driven Unlearning via Self Destructive Training

    Feb 18, 2026Rong Fu, WeiZhi Tang, Ziming Wang +6Multimodal RobustnessMissing-Modality Learning

  29. Effective and Robust Multimodal Medical Image Analysis

    Feb 17, 2026Joy Dhar, Nayyar Zaidi, Maryam HaghighatMedical Image AnalysisMultimodal Fusion