Overview

Multimodal robustness asks whether systems that combine images, text, audio, medical data, or sensors can still make reliable predictions when some inputs are missing, corrupted, or in conflict. Common approaches include modality dropout, reliability-aware gating and expert routing, uncertainty estimation, and methods that separate shared information from modality-specific or spurious features. Researchers evaluate these methods on tasks such as medical segmentation, sentiment analysis, autonomous driving, and multimodal language-model reasoning, using corruption, missing-input, domain-shift, and adversarial benchmarks. A central tension is that adding modalities can improve performance when evidence is complementary but can also introduce interference or overreliance, and gains on controlled benchmarks do not always carry over to real deployment conditions.

Latest papers

CardsList

279 papers26 papers in the last four weeks, down 10% on the four weeks before. 0.2% of all new papers.

  1. URMF: Uncertainty-aware Robust Multimodal Fusion for Multimodal Sarcasm Detection

    Apr 8, 2026Zhenyu Wang, Weichen Cheng, Weijia Li +3Uncertainty-Aware Multimodal FusionMultimodal Robustness

  2. Decoupling and Regulating Modality Heads for Fake News Detection under Missing Modality

    Apr 8, 2026Kai Qian, Dongjie Xu, Weijie Shi +7Fake News DetectionMultimodal Robustness

  3. Hidden in the Multiplicative Interaction: Uncovering Fragility in Multimodal Contrastive Learning

    Apr 7, 2026Tillmann Rheude, Stefan Hegselmann, Roland Eils +1Multimodal Contrastive LearningCross-Modal Retrieval

  4. QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis

    Apr 7, 2026Yitong Zhu, Yuxuan Jiang, Guanxuan Jiang +4Multimodal Sentiment AnalysisMultimodal Robustness

  5. Purify-then-Align: Towards Robust Human Sensing under Modality Missing with Knowledge Distillation from Noisy Multimodal Teacher

    Apr 7, 2026Pengcheng Weng, Yanyu Qian, Yangxin Xu +1Missing-Modality LearningMultimodal Robustness

  6. Evaluation Before Generation: A Paradigm for Robust Multimodal Sentiment Analysis with Missing Modalities

    Apr 7, 2026Rongfei Chen, Tingting Zhang, Xiaoyu Shen +1Multimodal Sentiment AnalysisMissing-Modality Learning

  7. Weather-Conditioned Branch Routing for Robust LiDAR-Radar 3D Object Detection

    Apr 7, 2026Hongsheng Li, Lingfeng Zhang, Zexian Yang +4Radar-LiDAR FusionObject Detection

  8. CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models

    Apr 6, 2026Xiangzhao Hao, Zefeng Zhang, Zhenyu Zhang +6Unified Multimodal ModelsMultimodal Robustness

  9. PanLUNA: An Efficient and Robust Query-Unified Multimodal Model for Edge Biosignal Intelligence

    Apr 5, 2026Marija Zelic, Anna Tegon, Yawei Li +2Multimodal Foundation ModelsMultimodal Sensor Fusion

  10. SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations

    Apr 2, 2026Yiqiang Cai, Chengyan Wu, Bolei Ma +4Emotion Recognition in ConversationsMultimodal Emotion Recognition

  11. Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigation

    Apr 2, 2026Teng Liu, Yinfeng YuAudio-Visual NavigationEmbodied Navigation

  12. CASA: Classification Augmented with Safety Attention for Robust Multimodal Alignment

    Mar 31, 2026Anurag Kumar, Raghuveer Peri, Jon Burnsky +4MLLM SafetyLLM Safety Alignment

  13. Unified Restoration-Perception Learning: Maritime Infrared-Visible Image Fusion and Segmentation

    Mar 30, 2026Weichao Cai, Weiliang Huang, Biao Xue +3Infrared-Visible Image FusionSemantic Segmentation

  14. Adversarial Attacks on Multimodal Large Language Models: A Comprehensive Survey

    Mar 30, 2026Bhavuk Jain, Sercan Ö. Arık, Hardeo K. ThakurAdversarial Attacks on Unified Multimodal ModelsLLM Security

  15. Omni-Modal Dissonance Benchmark: Systematically Breaking Modality Consensus to Probe Robustness and Calibrated Abstention

    Mar 28, 2026Zabir Al Nazi, Shubhashis Roy Dipta, Md Rizwan ParvezModality Reliance in Multimodal ModelsMultimodal Model Evaluation

  16. Context-specific Credibility-aware Multimodal Fusion with Conditional Probabilistic Circuits

    Mar 27, 2026Pranuthi Tenali, Sahil Sidheekh, Saurabh Mathur +3Multimodal RobustnessUncertainty-Aware Multimodal Fusion

  17. Hierarchy-Guided Multimodal Representation Learning for Taxonomic Inference

    Mar 26, 2026Sk Miraj Ahmed, Xi Yu, Yunqi Li +2Hierarchical Representation LearningMultimodal Robustness

  18. Probabilistic Concept Graph Reasoning for Multimodal Misinformation Detection

    Mar 26, 2026Ruichao Yang, Wei Gao, Xiaobin Zhu +5Graph ReasoningMultimodal Robustness

  19. DecepGPT: Schema-Driven Deception Detection with Multicultural Datasets and Robust Multimodal Learning

    Mar 25, 2026Jiajian Huang, Dongliang Zhu, Zitong YU +4Multimodal RobustnessCross-Domain Generalization

  20. Multi-Modal Image Fusion via Intervention-Stable Feature Learning

    Mar 24, 2026Xue Wang, Zheng Guan, Wenhua Qian +2Multi-Source Image FusionMultimodal Robustness

  21. Cross-Modal Reinforcement Learning for Navigation with Degraded Depth Measurements

    Mar 23, 2026Omkar Sawant, Luca Zanatta, Grzegorz Malczyk +1Robot NavigationCross-Modal Learning

  22. Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learning

    Mar 23, 2026Xingyu Zhu, Liang Yi, Shuo Wang +4Bayesian Model AveragingTest-Time Adaptation of VLMs

  23. NavTrust: Benchmarking Trustworthiness for Embodied Navigation

    Mar 19, 2026Huaide Jiang, Yash Chaudhary, Yuping Wang +8Embodied NavigationRobot Navigation Benchmarks

  24. Communication-Efficient and Robust Multi-Modal Federated Learning via Latent-Space Consensus

    Mar 19, 2026Mohamed Badi, Chaouki Ben Issaid, Mehdi BennisMultimodal Federated LearningFederated Learning