Overview

Multimodal robustness asks whether systems that combine images, text, audio, medical data, or sensors can still make reliable predictions when some inputs are missing, corrupted, or in conflict. Common approaches include modality dropout, reliability-aware gating and expert routing, uncertainty estimation, and methods that separate shared information from modality-specific or spurious features. Researchers evaluate these methods on tasks such as medical segmentation, sentiment analysis, autonomous driving, and multimodal language-model reasoning, using corruption, missing-input, domain-shift, and adversarial benchmarks. A central tension is that adding modalities can improve performance when evidence is complementary but can also introduce interference or overreliance, and gains on controlled benchmarks do not always carry over to real deployment conditions.

Latest papers

CardsList

291 papers12 papers in the last four weeks, down 62% on the four weeks before. 0.1% of all new papers.

  1. MM-SystemOneBias: Evaluating Bias in Multimodal Jev-Style System One Decision Models

    Nov 19, 2026Jinzhe Li, Qi Wang, Dandan Guo +3Multimodal Model EvaluationSystem One Decision Models

  2. STA: A Split Temporal Adversary Method for Evaluating Robustness of Multimodal RL-based Driving Policies

    Nov 16, 2026Shenghao Xiong, Xiaolin ChangMultimodal RobustnessAdversarial Attacks

  3. Beyond Paired Inputs: Learning to Leverage RGB-T Cross-Modal Relations in Multimodal Large Language Models

    Nov 14, 2026Tianyi Zhao, Qihao Xu, Jiawen Xi +5Multimodal Large Language ModelsCross-Modal Learning

  4. Multimodal Person Concept Model for Person Identification under Varying Observation Conditions

    Nov 13, 2026Mizuho Okitani, Yoshinobu HagiwaraMultimodal RobustnessPerson Re-Identification

  5. ReSMap: Recasting Satellite Priors for Robust and Accurate Online HD Map Construction

    Nov 3, 2026Kyungmin Kim, Sumin Lee, Sungoh Jeong +3HD Map ConstructionReliability-Aware Multimodal Fusion

  6. DiMuRe: Diagnosis-Guided Multilevel Recovery for Robotic Task Execution

    Nov 3, 2026Renkai Yi, Yuwei Wu, Haoyu Zhang +4Robot Failure RecoveryMultimodal Robustness

  7. Calibrating Multimodal Test-Time Adaptation under Reliability and Availability Modality Shifts

    Nov 2, 2026Jiangmeng Li, Jinglin Xu, Yi Li +5Test-Time AdaptationMultimodal Robustness

  8. MIRA: Reinforcing Multimodal Reasoning via Deceptive Contextual Augmentation

    Nov 2, 2026Zhihan Yin, Jianxin Liang, Yifeng Yao +5Reasoning for VLMsVLM Robustness

  9. ConsMSA: Semantic Distribution Consistency Learning for Multimodal Sentiment Analysis

    Oct 22, 2026Pan Wang, Lipeng Ke, Huajun Ying +5Multimodal Sentiment AnalysisMultimodal Learning

  10. Reliability-Aware Probabilistic Fusion for Multimodal Learning with Incomplete Evidence

    Oct 21, 2026Patitapaban Palo, Abhisek Tiwari, Mattia Carletti +3Reliability-Aware Multimodal FusionUncertainty-Aware Multimodal Fusion

  11. MERP: A Latent-Bottleneck Framework for Robust Multi-Modal Multi-Label Emotion Recognition

    Oct 21, 2026Chuangxin Zhao, Meimei Zhang, Canran Xiao +6Multimodal Emotion RecognitionMultimodal Robustness

  12. CheXFuse: Guided Differential Joint Attention Fusion for Robust Multimodal Chest X-Ray Classification in Data-Scarce Medical Settings

    Oct 19, 2026Muntaqim Ahmed Raju, Priyanka Siddappa, Md Shifat Haider Al Amin +2Multimodal FusionChest X-Ray Classification

  13. Beyond Invariance: Factor-wise Selective Treatment of Shifts for Multimodal Learning

    Oct 15, 2026Guimin Hu, Qiwei Peng, Boyan Xu +1Distribution Shift RobustnessMultimodal Robustness

  14. Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness

    Oct 14, 2026Minghao Kong, Deng Yao, Xi Zhang +4Multimodal Sentiment AnalysisMissing-Modality Learning

  15. On the Limits of Representation-Based Test-Time Adaptation for Multimodal LLMs

    Oct 14, 2026Mikołaj Piórczyński, Wojciech Masarczyk, Damian Sójka +2Test-Time AdaptationTest-Time Adaptation of VLMs

  16. SYNPRED: A Synergistic Approach to Multimodal Learning for Clinical Prediction

    Oct 13, 2026Ivana Janíčková, Yen Y. Tan, Thomas H. Helbich +6Clinical PredictionMultimodal Disentangled Representation Learning

  17. SpikeOcc: Towards Resilient Multimodal 3D Occupancy Perception via Spiking Experts

    Oct 11, 2026Yiding Sun, Zijie Xu, Hongqiang Lin +73D Occupancy PredictionMultimodal Robustness

  18. ClinEdge: An Expert-Graded Benchmark of Real Patient Edge Cases Where Frontier Multimodal Models Fail

    Oct 11, 2026Anurag Sharma, Aditya Sharma, Sapna BaalwanMultimodal Model EvaluationMedical Image Benchmarks

  19. Evidential Multimodal Transformers with Dempster-Shafer Fusion for Emotion Recognition

    Oct 9, 2026Muhammad Usama, Yeoreum JungMultimodal Emotion RecognitionUncertainty-Aware Multimodal Fusion

  20. SenseWeather: Multimodal Sensing for Robust Robotic Perception under Extreme Conditions

    Oct 8, 2026Fucai Ke, Sukai Huang, Junyi Hao +4Robotic PerceptionMultimodal Robustness

  21. Targeted Modality Dropout for Real-Robot Manipulation Robust to Intermittent Vision Loss

    Oct 7, 2026Genki Shikada, Kazuki Osamura, Masaru Ide +2Missing-Modality LearningMultimodal Robustness

  22. Beyond Perturbation Magnitude: Direction-Dependent Responses in Multimodal Geometric Representations

    Oct 6, 2026Yongsheng Luo, Wengan He, Yu Li +2Neural Representation GeometryMultimodal Robustness

  23. MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos

    Oct 6, 2026Souptik Sen, Zahra AhmadiMissing-Modality LearningAudio-Visual Understanding

  24. Dynamic Alignment and Calibration for Multimodal Learning

    Oct 6, 2026Jinghao Xu, Zhenhua Guo, Xiaofeng Zhu +1Multimodal RobustnessCross-Modal Alignment

  25. Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series

    Oct 5, 2026Payal Mohapatra, Yueyuan Sui, Haodong Yang +3Missing-Modality LearningTest-Time Adaptation

  26. SAFE-MR: Evidence Sufficiency Learning for Selective Multimodal Rumor Detection

    Oct 5, 2026Shiwen NiMultimodal RobustnessSelective Prediction

  27. Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness

    Oct 3, 2026Songyuan Sui, Zhen Tan, Mohan Zhang +3Missing-Modality LearningMultimodal Robustness