Overview

Missing-modality learning studies how to make systems use information from multiple sources—such as images and clinical records, audio and video, or different sensors—even when some inputs are unavailable. Common approaches simulate missing inputs with modality dropout, adapt fusion according to availability or reliability, or reconstruct missing features using generative models, prototypes, retrieval, and cross-modal distillation; some methods avoid reconstruction and fuse only observed inputs. Research spans medical imaging and electronic health records, sentiment analysis, remote sensing, and robotics, with evaluations increasingly testing varied missing patterns and corruption levels. A central tension is that reconstruction can add useful information but can also introduce errors, so systems must learn when to repair, ignore, or downweight missing or unreliable evidence while maintaining calibration and generalization.

Latest papers

CardsList

173 papers22 papers in the last four weeks, up 38% on the four weeks before. 0.1% of all new papers.

  1. CLoE: Expert Consistency Learning for Robust Missing Modality Segmentation

    Mar 10, 2026Xinyu Tong, Meihua Zhou, Bowu Fan +1Missing-Modality Medical Image SegmentationMedical Image Segmentation

  2. Progressive Representation Learning for Multimodal Sentiment Analysis with Incomplete Modalities

    Mar 10, 2026Jindi Bao, Jianjun Qian, Mengkai Yan +1Multimodal Sentiment AnalysisMissing-Modality Learning

  3. SiMO: Single-Modality-Operable Multimodal Collaborative Perception

    Mar 9, 2026Jiageng Wen, Shengjie Zhao, Bing Li +3Cooperative PerceptionMultimodal Sensor Fusion

  4. Solution to the 10th ABAW Expression Recognition Challenge: A Robust Multimodal Framework with Safe Cross-Attention and Modality Dropout

    Mar 9, 2026Jun Yu, Naixiang Zheng, Guoyuan Wang +5Multimodal Emotion RecognitionFacial Expression Recognition

  5. CoRe-BT: A Multimodal Radiology-Pathology-Text Benchmark for Robust Brain Tumor Typing

    Mar 4, 2026Juampablo E. Heras Rivera, Daniel K. Low, Xavier Xiong +5Brain Tumor ClassificationMedical Image Benchmarks

  6. Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Data

    Mar 3, 2026Sijie Mai, Shiqin Han, Haifeng HuMultimodal RobustnessMissing-Modality Learning

  7. SGMA: Semantic-Guided Modality-Aware Segmentation for Remote Sensing with Incomplete Multimodal Data

    Mar 3, 2026Lekang Wen, Liang Liao, Jing Xiao +1Multimodal Semantic SegmentationRemote Sensing Image Segmentation

  8. ModalPatch: A Plug-and-Play Module for Robust Multi-Modal 3D Object Detection under Modality Drop

    Mar 3, 2026Shuangzhi Li, Lei Ma, Xingyu Li3D Object DetectionMissing-Modality Learning

  9. DeLo: Dual Decomposed Low-Rank Experts Collaboration for Continual Missing Modality Learning

    Mar 2, 2026Xiwei Liu, Yulong Li, Feilong Tang +1Missing-Modality LearningMultimodal Large Language Models

  10. FedUAF: Uncertainty-Aware Fusion with Reliability-Guided Aggregation for Multimodal Federated Sentiment Analysis

    Feb 28, 2026Xianxun Zhu, Zezhong Sun, Imad Rida +4Multimodal Federated LearningMultimodal Sentiment Analysis

  11. When Does Multimodal Learning Help in Healthcare? A Benchmark on EHR and Chest X-Ray Fusion

    Feb 27, 2026Kejing Yin, Haizhou Xu, Wenfang Yao +5Multimodal FusionMultimodal Model Evaluation

  12. Plug, Play, and Fortify: A Low-Cost Module for Robust Multimodal Image Understanding Models

    Feb 26, 2026Siqi Lu, Wanying Xu, Yongbin Zheng +3Missing-Modality LearningMultimodal Learning

  13. Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets

    Feb 23, 2026Yue Zhang, Zhizheng Zhuo, Siyao Xu +6Medical Image SynthesisMissing-Modality Learning

  14. BriMA: Bridged Modality Adaptation for Multi-Modal Continual Action Quality Assessment

    Feb 22, 2026Kanglei Zhou, Chang Li, Qingyi Pan +1Action Quality AssessmentMultimodal Robustness

  15. A Contrastive Variational AutoEncoder for NSCLC Survival Prediction with Missing Modalities

    Feb 19, 2026Michele Zanitti, Vanja Miskovic, Francesco Trovò +5Cancer Survival PredictionMultimodal Survival Analysis

  16. Characterizing the Predictive Impact of Modalities with Supervised Latent-Variable Modeling

    Feb 19, 2026Divyam Madaan, Sumit Chopra, Kyunghyun ChoMissing-Modality LearningMultimodal Learning

  17. ModalImmune: Immunity Driven Unlearning via Self Destructive Training

    Feb 18, 2026Rong Fu, WeiZhi Tang, Ziming Wang +6Multimodal RobustnessMissing-Modality Learning

  18. MissMAC-Bench: Building Solid Benchmark for Missing Modality Issue in Robust Multimodal Affective Computing

    Jan 31, 2026Ronghao Lin, Honghao Lu, Ruixing Wu +5Missing-Modality LearningAffective Computing

  19. FediLoRA: Practical Federated Fine-Tuning of Foundation Models Under Missing-Modality Constraints

    Sep 1, 2025Lishan Yang, Wei Emma Zhang, Nam Kha Nguygen +4Federated Fine-TuningFederated Learning Aggregation

  20. ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completion

    Jul 8, 2025Yuhan Li, Wei Zhang, Juan Chen +3Cross-Modal LearningMissing-Modality Learning

  21. Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion

    Jun 27, 2025Ying Zhang, Yu Zhao, Xuhui Sui +5Multimodal Federated LearningMissing-Modality Learning