Missing-Modality Learning

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 107

All topics

Latent World Recovery for Multimodal Learning with Missing Modalities
Jun 10, 2026Hui Wang, Tianyu Ren, Joseph Butler +3Missing-Modality Learning Cross-Modal Alignment
Queen’s University Belfast, Belfast, United Kingdom
Missing-Token Prompted Reliability-Aware Fusion for Robust Polyglot Speaker Identification
Jun 10, 2026Peng Jia, Li Dai, Jia Li +3Missing-Modality Learning Multimodal Robustness
Hefei University of Technology Hefei, China · Intelligent Interconnected Systems Laboratory of Anhui Province Hefei University of Technology Hefei, China
AnyMod-LLVE: Low-Light Video Enhancement with Modality-Agnostic Inference
Jun 9, 2026Hangfeng Liang, Yutao Hu, Yanhan Hu +3Missing-Modality Learning Cross-Modal Representation Learning
School of Computer Science and Engineering, Southeast University · Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China · Shanghai Innovation Institute +1
Cross-Modal Masking for Robust Silent Speech Synthesis Using sEMG and Lipreading
Jun 8, 2026Eder del Blanco, David Gimeno-Gómez, Eva Navas +2Missing-Modality Learning Multimodal Fusion
Aholab research group within the HiTZ Center at University of the Basque Country (UPV/EHU), Barrio Sarriena s/n, 48940 Leioa, Bizkaia, Spain · PRHLT research center, Universitat Polit`ecnica de Val`encia (UPV), Camino de Vera s/n, 46022, Val`encia, Spain
PRISM: Topology-Aware Cross-Modal Imputation for Modality-Deficient Federated Graph Learning
Jun 8, 2026Zekai Chen, Miao Zhang, Jiayang Xing +4Multimodal Federated Learning Missing-Modality Learning
Beijing Institute of Technology, Beijing, 100081, China
LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts
Jun 6, 2026Maxx Richard Rahman, Prakhar Kumar, Wolfgang MaassMissing-Modality Learning Multimodal Robustness
German Research Centre for Artificial Intelligence (DFKI) Saarbrücken, Germany
Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis
Jun 5, 2026Sanket Kachole, Siddhesh Thakur, Shubham Innani +4Missing-Modality Learning Cancer Survival Prediction
Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine, Indianapolis, IN, USA · IU Melvin and Bren Simon Comprehensive Cancer Center, Indianapolis, IN, USA · Departments of Biostatistics and Health Data Science; Radiology and Imaging Sciences; Neurological Surgery; Indiana University School of Medicine, Indianapolis, IN, USA +1
PAMF: Prior-Aware Multimodal Fusion for Incomplete Time Series Data
Jun 4, 2026Ziwen Kan, Wugeng Zheng, Tianlong Chen +1Missing-Modality Learning Flow Matching
Department of Computer Science, University of Central Florida · Department of Computer Science, University of North Carolina at Chapel Hill
TRACE: A Temporal Conditional Estimation for Multimodal Time Series Foundation Models
Jun 4, 2026Ziwen Kan, Yishuo Chen, Kecheng Li +7Irregular Time-Series Modeling Missing-Modality Learning
Department of Computer Science, University of Central Florida · Department of Computer Science, University of North Carolina at Chapel Hill
To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection
Jun 4, 2026Erfan Loweimi, Mengjie Qian, Kate Knill +7Missing-Modality Learning Audio-Visual Understanding
University of Cambridge, UK · Southwest Jiaotong University, China · University of Surrey, UK +1
Disentangled Fine-Grained Prototype Learning for Incomplete Image-Tabular Classification
Jun 3, 2026Feixiang Zhou, Jianyang Xie, Zhuangzhi Gao +10Missing-Modality Learning Cross-Modal Alignment
School of Eye and Vision Sciences, University of Liverpool, U.K. · School of Computer Science, University of Exeter, U.K. · School of Computer Science and Engineering, South China University of Technology, China +4
Beyond Missing Rates: Rethinking Incomplete Multi-View Clustering with Protocol Divergence
Jun 3, 2026Haolu Liu, Xiyue Wang, Xuanting Xie +2Missing-Modality Learning Learning with Missing Data
CL-DMDF:Dynamic Multimodal Data Fusion Model Based on Contrastive Learning
Jun 1, 2026Dong Li, Lingling Zhang, Binghao Han +2Missing-Modality Learning Cross-Modal Attention
School of Information, Liaoning University, Shenyang, China · School of Computer Science and Engineering, Northeastern University, Shenyang, China
Can BEV Perception Gracefully Degrade under Sensor Failures?
May 29, 2026Haifa Zhang, Yijing Wang, Haoyu Wang +2Missing-Modality Learning Multimodal Robustness
Tianjin Key Laboratory of Intelligent Unmanned Swarm Technology and System, School of Electrical and Information Engineering, Tianjin University, Tianjin, China · Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai, China
Towards Unified Vision-Language Models with Incomplete Multi-Modal Inputs
May 27, 2026Xiang Fang, Wanlong Fang, Changshuo Wang +4Missing-Modality Learning VLM Robustness
School of Software Engineering, Huazhong University of Science and Technology · Nanyang Technological University, Singapore · University College London +3
Context-driven Missing-Modality Learning for Robust Medical Diagnosis with Image-Tabular Data
May 25, 2026Tianling Liu, Lequan Yu, Tong Han +1Missing-Modality Learning Multimodal Robustness
College of Intelligence and Computing, Tianjin University, Tianjin 300350, China. · Department of Statistics and Actuarial Science, School of Computing and Data Science, The University of Hong Kong, Hong Kong. · Department of Radiology, Tianjin Huanhu Hospital, Tianjin 300350, China. +2
Multimodality Stacking with Blockwise missing values and application to the PIONeeR biomarkers study for prediction of resistance to immunotherapy
May 24, 2026Mohamed Boussena, Florence Monville, Jacques Fieschi-Meric +8Missing-Modality Learning Cancer Survival Prediction
Inria – Inserm team COMPO, COMPutational pharmacology and clinical Oncology, Centre Inria Sophia Antipolis - M´editerran´ee, Centre de Recherches en Canc´erologie de Marseille, Inserm U1068, CNRS UMR7258, Institut Paoli-Calmettes, Pharmacy faculty, Aix-Marseille University · Veracyte SAS, Marseille, France · Assistance Publique-Hˆopitaux de Marseille (APHM), Marseille, France +4
AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning
May 24, 2026Jian Lang, Rongpei Hong, Ting Zhong +1Missing-Modality Learning Multimodal Reasoning
University of Electronic Science and Technology of China, Chengdu, Sichuan · Intelligent Digital Media Technology Key Laboratory of Sichuan Province, Chengdu, Sichuan
GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences
May 22, 2026Pengfei Song, Fangjin Liu, Wenwen Zeng +5Missing-Modality Learning Medical Diagnosis
School of Biomedical Engineering and Technology Innovation, Fudan University · Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University · 3Intelligent Diagnosis and Treatment Laboratory for Brain Diseases, Joint Laboratory of Neurosurgery Department of Huashan Hospital and School of Information Science and Technology, Fudan University
D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities
May 21, 2026Danish Ali, Ajmal Mian, Naveed Akhtar +1Missing-Modality Learning BraTS
The University of Western Australia, Perth, WA 6009, Australia · The University of Melbourne, Melbourne, Parkville VIC 3010, Australia
Latent Space Guided Scenario Sampling for Multimodal Segmentation Under Missing Modalities
May 19, 2026Irem Ulku, Ö. Özgür Tanrıöver, Erdem AkagündüzMissing-Modality Learning Remote Sensing Image Segmentation
Department of Computer Engineering, Ankara University, Ankara, Türkiye · Department of Modeling and Simulation, Graduate School of Informatics, METU, Ankara, Türkiye
Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Missing-Modality Learning Multimodal Robustness
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China) · Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software · The Hong Kong University of Science and Technology (Guangzhou)
Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities
May 16, 2026Sha Tao, Jiao Pan, Yu Guo +1Missing-Modality Learning Heterogeneous GNNs
University of Science and Technology Beijing, Beijing, China
MedMIX: Modality-Internal Expert Fusion for Multimodal Medical Diagnosis
May 15, 2026Seungik Cho, Anqi Li, Wei QiuMissing-Modality Learning Multimodal Robustness
Department of Electrical and Computer Engineering Rice University Houston, TX 77005
MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusion
May 13, 2026Wugeng Zheng, Ziwen Kan, Tianlong Chen +2Missing-Modality Learning Multimodal Robustness
University of Central Florida · University of North Carolina at Chapel Hill
PRA-PoE: Robust Multimodal Alzheimer's Diagnosis with Arbitrary Missing Modalities
May 13, 2026Guangqian Yang, Ye Du, Wenlong Hou +2Missing-Modality Learning Alzheimer's Disease
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China · Department of Technology Management for Innovation, The University of Tokyo,2026 Japan · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China
BrainAnytime: Anatomy-Aware Cross-Modal Pretraining for Brain Image Analysis with Arbitrary Modality Availability
May 13, 2026Guangqian Yang, Tong Ding, Wenlong Hou +4Missing-Modality Learning Masked Autoencoders
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China · Department of Technology Management for Innovation, The University of Tokyo, Japan · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China
VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
May 13, 2026Yuxuan Weng, Wenhan Luo, Qijia ShaoMissing-Modality Learning Disentangled Representation Learning
The Hong Kong University of Science and Technology (HKUST)
Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity
May 12, 2026Sirui Zhang, Haonan Wang, Xunkai Li +5Multimodal Federated Learning Missing-Modality Learning
Beijing Institute of Technology
Resilient Vision-Tabular Multimodal Learning under Modality Missingness
May 12, 2026Camillo Maria Caruso, Valerio Guarrasi, Paolo SodaMissing-Modality Learning Multimodal Robustness
Research Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Roma, Italy, Europe · Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Umeå, Sweden, Europe

Jun 10, 2026, cs.LGJ/K move · Enter open · S save

Latent World Recovery for Multimodal Learning with Missing Modalities

Hui Wang, Tianyu Ren, Joseph Butler, Christopher Baker+2

Queen’s University Belfast, Belfast, United Kingdom

Missing-Modality Learning Cross-Modal Alignment Multimodal Fusion Multimodal Understanding

Open paper AskPDF arXiv

We study multimodal learning under missing modalities, with particular motivation from bioscience applications in which heterogeneous modalities are often only partially available when decisions need to be made. We propose Latent World Recovery (LWR), a framework built on two key ideas: (i) modality-specific embeddings from different modalities are aligned in a shared latent space, and (ii) a unified representation is constructed by fusing only the embeddings of the modalities that are actually available at both training and inference time. Rather than imputing missing modalities or requiring a fixed modality set, LWR treats each modality as a partial perception of an underlying latent state and performs availability-aware representation learning directly from the observed modalities. This combination of neighbor-based latent alignment and availability-aware modality fusion enables robust multimodal prediction under partial observation, while avoiding error propagation from explicit reconstruction of missing modalities. We evaluate the proposed framework on real-world incomplete multi-omics benchmarks and demonstrate that it provides an effective approach to downstream tasks such as cancer phenotype classification and survival prediction.

Momentum

Related topics

Latest papers 107