Missing Modalities

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 51

All topics

Fed-ReMasker: Federated Tabular Imputation under Feature-Level Missingness
Sep 23, 2026Ioannis Papathanail, Rooholla Poursoleymani, Lubnaa Abdur Rahman +1Imputation Federated Learning
ARTORG Center for Biomedical Engineering Research University of Bern, Bern, Switzerland · Graduate School for Cellular and Biomedical Sciences University of Bern, Bern, Switzerland
GLR-MM: Graph-Based Global-Local Reconstruction for Robust Multimodal Chest X-ray and EHR Representation Learning under Missing Modalities
Sep 20, 2026Surbhi Sharma, Nikhil Manali, Devesh MaheshwariIntensive Care Unit Mortality Prediction Missing Modalities
Houston Methodist, Houston, TX, USA · University of Wisconsin–Madison, Madison, WI, USA · Walmart, USA
Robust small-molecule identification from incomplete, degraded, and inconsistent spectra using multimodal mixed-condition training
Sep 13, 2026Bowen Gao, Lei Zhu, Yiying Wang +1Laser-Induced Breakdown Spectroscopy Missing Modalities
State Key Laboratory of Materials for Integrated Circuits, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, 865 Changning Road, Shanghai 200050, China
Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction
Sep 12, 2026Han-Jun Choi, Byunggill Joe, Saim Shin +1Multimodal Sentiment Analysis Missing Modalities
Korea Electronics Technology Institute (KETI) Seongnam, South Korea
I Don't Miss You, but I Do: Self-Explanation Faithfulness of Modality Missingness in Vision-Language Models
Sep 7, 2026Aydin Javadov, Daniel Schoess, Florian von WangenheimModalities Missing Modalities
ETH Zurich
TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment
Aug 31, 2026Merna Bibars, Bolaji Omofojoye, Allan I. Levey +3Mild Cognitive Impairment Multimodal Clinical Data
Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA · Department of Systems and Biomedical Engineering, Cairo University, Giza, Egypt · Department of Biomedical Informatics, Emory University, Atlanta, GA, USA +2
Multimodal Federated Learning under Dual-Axis Modality Missingness
Aug 10, 2026Adiba Orzikulova, Jaehyun Kwak, Jaemin Shin +5Federated Learning Missing Modalities
1KAIST · 2CUHK · 3HKUST
Conformal Calibration for Multi-Modal Regression with Missing Modalities
Aug 7, 2026Ilia AziziOnline Conformal Prediction Missing Modalities
Department of Operations, HEC Lausanne, University of Lausanne, Switzerland · BegooAI, Switzerland
Conformal Fusion Under Missing Modalities
Aug 7, 2026Alireza MoayedikiaMissing Modalities Multimodal Fusion
Department of Business Technology and Entrepreneurship Swinburne University of Technology Hawthorn, VIC 3122, Australia
Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations
Aug 4, 2026Chunlei Meng, Jacqueline J. Pang, Pengbin Feng +3Multimodal Sentiment Analysis Missing Modalities
The College of Intelligent Robotics and Advanced Manufacturing (CIRAM), Fudan University · J.P. Morgan Chase · University of Southern California (USC) +1
Compass: Degradation-Simulated Reciprocal Learning with Lightweight Needle RWKV for Multimodal Crack Segmentation under Missing Modalities
Aug 4, 2026Hui Liu, Chen Jia, Fan Shi +3Missing Modalities Amodal Segmentation
Engineering Research Center of Learning-Based Intelligent System (Ministry of Education) Tianjin University of Technology Tianjin, China
Implicit Neural Representations for Multimodal Longitudinal Image Imputation and Interpolation
Aug 3, 2026Sina Wendrich, Lukas Förner, Zoe Reinke +5Magnetic Resonance Imaging Imputation
Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Augsburg, Augsburg, Germany · Digital Medicine, University Hospital Augsburg, Augsburg, Germany · Chair for Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich, Garching bei München, Germany +3
Spatio-Temporal Conditional Denoising Transformer for Modality-Missing RGBT Tracking
Jul 27, 2026Andong Lu, Ziyi Zha, Jiandong Jin +4Rgb-Event Object Tracking Spatio-Temporal Transformers
School of Computer Science and Technology, Anhui University, China · School of Artificial Intelligence, Anhui University, China
Co-Learning for Missing Arbitrary Modalities in Multi-modal Classification
Jul 27, 2026Francisco Mena, Dino Ienco, Roberto Interdonato +2Missing Modalities Multimodal Classification
GFZ Helmholtz Center for Geosciences, Potsdam, Germany · INRAE, UMR TETIS, University of Montpellier, Montpellier, France · INRIA, EVERGREEN, University of Montpellier, Montpellier, France +1
FedTaste: Topology-Aware Structural Transfer for Multimodal Federated Learning with Missing Modalities
Jul 25, 2026Haochen Liang, Jie Zhang, Hideya OchiaiMultimodal Learning Missing Modalities
The University of Tokyo Tokyo, Japan · Great Bay University Dongguan, China
Toward Reliable RGB-D Semantic Segmentation: Handling Missing Modalities via Condition Dropout
Jul 22, 2026Xuchen Zhu, Yajuan Wei, Shuang Hao +3Dropout Semantic Segmentation
Xi’an University of Posts & Telecommunications, Xi’an, China · Xi’an Jiaotong University, Xi’an, China · Huazhong University of Science and Technology, Wuhan, China +1
Posterior Samplings are Missing Modalities Generators for Medical Image Translation
Jul 21, 2026Jonghun KimMissing Modalities Cross-Modality
Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Korea
Should Missing Modalities Always Be Necessary to Repair for Multi-modal Sentiment Analysis?
Jul 19, 2026Yubo Gao, Haotian Wu, Xiaoyu Xu +9Multimodal Sentiment Analysis Missing Modalities
The Hong Kong University of Science and Technology (Guangzhou) · The Hong Kong University of Science and Technology · Nanyang Technological University +2
MAMMOTH: A Multi-Modal End-to-End Policy for Off-Road Mobility Robust to Missing Modality
Jul 14, 2026Ahaan Kotian, Shivani Subramanyan, Suresh SundaramTerrain Missing Modalities
Artificial Intelligence and Robotics Lab, Department of Aerospace Engineering, Indian Institute of Science, India.
General Incomplete Multimodal Learning via Dynamic Quality Perception
Jul 8, 2026Xiangyu Meng, Shicai WeiMultimodal Learning Missing Modalities
University of Electronic Science and Technology of China
ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
Jul 7, 2026Aavash Chhetri, Bibek Niroula, Eduard Vazquez +4Missing Modalities Federated Learning
NepAl Applied Mathematics and Informatics Institute for research, Nepal · Fogsphere (Redev.AI Ltd), UK · University of Lausanne, Switzerland +4
Learning from Reliable Latent Prompts for Visual Recognition with Missing Modalities
Jun 29, 2026Taixi Chen, Nancy GuoMultimodal Learning Missing Modalities
School of Computing State University of New York at Binghamton
Set-Inclusive Uncertainty Modeling for Robust Brain Tumor Segmentation
Jun 29, 2026Seunghun Baek, Jihwan Park, Jaeyoon Sim +3Brain Tumor Segmentation Magnetic Resonance Imaging
Pohang University of Science and Technology, Pohang, South Korea
Residual-Guided Expert Specialization for Incomplete Multimodal Learning
Jun 29, 2026Seunghun Baek, Jihwan Park, Jaeyoon Sim +3Missing Modalities Multimodal Learning
Pohang University of Science and Technology (POSTECH), South Korea
Evidential Fusion Network for Multimodal Survival Prediction under Missing Modalities
Jun 18, 2026Yucheng Xing, Hailan Mo, Zi Wang +2Missing Modalities Survival Predictions
National University of Singapore, Singapore · Imperial College London, London, UK
Unsupervised Learning for Missing Modalities in Multimodal Learning
Jun 14, 2026Hassan Ismkhan, Hamid BouchahciaMissing Modalities Multimodal Learning
Bournemouth University Bournemouth, UK
Reinforcement Learning-Guided Retrieval with Soft Fusion for Robust Multimodal Imitation Learning under Missing Modalities
Jun 13, 2026Hassan Ismkhan, Hamid BouchahciaScalable Robot Learning Missing Modalities
Bournemouth University Bournemouth, UK
An Attention-based Model for Robust Forecasting with Missing Modality
Jun 11, 2026Zhitian Zhang, Wenjie Zi, Yunduz Rakhmangulova +3Missing Modalities Multimodal Model
1Simon Fraser University · 2RBC Borealis
Latent World Recovery for Multimodal Learning with Missing Modalities
Jun 10, 2026Hui Wang, Tianyu Ren, Joseph Butler +3Missing Modalities Multimodal Learning
Queen’s University Belfast, Belfast, United Kingdom
PRISM: Topology-Aware Cross-Modal Imputation for Modality-Deficient Federated Graph Learning
Jun 8, 2026Zekai Chen, Miao Zhang, Jiayang Xing +4Federated Graph Learning Missing Modalities
Beijing Institute of Technology, Beijing, 100081, China
LongMoE: Longitudinal Multimodal Learning via Trajectory-Aware Mixture-of-Experts
Jun 6, 2026Maxx Richard Rahman, Prakhar Kumar, Wolfgang MaassMultimodal Clinical Data Missing Modalities
German Research Centre for Artificial Intelligence (DFKI) Saarbrücken, Germany
Multi-FRuGaL: Multimodal Flexible Redundancy-aware Decomposed Gated Learning for Cancer Diagnosis and Prognosis
Jun 5, 2026Sanket Kachole, Siddhesh Thakur, Shubham Innani +4Missing Modalities Cancer Detection
Division of Computational Pathology, Department of Pathology and Laboratory Medicine, Indiana University School of Medicine, Indianapolis, IN, USA · IU Melvin and Bren Simon Comprehensive Cancer Center, Indianapolis, IN, USA · Departments of Biostatistics and Health Data Science; Radiology and Imaging Sciences; Neurological Surgery; Indiana University School of Medicine, Indianapolis, IN, USA +1
PAMF: Prior-Aware Multimodal Fusion for Incomplete Time Series Data
Jun 4, 2026Ziwen Kan, Wugeng Zheng, Tianlong Chen +1Imputation Missing Modalities
Department of Computer Science, University of Central Florida · Department of Computer Science, University of North Carolina at Chapel Hill
TRACE: A Temporal Conditional Estimation for Multimodal Time Series Foundation Models
Jun 4, 2026Ziwen Kan, Yishuo Chen, Kecheng Li +7Time Series Foundation Models Missing Modalities
Department of Computer Science, University of Central Florida · Department of Computer Science, University of North Carolina at Chapel Hill
Learning What Not to Impute: An Uncertainty-Aware Diffusion Framework for Meaningful Missingness
Jun 3, 2026Lixing Zhang, Yidong Ouyang, Weifu Li +3Imputation Missing Data
University of Minnesota · University of California, Los Angeles · Carnegie Mellon University
AOEPT: Breaking the Implicit Modality-Reduction Bottleneck in Modality-Missing Prompt Tuning
May 24, 2026Jian Lang, Rongpei Hong, Ting Zhong +1Missing Modalities Multimodal Continual Instruction Tuning
University of Electronic Science and Technology of China, Chengdu, Sichuan · Intelligent Digital Media Technology Key Laboratory of Sichuan Province, Chengdu, Sichuan
D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities
May 21, 2026Danish Ali, Ajmal Mian, Naveed Akhtar +1Brain Tumor Segmentation Magnetic Resonance Imaging
The University of Western Australia, Perth, WA 6009, Australia · The University of Melbourne, Melbourne, Parkville VIC 3010, Australia
Latent Space Guided Scenario Sampling for Multimodal Segmentation Under Missing Modalities
May 19, 2026Irem Ulku, Ö. Özgür Tanrıöver, Erdem AkagündüzAmodal Segmentation Missing Modalities
Department of Computer Engineering, Ankara University, Ankara, Türkiye · Department of Modeling and Simulation, Graduate School of Informatics, METU, Ankara, Türkiye
Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities
May 16, 2026Chenglizhao Chen, Yuchen Cao, Xinyu Liu +3Multimodal Sentiment Analysis Missing Modalities
Qingdao Institute of Software, College of Computer Science and Technology, China University of Petroleum (East China) · Shandong Key Laboratory of Intelligent Oil & Gas Industrial Software · The Hong Kong University of Science and Technology (Guangzhou)
Virtual Nodes Guided Dynamic Graph Neural Network for Brain Tumor Segmentation with Missing Modalities
May 16, 2026Sha Tao, Jiao Pan, Yu Guo +1Brain Tumor Segmentation Missing Modalities
University of Science and Technology Beijing, Beijing, China
MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusion
May 13, 2026Wugeng Zheng, Ziwen Kan, Tianlong Chen +2Missing Modalities Multimodal Fusion
University of Central Florida · University of North Carolina at Chapel Hill
PRA-PoE: Robust Multimodal Alzheimer's Diagnosis with Arbitrary Missing Modalities
May 13, 2026Guangqian Yang, Ye Du, Wenlong Hou +2Missing Modalities Multimodal Learning
Department of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China · Department of Technology Management for Innovation, The University of Tokyo,2026 Japan · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China
VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
May 13, 2026Yuxuan Weng, Wenhan Luo, Qijia ShaoMissing Modalities Wearable Physiology
The Hong Kong University of Science and Technology (HKUST)
Resilient Vision-Tabular Multimodal Learning under Modality Missingness
May 12, 2026Camillo Maria Caruso, Valerio Guarrasi, Paolo SodaMissing Modalities Multimodal Learning
Research Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Roma, Italy, Europe · Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering, Umeå University, Umeå, Sweden, Europe
LARGO: Low-Rank Hypernetwork for Handling Missing Modalities
May 7, 2026Niels Vyncke, Pooya Ashtari, Aleksandra PižuricaMissing Modalities Modalities
Department of Telecommunications and Information Processing Ghent University Ghent, Belgium
Conditional Imputation for Within-Modality Missingness in Multi-Modal Federated Learning
Apr 25, 2026Wugeng Zheng, Ziwen Kan, Katie Wang +2Missing Modalities Imputation
University of Central Florida · Independent Researcher
Federated Cross-Modal Retrieval with Missing Modalities via Semantic Routing and Adapter Personalization
Apr 24, 2026Hefeng Zhou, Xuan Liu, Sicheng Chen +7Cross-Modal Missing Modalities
Shanghai Jiao Tong University · Hohai University · Shenzhen Univ of Advanced Technology
Uni-Encoder Meets Multi-Encoders: Representation Before Fusion for Brain Tumor Segmentation with Missing Modalities
Apr 24, 2026Peibo Song, Xiaotian Xue, Jinshuo Zhang +5Brain Tumor Segmentation Magnetic Resonance Imaging
School of Mathematics, Shandong University · 2GSFS, The University of Tokyo · 3MedVisAI Lab +2
Handling and Interpreting Missing Modalities in Patient Clinical Trajectories via Autoregressive Sequence Modeling
Apr 20, 2026Andrew Wang, Ellie Pavlick, Ritambhara SinghMultimodal Clinical Data Missing Modalities
Brown University
ADMC: Attention-based Diffusion Model for Missing Modalities Feature Completion
Jul 8, 2025Yuhan Li, Wei Zhang, Juan Chen +3Missing Modalities Cross-Modal
National University of Defense Technology · The Fifth Electronic Research Institute of MIIT · University of Chinese Academy of Sciences +2
A Multimodal Feature Distillation with Mamba-Transformer Network for Brain Tumor Segmentation with Incomplete Modalities
Apr 22, 2024Ming Kang, Fung Fung Ting, Shier Nee Saw +3Brain Tumor Segmentation Amodal Segmentation
School of Information Technology, Monash University, Malaysia Campus, Subang Jaya 47500, Malaysia · Augmented Intelligence and Multimodal analytics (AIM) for Health Lab, Faculty of Information Technology, Monash University, Clayton VIC 3800, Australia · Monash Medical AI Group, Monash University, Clayton VIC 3800, Australia +1

Sep 23, 2026, cs.LGJ/K move · Enter open · S save

Fed-ReMasker: Federated Tabular Imputation under Feature-Level Missingness

Ioannis Papathanail, Rooholla Poursoleymani, Lubnaa Abdur Rahman, Stavroula Georgia Mougiakakou

ARTORG Center for Biomedical Engineering Research University of Bern, Bern, Switzerland · Graduate School for Cellular and Biomedical Sciences University of Bern, Bern, Switzerland

Imputation Federated Learning Missing Data Missing Modalities Imbalanced Classification Patients+1

Open paper AskPDF arXiv

Multi-center clinical studies and biomedical research collaborations increasingly seek to utilize data across centers to build models that generalize beyond any single center. This creates two distinct challenges: data protection regulations may restrict the sharing of raw patient data across institutions, while centers may collect only partially overlapping sets of features under different protocols. Federated learning enables collaborative model training without centralizing raw data. However, existing federated imputation methods rarely evaluate feature-level missingness, in which entire features are unobserved at some centers. To address this setting, we adapt the ReMasker masked autoencoder to federated learning (Fed-ReMasker), enabling centers to impute features never observed locally by leveraging knowledge learned across collaborating centers. We evaluate Fed-ReMasker in a benchmark spanning synthetic datasets with linear and nonlinear relationships and real-world tabular datasets, including clinical data. The benchmark varies the number of centers, the missingness ratios, and client heterogeneity. Fed-ReMasker achieves the lowest imputation error in 93.2% of value-level and 96.7% of feature-level scenarios in the homogeneous benchmark. It also remains robust to client heterogeneity using simple federated averaging, outperforming all baselines in all 36 value-level scenarios and each baseline in at least 35 of 36 feature-level scenarios, and comes within 3.0% on average of a centralized model trained on the pooled data.

Momentum

Related topics

Latest papers 51