Missing-Modality Learning

Follow this topic Ask about this topic

Momentum

10 papers in the last four weeks, up 43% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 107

All topics

Missing Modality-Aware Calibration for Trustworthy Brain Tumor Segmentation
Oct 8, 2026Sol Lee, Hyunji Kim, Sungrae Hong +2Probability Calibration Brain Tumor Segmentation
Korea Advanced Institute of Science and Technology, Daejeon, South Korea
MC-TRCM: Observation-Aware Recursive Fusion for Incomplete Mobile and Wearable Mental-Health Feature Views
Oct 8, 2026Wentao Wang, Lifeng Han, Zining Ren +2Clinical Outcome Prediction Clinical Prediction
Dalian University of Technology, Dalian, China · The Hong Kong Polytechnic University, Hong Kong, China · Southwest University, Chongqing, China
CoPoE: Multimodal Fusion via Decomposable Disease-Coordinate Product-of-Experts for Missing-Modality Alzheimer's Diagnosis
Oct 8, 2026Chihun An, Ikbeom JangAlzheimer's Disease Classification Multimodal Fusion
Department of Artificial Intelligence Hanyang University Seoul, Republic of Korea · Division of Computer Engineering Hankuk University of Foreign Studies Yongin, Republic of Korea
Targeted Modality Dropout for Real-Robot Manipulation Robust to Intermittent Vision Loss
Oct 7, 2026Genki Shikada, Kazuki Osamura, Masaru Ide +2Missing-Modality Learning Multimodal Robustness
Fujitsu Limited, Kanagawa 211-8588, Japan. · Faculty of Science and Engineering, Waseda University, Tokyo 169-8050, Japan. · National Institute of Advanced Industrial Science and Technology, Tokyo 100-8921, Japan.
MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos
Oct 6, 2026Souptik Sen, Zahra AhmadiMissing-Modality Learning Audio-Visual Understanding
Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine (CAIMed), Hannover, Germany
Source-Learned Reliance for Selective Test-Time Adaptation of Multimodal Time Series
Oct 5, 2026Payal Mohapatra, Yueyuan Sui, Haodong Yang +3Missing-Modality Learning Test-Time Adaptation
Arm Inc., USA · Northwestern University, USA
ARO: Aligned Representation learning for multi-Omics data
Oct 5, 2026Amogh Singh, Yash Shah, Chiara D'Ercoli +4Missing-Modality Learning Learning with Missing Data
Department of Computer Science, University of Cambridge, Cambridge, UK · DIAG, University of Rome “Sapienza”, Rome, Italy · Max Planck Institute for Intelligent Systems
CAMOS: Coupled Oscillatory State-Space Model for Multimodal Clinical Time-Series
Sep 30, 2026Maxx Richard Rahman, Mostafa Hammouda, Wolfgang MaassIrregular Time-Series Modeling Missing-Modality Learning
Saarland University and German Research Center for Artificial Intelligence (DFKI) Saarbrücken, Germany · Saarland University Saarbrücken, Germany
TSMD: Temporal-Stream Modality Dropout for Robust Video Highlight Detection
Sep 30, 2026Bo-Yuan Cheng, Kuan-Yu Chen, Po-Han Huang +2Missing-Modality Learning Multimodal Robustness
AI Research Center, Inventec Corporation, Taiwan · Graduate Institute of Communication Engineering, National Taiwan University, Taiwan
Semantic Modality Compensation for Unsupervised Visible-Infrared Person Re-identification under Unpaired Settings
Sep 28, 2026Duanning Chen, Ke He, Bin Yang +1Missing-Modality Learning Multimodal Disentangled Representation Learning
Wuhan University
SemMSA: Latent Semantic-Aided Robust Multimodal Sentiment Analysis with Incomplete Data
Sep 24, 2026Wenhao Li, Zhibin Wu, Chong Xiao +1Missing-Modality Learning Multimodal Robustness
Software School, Shandong University · Shenzhen Loop Area Institute
MMAP: Multimodal Missing-Aware Pretraining for Longitudinal Alzheimer's Prediction
Sep 22, 2026Fiona Kekwick, Matthew Baugh, Bernhard Kainz +2Missing-Modality Learning Cross-Modal Alignment
Department of Computing, Imperial College London, London, UK · FAU Erlangen-Nürnberg, Erlangen, Germany · Department of Brain Sciences, Imperial College London, London, UK +1
GLR-MM: Graph-Based Global-Local Reconstruction for Robust Multimodal Chest X-ray and EHR Representation Learning under Missing Modalities
Sep 20, 2026Surbhi Sharma, Nikhil Manali, Devesh MaheshwariMissing-Modality Learning Graph Neural Networks
Houston Methodist, Houston, TX, USA · University of Wisconsin–Madison, Madison, WI, USA · Walmart, USA
AsyncCouple-Flow: Asynchronous Cross-Modal Coupling and Flow Matching for Spatio-Temporal Forecasting
Sep 15, 2026Zhixiang Wu, Yining Liu, Bo Zhao +4Missing-Modality Learning Spatiotemporal Forecasting
Institute of Computing Technology, Chinese Academy of Sciences, China · Emory University, USA · University of California, Berkeley, USA +3
LGFN: Lightweight Gated RGB-Polarization Fusion with Modality-Availability Conditioning for Camouflaged Object Detection
Sep 14, 2026Zhuangfan Huang, Xiaosong Li, Yang Liu +2Missing-Modality Learning Efficient Multimodal Inference
Guangdong-HongKong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, School of Physics and Optoelectronic Engineering, Foshan University, Foshan 528225, China. · School of Mechanical and Electrical Engineering, China University of Mining and Technology-Beijing, Beijing 100083, China.
Robust small-molecule identification from incomplete, degraded, and inconsistent spectra using multimodal mixed-condition training
Sep 13, 2026Bowen Gao, Lei Zhu, Yiying Wang +1Missing-Modality Learning Multimodal Robustness
State Key Laboratory of Materials for Integrated Circuits, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, 865 Changning Road, Shanghai 200050, China
Robust Multimodal Sentiment Analysis with Incomplete Modalities via Semantic-aware Completeness based Reconstruction
Sep 12, 2026Han-Jun Choi, Byunggill Joe, Saim Shin +1Missing-Modality Learning Multimodal Robustness
Korea Electronics Technology Institute (KETI) Seongnam, South Korea
Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection
Sep 3, 2026Yue Zhao, Hua Yu, Yukun Zhao +6Missing-Modality Learning Multimodal Robustness
School of Electronic Engineering, Key Laboratory of Collaborative Intelligence Systems, Ministry of Education, Xidian University, Xi’an 710071, China · College of Computing and Data Science, Nanyang Technological University, Singapore · School of Electronics and Communication Engineering, Sun Yat-sen University, Guangzhou 510275, China +3
Test-Time Logit Prompting for Source-Free Missing Modality Adaptation
Sep 2, 2026Taixi Chen, Nancy GuoMissing-Modality Learning Test-Time Adaptation
School of Computing State University of New York at Binghamton
TAMI: Temporally Aligned, Missingness-Aware, and Interpretable Multimodal Fusion for Mental Health Assessment in Older Adults with Mild Cognitive Impairment
Aug 31, 2026Merna Bibars, Bolaji Omofojoye, Allan I. Levey +3Missing-Modality Learning Depression Detection
Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, GA, USA · Department of Systems and Biomedical Engineering, Cairo University, Giza, Egypt · Department of Biomedical Informatics, Emory University, Atlanta, GA, USA +2
Whole-Body MRI Classification via Prompt-Based Clinical Conditioning
Aug 31, 2026Laura Daza, Marta Hasny, Cristina González +1Missing-Modality Learning Multimodal Classification
Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany · School of Computation, Information and Technology, Technical University of Munich, Germany · School of Biomedical Engineering & Imaging Sciences, King’s College London, UK +1
Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective
Aug 31, 2026Jiaqi Zhang, Zheng Pang, Mengting Li +9Missing-Modality Learning Memory-Augmented Neural Networks
Jiangsu University · Griffith University · National University of Singapore +8
Sequential Modality Dropout for Robust Multi-Modal Sequential Recommendation
Aug 10, 2026Guanqun Yang, Wenlong ZhangMissing-Modality Learning Multimodal Robustness
Stevens Institute of Technology Hoboken, NJ, USA
Multimodal Federated Learning under Dual-Axis Modality Missingness
Aug 10, 2026Adiba Orzikulova, Jaehyun Kwak, Jaemin Shin +5Multimodal Federated Learning Missing-Modality Learning
1KAIST · 2CUHK · 3HKUST
Conformal Fusion Under Missing Modalities
Aug 7, 2026Alireza MoayedikiaMissing-Modality Learning Group-Conditional Conformal Prediction
Department of Business Technology and Entrepreneurship Swinburne University of Technology Hawthorn, VIC 3122, Australia
AnyTrack: Unifying Visual Object Tracking with Any Modalities
Aug 7, 2026Hao Li, Yunzhi Zhuge, Wenning Hao +4Missing-Modality Learning Unified Multimodal Models
Army Engineering University of PLA Nanjing, China · Dalian University of Technology Dalian, China · National University of Defense Technology Nanjing, China
MIDAS: Mutual Information Disentanglement with Uncertainty-Aware Fusion for Incomplete Multimodal Sentiment Analysis
Aug 6, 2026Yuhua Wen, Yingying Zhou, Qifei Li +4Missing-Modality Learning Multimodal Disentangled Representation Learning
School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China · Zhongguancun Academy, Beijing 100094, China · Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China +1
GAUGE: Granularity-Adaptive Counterfactual Gating of Evidence for Incomplete Multimodal Classification
Aug 6, 2026Yunping Shi, En Yu, Kairui Guo +1Missing-Modality Learning Feature Attribution
Australian Artificial Intelligence Institute (AAII), University of Technology Sydney (UTS), Australia
Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations
Aug 4, 2026Chunlei Meng, Jacqueline J. Pang, Pengbin Feng +3Missing-Modality Learning Multimodal Sentiment Analysis
The College of Intelligent Robotics and Advanced Manufacturing (CIRAM), Fudan University · J.P. Morgan Chase · University of Southern California (USC) +1
Compass: Degradation-Simulated Reciprocal Learning with Lightweight Needle RWKV for Multimodal Crack Segmentation under Missing Modalities
Aug 4, 2026Hui Liu, Chen Jia, Fan Shi +3Missing-Modality Learning Efficient Multimodal Inference
Engineering Research Center of Learning-Based Intelligent System (Ministry of Education) Tianjin University of Technology Tianjin, China

Oct 8, 2026, cs.CVJ/K move · Enter open · S save

Missing Modality-Aware Calibration for Trustworthy Brain Tumor Segmentation

Sol Lee, Hyunji Kim, Sungrae Hong, Donghee Han+1

Korea Advanced Institute of Science and Technology, Daejeon, South Korea

Probability Calibration Brain Tumor Segmentation Segmentation Uncertainty Estimation Missing-Modality Learning

Open paper AskPDF arXiv

Multimodal brain tumor segmentation typically leverages multiple MRI modalities, yet incomplete modality acquisition is common in clinical practice due to protocol heterogeneity and scan failures. Although recent methods maintain segmentation accuracy under missing modality conditions, they frequently overlook prediction reliability, leading to miscalibrated confidence estimates that hinder clinical adoption. Existing calibration techniques are largely modality-agnostic or assume that prediction difficulty decreases monotonically as additional modalities become available. However, in brain tumor segmentation, prediction difficulty depends primarily on which modalities are absent rather than how many, leading to combination-specific and spatially heterogeneous calibration errors. To address this, we propose Missing Modality-Aware Local Temperature Scaling (MMA-LTS), a post-hoc voxel-wise confidence calibration method. It estimates a spatially adaptive temperature field conditioned on a modality-availability learnable token and a voxel-wise difficulty score. Experiments on BraTS 2020 and FeTS 2024 show that MMA-LTS improves calibration while preserving the segmentation accuracy of state-of-the-art models across diverse missing-modality scenarios, thereby enhancing trustworthiness toward clinical deployment.

Momentum

Related topics

Latest papers 107