Overview

Multimodal classification studies how to combine different kinds of evidence—for example, medical images with clinical records, or meme images with text—to predict categories. Common approaches include feature or decision fusion, cross-attention and contrastive alignment, mixture-of-experts models, and large vision-language models; benchmarks range from medical diagnosis and sentiment analysis to document, time-series, and content moderation tasks. Current work also addresses missing or unreliable inputs through modality dropout, imputation, adaptive routing, and selective acquisition, while evaluating fairness, calibration, and interpretability. A central tension is that adding a modality can improve predictions when it contributes complementary information, but can also hurt when it is noisy, redundant, or unavailable at deployment.

Latest papers

CardsList

212 papers17 papers in the last four weeks, down 29% on the four weeks before. 0.1% of all new papers.

  1. PADSNet: Physics-Aware Dual-Stream Network with Biomechanical Priors for Laryngeal Lesion Classification

    Nov 13, 2026Zhenzhen You, Weifeng Yu, Zhenghao Shi +7Medical Image ClassificationPhysics-Informed ML

  2. A Tumour-Aware Multimodal Framework for Explainable Prediction of IDH Mutation in Gliomas from Multi-Sequence MRI

    Nov 13, 2026Tahsien Al-Quraishi, Waseem Alwan Zaboon, O. S. Albahri +1Clinical PredictionBrain Tumor Classification

  3. A Unified Interpretable Semantic Framework for Multi-Modal Fiber Sensing Under Data Scarcity

    Nov 11, 2026Khouloud AbdelliMultimodal Sensor FusionMultimodal Classification

  4. MouldIt: Data Efficiency of Multi-Task Temporal Representation Learning in Injection Moulding

    Nov 10, 2026Abdullah AyadTemporal Representation LearningManufacturing

  5. Guided Co-Attention with Adaptive Gating for Multimodal Medical Data Fusion

    Nov 7, 2026Muntaqim Ahmed Raju, Priyanka Siddappa, Md Shifat Haider Al Amin +2Multimodal FusionGated Multimodal Fusion

  6. Evaluating classification and explainability in multimodal petrographic image analysis

    Nov 7, 2026Thomas James Wood, Oktay Karakuş, Can EyüpoğluMultimodal ClassificationExplainable Image Classification

  7. Leakage- and Label-Aware Benchmarking of Class-Imbalance Strategies for Multimodal Chest X-Ray and EHR Classification

    Nov 5, 2026Dang-Khoa Bui, Quang-Huy Tran, Minh-Khoi Nguyen-Bui +4Medical Image BenchmarksData Leakage

  8. Shared-Pattern Collaborative Network for Multi-Source Remote Sensing Data Classification

    Nov 2, 2026Chenfang Yang, Chuanzheng Gong, Feng Gao +2Remote SensingMultimodal Classification

  9. Stage-aware Multimodal Brain Graph Contrastive Learning for Neurodegenerative Disorder Diagnosis

    Nov 2, 2026Jingjing Zhou, Chenxuan Meng, Ciyuan Peng +2Medical DiagnosisMultimodal Graph Learning

  10. Multimodal BVP and Respiration for Automated Pain Recognition with Hankel-FCN

    Nov 1, 2026Valentina Becchetti, Muhammad Umar Khan, Stefanos Gkikas +2Multimodal ClassificationMultimodal Sensor Fusion

  11. Parameter-Efficient Fine-Tuning of Transformer Encoders for Audio-Image-Symbolic Music Retrieval

    Oct 30, 2026Eliseo Fuentes-Martinez, Antonio Hidalgo-Centeno, Jorge Calvo-Zaragoza +1Multimodal IRParameter-Efficient Fine-Tuning

  12. Seeing Is Not Enough: Knowledge-Grounded Active Inquiry from Uncertain Visual Evidence

    Oct 28, 2026Yucheng Liu, Everett X. WangMultimodal ClassificationClinical Decision-Making

  13. Explainable Multimodal AI Approach to Reduce Unnecessary Breast Biopsies

    Oct 26, 2026Sadam Hussain, Mansoor Ali, Daly Betzabeth Avendaño-Avalos +1Breast CancerRadiology VLMs

  14. CRANE: Post-Hoc Counterfactual Retrieval for Multimodal Classifiers

    Oct 22, 2026Franco Rugolon, Ioanna Miliou, Panagiotis PapapetrouCounterfactual ExplanationsMultimodal Model Interpretability

  15. GAMF-Net: Grouped Availability-Aware Multimodal Fusion for Smartphone Skin Lesion Classification

    Oct 20, 2026Yue Zhuo, Jingjia Yan, Fangyu Liu +4Skin Lesion ClassificationMultimodal Classification

  16. HypTI: Hyperbolic Geometry-Aware Multimodal Feature Fusion Framework for Dementia Detection Based on Tabular-Image Data

    Oct 20, 2026Jianfei Xu, Huizhi Liang, Judith Harrison +3Multimodal FusionMultimodal Classification

  17. Joint, Decoupled, or Agent: When Each Multimodal Alignment Paradigm Wins

    Oct 16, 2026Yi Fang, Gaurav Srivastava, Sirui Ding +1Multimodal FusionMultimodal Model Evaluation

  18. Task-Centric Multimodal Learning for Cognitive Impairment Detection

    Oct 14, 2026Sankalp Vaish, Rishank Singh, Sumukh Veeramalla +3Multimodal LearningSpeech-Based Dementia Detection

  19. Single-Pass Decision Scores Enable Rapid Classification with Adjustable Thresholds in Medical Multimodal Large Language Models

    Oct 14, 2026Patrick Wienholt, Frederik Hauke, Christiane Kuhl +3Medical LLMsMultimodal Classification

  20. Towards Modality-Agnostic Seizure Classification: A Unified Deep Learning Framework for Heterogeneous EEG and Intracranial EEG Signals

    Oct 12, 2026Ramya Sundaram, Muhammad Aslam Jarwar, M Uma +2EEG Seizure DetectionMultimodal Classification

  21. Siam-ALS: An Explainable Siamese Deep Learning Framework for Early ALS Detection Using EEG and Eye-Tracking Signals

    Oct 11, 2026Abdur Rahman, A. A. M. Muzahid, Istiak Ahmed +4Clinical PredictionMultimodal Classification

  22. Can Multimodal Decision Models Classify Breast Ultrasound Images? Benchmarking CLEF and CLEF-Flash Across Prompts and Datasets

    Oct 9, 2026Tran Cao Minh, Hai Tran, Ha Minh TanMedical Image ClassificationMultimodal Classification

  23. Learning What to Trust in Multimodal Learning under Noisy Supervision

    Oct 8, 2026Jiashuo Zou, Xiaobo XiaLearning with Noisy LabelsMultimodal Classification

  24. RSJEV: Discriminative Remote Sensing Scene Classification with Multimodal Large Language Models

    Oct 6, 2026Dongchen Si, Di Wang, Mingzhen Xu +3Remote Sensing Image UnderstandingEfficient Multimodal Inference

  25. Efficient Multimodal Inference through Adaptive Acquisition and Sequential Fusion

    Oct 5, 2026Payal Mohapatra, Haodong Yang, Yueyuan Sui +3Efficient Multimodal InferenceMultimodal Classification

  26. Anatomy-aware Fine-grained Multimodal Fusion for Laryngopharyngeal Cancer T-Staging Prediction Using CT and Radiology Report

    Oct 5, 2026Xingyue Zhao, Yanzhou Su, Fang Zhang +12Radiology VLMsMultimodal Classification

  27. ASD-FEAT: A Multi-Modal Infant Video-Derived Dataset for Early ASD Risk Prediction

    Oct 2, 2026Sidrah Liaqat, Halil Helvaci, Sen-Ching Cheung +4Autism Spectrum DisorderMultimodal Classification