Multimodal Graph Learning

Ask about this topic

Overview

Multimodal Graph Learning studies how to use relationships between entities alongside their text, images, sensor readings, or other features. Common approaches use graph neural networks, attention, contrastive alignment, and learned graph structures, while hypergraphs model relationships among several entities or modalities at once. Vision-language models and large language models are also being adapted to graph tasks, including recommendation, biomedical prediction, and social-media analysis. A central challenge is balancing shared cross-modal information against useful modality-specific signals, especially when graph connections are noisy, modalities are missing, or message passing spreads errors.

Latest papers

CardsList

110 papers12 papers in the last four weeks, up 20% on the four weeks before. 0.1% of all new papers.

  1. Multi-Modal Graph Neural Network with Transformer-Guided Adaptive Diffusion for Preclinical Alzheimer Classification

    Jun 2, 2026Jaeyoon Sim, Minjae Lee, Guorong Wu +1Graph Neural NetworksAlzheimer's Disease Classification

    Pohang University of Science and Technology, Pohang, South Korea · University of North Carolina at Chapel Hill, Chapel Hill, USA

  2. Advanced Mathematics Learning Behavior Prediction and Academic Early Warning Model Based on Multimodal Data Analysis

    May 31, 2026Liu Qiong, Li ZhengboEducational AssessmentAI in Education

    Moutai Institute,, Renhuai, 564507, Guizhou, China

  3. UniRTL: Unifying Code and Graph for Robust RTL Representation Learning

    May 29, 2026Yi Liu, Hongji Zhang, Lei Chen +2Representation LearningCross-Modal Representation Learning

    Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR · Noah’s Ark Lab, Huawei, Hong Kong SAR

  4. OOD-GraphLLM: Graph Large Language Model for Out-of-Distribution Generalized Drug Synergy Prediction

    May 28, 2026Xin Wang, Linxin Xiao, Yang Yao +1OOD GeneralizationMultimodal Graph Learning

    DCST, BNRist, Tsinghua University · Beijing, China · DCST, Tsinghua University

  5. Beyond the Aggregation Dilemma: Prior-Retaining Decoupled Learning for Multimodal Graphs

    May 23, 2026Hao Yan, Xuanru Wang, Jun Yin +3Graph Neural NetworksMultimodal Graph Learning

    School of Computer Science and Engineering, Central South University, Changsha, China · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hong Kong SAR, China · School of Information and Communication Technology, Griffith University, Brisbane, Australia

  6. Case-Aware Medical Image Classification with Multimodal Knowledge Graphs and Reliability-Guided Refinement

    May 21, 2026Yiming Xu, Yixuan Liu, Yuhang Zhang +3Case-Based ReasoningMedical Image Classification

    University of Science and Technology of China · Hefei, China

  7. CatalyticMLLM: A Graph-Text Multimodal Large Language Model for Catalytic Materials

    May 17, 2026Yanjie Li, Jian Xu, Xu-Yao Zhang +4Multimodal Large Language ModelsMaterials Property Prediction

    AnnLab, Institute of Semiconductors, Chinese Academy of Sciences, Beijing, China. · Zhongguancun Academy, Zhongguancun Academy, Beijing, China. · School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China. +3

  8. TopoEvo: A Topology-Aware Self-Evolving Multi-Agent Framework for Root Cause Analysis in Microservices

    May 15, 2026Junle Wang, Xingchuang Liao, Wenjun WuSoftware EngineeringMulti-Agent Orchestration

    School of Artificial Intelligence, Beihang University Beijing, China

  9. Multimodal Graph-based Classification of Esophageal Motility Disorders

    May 13, 2026Alexander Geiger, Lars Wagner, Daniel Rueckert +3Multimodal Graph LearningMultimodal Fusion

    Technical University of Munich, School of Medicine and Health, TUM University Hospital Rechts der Isar, Research Group MITI, Munich, Germany. · Technical University of Munich, School of Computation, Information and Technology, Chair for AI in Healthcare and Medicine, Munich, Germany. · Imperial College London, Department of Computing, London, UK. +2

  10. Supervised Deep Multimodal Matrix Factorization for Interpretable Brain Network Analysis

    May 13, 2026Amjad Seyedi, Lifang He, Songlin Zhao +2Neural Network InterpretabilityMultimodal Graph Learning

    Dept. of Mathematics & Operational Research University of Mons, Mons, Belgium · Dept. of Computer Science & Engineering Lehigh University, Bethlehem, PA, USA · Dept. of Industrial & Systems Engineering Lehigh University, Bethlehem, PA, USA

  11. Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity

    May 12, 2026Sirui Zhang, Haonan Wang, Xunkai Li +5Multimodal Federated LearningMissing-Modality Learning

    Beijing Institute of Technology

  12. STAGE: Tackling Semantic Drift in Multimodal Federated Graph Learning

    May 12, 2026Zekai Chen, Xun Wu, Xunkai Li +3Multimodal Federated LearningCross-Modal Representation Learning

    Beijing Institute of Technology, Beijing, 100081, China · Minzu University of China, Beijing, 100081, China

  13. CAMPA: Efficient and Aligned Multimodal Graph Learning via Decoupled Propagation and Aggregation

    May 12, 2026Daohan Su, Hao Liu, Xunkai Li +6Efficient Multimodal InferenceCross-Modal Alignment

  14. Bridging Sequence and Graph Structure for Epigenetic Age Prediction

    May 11, 2026Yao Li, Xikun Zhang, Xiaotao Shen +4Multimodal Graph Learning

    School of Computing and Information Systems The University of Melbourne · School of Computing Technologies RMIT University · Lee Kong Chian School of Medicine Nanyang Technological University Singapore +1

  15. CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs

    May 11, 2026Yousef A. Radwan, Yao Li, Qing Qing +5Continual LearningKG Embedding

    Technology, Innovation, Entrepreneurship Department King Abdullah University of Science and Technology · School of Computing and Information Systems The University of Melbourne · College of Computer Science and Technology Jilin University +2

  16. Stable Multimodal Graph Unlearning via Feature-Dimension Aware Quantile Selection

    May 5, 2026Jingjing Zhou, Yongshuai Yang, Qing Qing +5Graph UnlearningPrivacy-Preserving ML

    School of Information and Electronic Engineering, Zhejiang Gongshang University, Hangzhou, China · College of Computer Science and Technology, Jilin University, Changchun 130012, China · School of Computing Technologies, RMIT University, Melbourne, VIC 3000, Australia +1

  17. Triple Spectral Fusion for Sensor-based Human Activity Recognition

    May 4, 2026Ye Zhang, Longguang Wang, Qing Gao +3Graph Signal ProcessingHuman Activity Recognition

    School of Electronics and Communication Engineering, the Shenzhen Campus of Sun Yat-sen University, Sun Yat-sen University, Shenzhen 518107, China · Aviation University of Air Force, Changchun 130012, China · College of Computer Science, Chongqing University, Chongqing 400044, China +1

  18. CMGL: Confidence-guided Multi-omics Graph Learning for Cancer Subtype Classification

    Apr 27, 2026Boyang Fan, Hengchuang Yin, Siyu Yi +5OncologyCancer Subtype Classification

    College of Computer Science, Sichuan University, Chengdu, China · Xinjiang Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Urumqi, China · College of Mathematics, Sichuan University, Chengdu, China +1

  19. AROMA: Augmented Reasoning Over a Multimodal Architecture for Virtual Cell Genetic Perturbation Modeling

    Apr 22, 2026Zhenyu Wang, Geyan Ye, Wei Liu +1Multimodal Graph Learning

    AI for Life Sciences Lab, Tencent, Shenzhen, China

  20. SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topology

    Apr 19, 2026Zheng Nie, Ruolin Shen, Xinlei Yu +3Multi-Agent CollaborationDynamic Graph Learning

    National University of Singapore, Singapore · Technical University of Munich, Munich, Germany · Zhejiang University, China

  21. RoleMAG: Learning Neighbor Roles in Multimodal Graphs

    Apr 14, 2026Yilong Zuo, Xunkai Li, Zhihan Zhang +2Multimodal Graph LearningGraph Neural Networks

    Beijing Institute of Technology, Beijing, China

  22. A Dual Cross-Attention Graph Learning Framework For Multimodal MRI-Based Major Depressive Disorder Detection

    Apr 11, 2026Nojod M. Alotaibi, Areej M. AlhothaliDepression DetectionMultimodal Fusion

    Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia

  23. Multimodal Structure Learning: Disentangling Shared and Specific Topology via Cross-Modal Graphical Lasso

    Apr 5, 2026Fei Wang, Yutong Zhang, Xiong WangMultimodal LearningMultimodal Graph Learning

    Department of Applied Mathematics and Statistics, Stony Brook University · School of Mathematics, Sichuan University · School of Computer Science and Technology, USTC

  24. Disentangled Dual-Branch Graph Learning for Conversational Emotion Recognition

    Apr 3, 2026Chengling Guo, Yuntao Shou, Tao Meng +3Emotion Recognition in ConversationsMultimodal Emotion Recognition

    College of Computer and Mathematics, Central South University of Forestry and Technology · Changsha Hospital for Maternal and Child Health Care · Department of Computer Science, State University of New York

  25. BLEG: LLM Functions as Powerful fMRI Graph-Enhancer for Brain Network Analysis

    Apr 1, 2026Rui Dong, Zitong Wang, Jiaxing Li +2Brain Network AnalysisGraph Neural Networks

    School of Computer Science and Engineering, Southeast University

  26. Dynamic Graph Neural Network with Adaptive Features Selection for RGB-D Based Indoor Scene Recognition

    Apr 1, 2026Qiong Liu, Ruofei Xiong, Xingzhen Chen +2Multimodal Graph LearningDynamic Graph Learning

    School of Electronic Information and Communications, Huazhong University of Science and Technology, No. 1037, Luoyu Rd., Wuhan, 430074, P. R. China

  27. Learning Structural-Functional Brain Representations through Multi-Scale Adaptive Graph Attention for Cognitive Insight

    Mar 31, 2026Badhan Mazumder, Sir-Lord Wiafe, Aline Kotoski +2Brain Network AnalysisMultimodal Graph Learning

    Department of Computer Science, Georgia State University · Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University · Neuroscience Institute, Georgia State University

  28. ORACAL: A Robust and Explainable Multimodal Framework for Smart Contract Vulnerability Detection with Causal Graph Enrichment

    Mar 30, 2026Tran Duong Minh Dai, Triet Huynh Minh Le, M. Ali Babar +2Software Vulnerability DetectionMultimodal Graph Learning

    Information Security Lab, University of Information Technology, Ho Chi Minh City, Vietnam · Vietnam National University, Ho Chi Minh City, Vietnam · School of Computer Science and Information Technology, Adelaide University, Adelaide, Australia

  29. TMTE: Effective Multimodal Graph Learning with Task-aware Modality and Topology Co-evolution

    Mar 29, 2026Yinlin Zhu, Xunkai Li, Di Wu +3Multimodal Graph LearningGraph Structure Learning

    Sun Yat-sen University, Guangzhou, China · Beijing Institute of Technology, Beijing, China

  30. Dual-branch Graph Domain Adaptation for Cross-scenario Multi-modal Emotion Recognition

    Mar 27, 2026Yuntao Shou, Jun Zhou, Tao Meng +2Graph Domain AdaptationEmotion Recognition in Conversations

    College of Computer and Mathematics, Central South University of Forestry and Technology · Department of Computer Science, State University of New York