Multimodal Graph Learning

Ask about this topic

Overview

Multimodal Graph Learning studies how to use relationships between entities alongside their text, images, sensor readings, or other features. Common approaches use graph neural networks, attention, contrastive alignment, and learned graph structures, while hypergraphs model relationships among several entities or modalities at once. Vision-language models and large language models are also being adapted to graph tasks, including recommendation, biomedical prediction, and social-media analysis. A central challenge is balancing shared cross-modal information against useful modality-specific signals, especially when graph connections are noisy, modalities are missing, or message passing spreads errors.

Latest papers

CardsList

110 papers12 papers in the last four weeks, up 20% on the four weeks before. 0.1% of all new papers.

  1. Quantum-Classical Link Prediction on Dark Web Hyperlink Graphs

    Oct 23, 2026Vojtěch Novák, Radovan Rečka, Ondřej Knebl +2Link PredictionHybrid Quantum-Classical ML

    Department of Computer Science, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Ostrava, Czech Republic. · IT4Innovations National Supercomputing Center, VSB-Technical University of Ostrava, Ostrava, 708 00, Czech Republic. · Department of Informatics and Statistics, Marine Research Institute, Klaipeda University, Klaipeda, Lithuania.

  2. DIGOM: Disentangled Interaction Graphs for Outcome prediction in Multimodal healthcare

    Oct 23, 2026Hakima Laribi, Olivier Lefebvre, Dan Poenaru +1Clinical Outcome PredictionMultimodal Graph Learning

    Department of Computer Science, Université de Sherbrooke, 2500 Boulevard de l’Université, Sherbrooke, Québec, J1K 2R1, Canada · Department of Pediatric Surgery, Montreal Children’s Hospital, 1001 Boulevard Décarie, Montreal, Québec, H4A 3J1, Canada · Centre for Outcomes Research and Evaluation (CORE), Research Institute of the McGill University Health Centre, 5252 Boulevard de Maisonneuve Ouest, Montreal, Québec, H4A 3S5, Canada +1

  3. Beyond Phenotypic Similarity: Relation Refinement and Selective Population Graph Learning for Multimodal Brain Disorder Diagnosis

    Oct 22, 2026Yinyu LanBrain Disorder ClassificationMultimodal Graph Learning

    School of Medicine and Health, Harbin Institute of Technology, Harbin 150001, China

  4. Escaping the Phylogenetic Trap: Persistent Homology Enables Cross-Species Ion Channel Classification via Multimodal Graph Neural Networks

    Oct 21, 2026Arezoo Bybordi, Favour Achimba, Mariam Gelashvili +4OOD GeneralizationProtein Representation Learning

    The Graduate Center, City University of New York · Hunter College, City University of New York · Tandon School of Engineering, New York University +3

  5. HGASurv: Hierarchical Granularity-Aware Multimodal Integration for Survival Prediction

    Oct 19, 2026Peike Yu, Wuchao Liu, Jihong Guan +1Multimodal Survival AnalysisCancer Survival Prediction

    School of Computer Science and Technology, Tongji University, 1239 Siping Road, Shanghai 200092, China · College of Computer Science and Artificial Intelligence, Fudan University, 2005 Songhu Road, Shanghai 200438, China

  6. Multimodal Decoupling for Diversified Recommendation through Semantic and Structural Shaping

    Oct 19, 2026Changran He, Jiaming Wei, Jianghong Ma +3Recommender SystemsMultimodal Recommendation

    Harbin Institute of Technology(Shenzhen) Shenzhen, China · Shenzhen Key Laboratory of Internet Information Collaboration Shenzhen, China · Shenzhen Research Institute, City University of Hong Kong Shenzhen, China +1

  7. STC-MGNet: Spatial-Temporal-Channel Attention-Enhanced Multimodal Graph Network for Pedestrian Intention Prediction

    Oct 16, 2026Yuanzhe Li, Meng WangPedestrian Intention PredictionSpatiotemporal GNNs

    Chair of Automotive Engineering, Technische Universität Berlin, Berlin, Germany

  8. Multi-Modal Graph Neural Network-Inspired Vessel Identification and Tracking for UAV-Based Maritime Surveillance

    Oct 9, 2026Chenjie Zhao, Jiangtian Nie, Jiawen Kang +2Maritime SurveillanceMulti-Object Tracking

    Sanya Science and Education Innovation Park of Wuhan University of Technology, Sanya 572025, China · School of Navigation, Wuhan University of Technology, Wuhan 430063, China · School of Natural and Computing Sciences, University of Aberdeen, Aberdeen AB24 3UE, U.K. +2

  9. Evi-VN: Hard Region Guided Virtual Node Evidence Injection for GNN-Based Fraud Detection

    Oct 8, 2026Jiran Tao, Yifan Wu, Binyan JiangGraph Neural NetworksFinancial Fraud Detection

    The Hong Kong Polytechnic University

  10. Toward Omni Multimodal Graph Foundation Model: A Topology-Driven Binding Approach

    Oct 2, 2026Xunkai Li, Chenxi Wan, Yinlin Zhu +4Graph Foundation ModelsMultimodal Graph Learning

    Beijing Institute of Technology · Sun Yat-sen University

  11. No-Free-Graph: Learning When Multimodal Data Should Be Graphified

    Oct 2, 2026Zekai Chen, Kai Hu, YuXin Zeng +6Multimodal Graph LearningGraph Structure Learning

    Beijing Institute of Technology · Sun Yat-sen University · Shandong University

  12. RAEGNet: Relation-Aware Evidence Graph Network for Harm-Aware Multimodal Fake News Detection

    Sep 29, 2026Wenbin Shen, Guoxuan Qin, Guangxu Yao +4Fake News DetectionMultimodal Graph Learning

    Nanjing University of Science and Technology · Zhejiang University · University of Chinese Academy of Sciences

  13. GraphSelect for Budgeted Representation Selection in Multimodal Graph Inference

    Sep 27, 2026Xu Wang, Xunkai Li, Yinlin Zhu +1Efficient Multimodal InferenceMultimodal Classification

    School of Airspace Science and Engineering, Shandong University, Weihai, China · Department of Computer Science, Beijing Institute of Technology, Beijing, China · School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China

  14. ICE: Task-Aligned Clifford Latent Fields for Multimodal Graph Foundation Models

    Sep 24, 2026Xunkai Li, Xu Wang, Yinlin Zhu +4Graph Foundation ModelsMultimodal Graph Learning

    Department of Computer Science, Beijing Institute of Technology, Beijing, China · School of Airspace Science and Engineering, Shandong University, WeiHai, China · School of Computer Science and Engineering, Sun Yat-sen University, GuangZhou, China

  15. MOVE: Multimodal Open-world Verification and Expansion for Graph Learning

    Sep 24, 2026Zekai Chen, Jiayang Xing, Xun Wu +7Multimodal Graph LearningNode Classification

    Beijing Institute of Technology · Shandong University

  16. SMILESGNN: Interpretable Clinical Toxicity Prediction via SMILES-Graph Cross-Attention Fusion

    Sep 23, 2026Quang Minh Nguyen, Thuy Quynh Nguyen, Duc Minh Le +3Toxicity DetectionMolecular Property Prediction

    National Economics University Hanoi, Vietnam · VNU University of Science Hanoi, Vietnam

  17. M2G-LLM: Enhancing Clinical Prediction via Multimodal Graph Reasoning and LLM Context Injection

    Sep 18, 2026Inyoung Choi, Sukwon Yun, Jiayi Xin +3Multimodal Large Language ModelsClinical Prediction

    University of Pennsylvania, Philadelphia, PA, USA · University of North Carolina at Chapel Hill, Chapel Hill, NC, USA

  18. Robust and Efficient AI Frameworks for Scalable Material Design and Property Prediction

    Sep 15, 2026Kishalay DasGraph SSLMaterials Property Prediction

  19. Graph-Transformer Fraud Detection with Self-Supervised Pretraining and Conformal Risk Control

    Sep 13, 2026Sergei, KomarovFinancial Fraud DetectionGraph Transformer

    JP Morgan New York, USA

  20. Towards Unified Multimodal Graph Foundation Model: A Bridge-Router-Adapter Based Approach

    Sep 6, 2026Sirui Zhang, Yubing Zhou, Xunkai Li +6Graph Foundation ModelsMultimodal Graph Learning

    Beijing Institute of Technology Beijing, China

  21. MURAL: Multimodal Uncertainty-aware Recommendation via Adaptive edge Learning

    Sep 4, 2026Ahmad Mousavi, Majid Alikhani, Yeon-Chang Lee +2Multimodal RecommendationMultimodal Graph Learning

    Department of Mathematics and Statistics American University · Independent Researcher Toronto, Ontario, Canada · Independent Researcher +4

  22. When Vision Meets Graphs: A Survey on Graph Reasoning and Learning

    Sep 3, 2026Xinjian Zhao, Wei Pang, Zhixuan Yu +8Visual ReasoningMultimodal Graph Learning

    The Chinese University of Hong Kong, Shenzhen · University of Waterloo · Institute of Automation, Chinese Academy of Sciences +1

  23. CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation

    Aug 29, 2026Yuxiang Xiao, Xibei Chen, Xin Zhou +3Embodied NavigationVision-Language Navigation

    Department of Mechanical Engineering, National University of Singapore, Singapore

  24. LION: A Clifford Neural Paradigm for Multimodal-Attributed Graph Learning

    Aug 25, 2026Xunkai Li, Zekai Chen, Zhengyu Wu +6Multimodal Graph LearningMultimodal Fusion

    Beijing Institute of Technology, Beijing, China · Ant Group, Hangzhou, China

  25. ReCoG: Reciprocal Co-Evolution for Multimodal Graph Learning

    Aug 24, 2026Rui Xue, Tianfu WuMultimodal Graph LearningGraph Structure Learning

    Department of Electrical and Computer Engineering (ECE) North Carolina State University, Raleigh, NC 27695, USA

  26. Text-Guided Visual Dependency Graph Learning with Cross-Modal Attention Priors

    Aug 19, 2026Fei Wang, Yutong Zhang, Yang Ye +3Multimodal Graph LearningProbabilistic Graphical Models

    Stony Brook University, USA · Sichuan University, China · Universiti Sains Malaysia, Malaysia +1

  27. Hypergraph-based Multimodal Retrieval-Augmented Generation with Incremental Refinement

    Aug 17, 2026Shenao Chen, Yidan Xu, Xiangmin Han +5Multimodal RAGMultimodal IR

    Hangzhou Dianzi University Hangzhou, China · Beijing University of Technology Beijing, China · Xi’an Jiaotong University Xi’an, China +1

  28. POI Recommendation with LLM-Augmented Multi-Graph Learning and Contrastive Alignment

    Aug 17, 2026Burak Tamer, Wolfram Höpken, Zehui Wang +1Recommender SystemsMultimodal Graph Learning

    Institute for Digital Transformation - University of Applied Sciences Ravensburg-Weingarten, Germany

  29. EvtGraph: Event-Adaptive Compression for Sparse Temporal Graph Learning in Multimodal Time Series

    Aug 5, 2026Ziqian Wang, Tingxiong Xiao, Yuxiao Cheng +1Irregular Time-Series ModelingEfficient Multimodal Inference

    Department of Automation Tsinghua University Beijing, China

  30. PatTree: a novel approach for automated creation of multimodal, graph-based patient representations for medical classification tasks

    Aug 3, 2026Julia Gehrmann, Lars Quakulinski, Hamza Naseem +1Multimodal ClassificationAlzheimer's Disease Classification

    Institute for Biomedical Informatics, University of Cologne, Medical Faculty and University Hospital Cologne, Kerpener Straße 62, Cologne, 50937, Germany · Division of Computer Science, Department of Mathematics and Computer Science, Faculty of Mathematics and Natural Sciences, University of Cologne, Albertus-Magnus-Platz, Cologne, 50923, Germany · Department of Data Science and Artificial Intelligence, Fraunhofer Institute for Applied Information Technology, Schloss Birlinghoven, Sankt Augustin, 53757, Germany