Multimodal KGs

KG: Knowledge Graph

Overview

Multimodal knowledge graphs represent entities and their relationships alongside evidence such as text, images, video, and timestamps, enabling reasoning across different kinds of data. Representation learning methods—including graph embeddings, contrastive alignment, and graph neural networks—support tasks such as link prediction, entity alignment, and completion, while graph construction and retrieval-augmented generation connect these methods to question answering and domain applications. Evaluation spans link-prediction benchmarks and multimodal question-answering settings in areas such as biomedicine, e-commerce, and personal data. A central challenge is making retrieved evidence reliable when modalities are missing, noisy, or ambiguous, and measuring whether retrieval quality actually improves grounded reasoning.

Latest papers

CardsList

42 papers6 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. GEMS-RAG: Graph-grounded Engineering Multimodal Standards Retrieval-Augmented Generation

    Oct 23, 2026Abdul Hannan Azad, Irvin Wang, Jiwan Jiang +6Multimodal RAGRetrieval-Augmented Generation

  2. MMKG-R1: Constructing Multimodal Knowledge Graphs via Reinforcement Learning

    Oct 14, 2026Zongyu Wu, Yilong Wang, Xiaochen Wang +5KG ConstructionMultimodal KGs

  3. KARAMEL: Knowledge-Aware Ranking for Multimodal Entity Linking in the Arts via Heterogeneous Graphs

    Oct 12, 2026Raffaele Scaringi, Alejandro Sierra-Múnera, Gennaro Vessio +2Cultural HeritageMultimodal KGs

  4. Silence and Noise: Resolving Suppression and Overvaluation in Multimodal Entity Alignment

    Oct 12, 2026Xizhe Zhang, Jingfeng Zhang, Meng-Fen ChiangCross-Modal AlignmentMultimodal KGs

  5. Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs

    Oct 5, 2026Jiawen Du, Arshan Ali Khan, Chenhao Zhang +7KG ConstructionGraph-Based Retrieval

  6. GeoOutageBench: Benchmarking Ambiguity-aware, Ontology-grounded Geospatiotemporal KGQA for Multimodal Power Outage and Resilience Analysis

    Sep 28, 2026Ethan D. Frakes, Amy Kvien, Rishabh Kundu +8Knowledge Graph Question AnsweringMultimodal KGs

  7. ExpArt-KG: Artwork Image Description Generation through Iterative Exploration of Knowledge Graphs

    Sep 1, 2026Yuta Kato, Shintaro Ozaki, Kazuki Hayashi +4Retrieval-Augmented GenerationImage Captioning

  8. More Perspectives, Stronger Signals: Multi-Perspective Enhancement and Progressive Fusion for Multimodal Entity Representation Learning

    Aug 29, 2026Chenyi Xiong, Yan Zhang, Jing Hu +5Multimodal LearningMultimodal KGs

  9. Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs

    Aug 26, 2026Zongyu Wu, Yilong Wang, Xiaochen Wang +5Multimodal RAGGraph Retrieval-Augmented Generation

  10. GraphLoom: Reliability-Calibrated Graph Evidence Routing for Multimodal KG-RAG

    Aug 15, 2026Zafar Ali, Asad Khan, Aalia Malik +1Multimodal RAGGraph Retrieval-Augmented Generation

  11. ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

    Aug 6, 2026Jiafan Li, Mengxue Yang, Jiaqi Zhu +3VLM ReasoningMultimodal KGs

  12. Evidence-Grounded Multimodal Knowledge Graph Construction for Multi-Lecture Educational Reasoning

    Aug 4, 2026Sahil Al Farib, Momota Ahsana Meem, Sheikh Redwanul Islam +1KG ConstructionMultimodal KGs

  13. BEST-KAG: Enhancing Question Answering of Building Engineering Standards with Multimodal Knowledge Graph Modeling and Large Language Model

    Aug 2, 2026Jia-Rui Lin, Junxi Guo, Keyin Chen +1Document UnderstandingKG Construction

  14. Dual-Path LLM Reasoning for Multimodal Few-Shot Knowledge Graph Completion

    Jul 29, 2026Jinlan Liu, Zhiying Tu, Yongchao Xing +5Multimodal Graph LearningMultimodal KGs

  15. MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion

    Jul 17, 2026Xu Hou, Meiyu Liang, Wei Huang +6Multimodal KGsKG Completion

  16. EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval

    Jul 14, 2026Jiashi Lin, Changhong Jiang, Xiangru Lin +12Multimodal RAGGraph Retrieval-Augmented Generation

  17. Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs

    Jul 8, 2026Pengyu Zhang, Klim Zaporojets, Congfeng Cao +2Multimodal Graph LearningMultimodal Contrastive Learning

  18. Multimodal Graph RAG for Long-range Visually Rich Document Understanding

    Jun 27, 2026Yi-Cheng Wang, Chu-Song ChenMultimodal RAGVisual Question Answering

  19. MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation

    Jun 24, 2026Xiaochen Wang, Bao Hoang, Han Liu +2Multimodal RAGRetrieval-Augmented Generation

  20. Multimodal Cultural Heritage Knowledge Graph Extension with Language and Vision Models

    May 17, 2026Yang Zhang, Nada Mimouni, Jean-Claude Moissinac +1KG ConstructionCultural Heritage

  21. CMKL: Modality-Aware Continual Learning for Evolving Biomedical Knowledge Graphs

    May 11, 2026Yousef A. Radwan, Yao Li, Qing Qing +5Continual LearningKG Embedding

  22. MicroWorld: Empowering Multimodal Large Language Models to Bridge the Microscopic Domain Gap with Multimodal Attributed Property Graph

    May 11, 2026Manyu Li, Ruian He, Chenxi Ma +2Multimodal RAGVisual Question Answering

  23. HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities

    May 10, 2026Shusaku Egami, Aoi Ohta, Tomoki Tsujimura +5Multi-Hop QASpatiotemporal Reasoning

  24. Unifying biomedical knowledge in a modern multimodal graph

    Apr 29, 2026Lucas Vittor, Ayush Noori, Iñaki Arango +5KG ConstructionMultimodal KGs

  25. RADD: Retrieval-Anchored Discrete Diffusion for Multi-Modal Knowledge Graph Completion

    Apr 28, 2026Guanglin Niu, Bo LiKG EmbeddingMultimodal KGs

  26. Graph-to-Frame RAG: Visual-Space Knowledge Fusion for Training-Free and Auditable Video Reasoning

    Apr 6, 2026Songyuan Yang, Weijiang Yu, Ziyu Liu +4Video ReasoningRetrieval-Augmented Generation

  27. MG2^2-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation

    Apr 4, 2026Sijun Dai, Qiang Huang, Xiaoxing You +1Cross-Modal LearningMultimodal RAG

  28. When Modalities Remember: Continual Learning for Multimodal Knowledge Graphs

    Apr 3, 2026Linyu Li, Zhi Jin, Yichi Zhang +5Multimodal KGsContinual Learning

  29. DyMRL: Dynamic Multispace Representation Learning for Multimodal Event Forecasting in Knowledge Graph

    Mar 25, 2026Feng Zhao, Kangzheng Liu, Teng Peng +2Multimodal KGsTemporal KGs