Multimodal KGs

KG: Knowledge Graph

Overview

Multimodal knowledge graphs represent entities and their relationships alongside evidence such as text, images, video, and timestamps, enabling reasoning across different kinds of data. Representation learning methods—including graph embeddings, contrastive alignment, and graph neural networks—support tasks such as link prediction, entity alignment, and completion, while graph construction and retrieval-augmented generation connect these methods to question answering and domain applications. Evaluation spans link-prediction benchmarks and multimodal question-answering settings in areas such as biomedicine, e-commerce, and personal data. A central challenge is making retrieved evidence reliable when modalities are missing, noisy, or ambiguous, and measuring whether retrieval quality actually improves grounded reasoning.

Latest papers

CardsList

42 papers6 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. Are a Thousand Words Better Than a Single Picture? Beyond Images -- A Framework for Multi-Modal Knowledge Graph Dataset Enrichment

    Mar 17, 2026Pengyu Zhang, Klim Zaporojets, Jie Liu +2Multimodal KGsKG Completion

  2. The EpisTwin: A Knowledge Graph-Grounded Neuro-Symbolic Architecture for Personal AI

    Mar 6, 2026Giovanni Servedio, Potito Aghilar, Alessio Mattiace +6Personal AI AgentsNeuro-Symbolic Reasoning

  3. VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddings

    Mar 2, 2026Athanasios Efthymiou, Stevan Rudinac, Monika Kackovic +2KG EmbeddingMultimodal KGs

  4. NICO-RAG: Multimodal Hypergraph Retrieval-Augmented Generation for Understanding the Nicotine Public Health Crisis

    Mar 2, 2026Manuel Serna-Aguilera, Raegan Anderes, Page Dobbs +1Hypergraph-Based RAGMultimodal RAG

  5. MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning

    Mar 1, 2026Eileen Wang, Hiba Arnaout, Dhita Pratama +6Commonsense ReasoningVisual Storytelling

  6. Enhancing Vision-Language Navigation with Multimodal Event Knowledge from Real-World Indoor Tour Videos

    Feb 27, 2026Haoxuan Xu, Tianfu Li, Wenbo Chen +4Vision-Language NavigationMultimodal KGs

  7. PSQE: A Theoretical-Practical Approach to Pseudo Seed Quality Enhancement for Unsupervised Multimodal Entity Alignment

    Feb 26, 2026Yunpeng Hong, Chenyang Bu, Jie Zhang +3Cross-Modal AlignmentPseudo-Labeling

  8. Hyper-modal Imputation Diffusion Embedding with Dual-Distillation for Federated Multimodal Knowledge Graph Completion

    Jun 27, 2025Ying Zhang, Yu Zhao, Xuhui Sui +5Multimodal Federated LearningMissing-Modality Learning

  9. MEDMKG: Benchmarking Medical Knowledge Exploitation with Multimodal Knowledge Graph

    May 22, 2025Xiaochen Wang, Yuan Zhong, Lingwei Zhang +3Multimodal KGsBiomedical KGs