cs.LGOct 3, 2026

Uncertainty in Representation Learning on Knowledge Graphs

Authors: Yuqicheng Zhu

Abstract

Knowledge graph embedding (KGE) methods represent entities and predicates in continuous vector spaces to infer missing knowledge. Despite strong benchmark performance, their predictions often lack principled reliability guarantees, limiting their use in high-stakes applications. Moreover, uncertainty arises throughout the KGE pipeline, from incomplete or probabilistic input knowledge to stochastic training and prediction. This thesis systematically investigates three sources of uncertainty in KGE: knowledge uncertainty, arising from incomplete, noisy, or probabilistic input knowledge; algorithmic uncertainty, induced by randomness in model training; and predictive uncertainty, concerning the reliability of model outputs. To address algorithmic uncertainty, the thesis demonstrates that models trained under identical settings can produce substantially different predictions and introduces a voting-based aggregation framework to mitigate this instability. To quantify predictive uncertainty, it adapts conformal prediction to KGE, constructing answer sets with distribution-free coverage guarantees and extending them to provide predicate-conditional reliability guarantees. To support reasoning under knowledge uncertainty, it develops statistically valid prediction intervals for confidence-scored triples and an embedding-based approach to approximate probabilistic reasoning over statistical ontologies with formal soundness guarantees. Together, these complementary, model-agnostic methods provide a practical and theoretically grounded approach to uncertainty in KGE, advancing beyond predictive accuracy toward reliable and uncertainty-aware knowledge graph reasoning.

Explore similar work

CardsList
  1. Scalable Uncertainty Reasoning in Knowledge Graphs

    May 15, 2026Jingcheng WuProbabilistic CircuitsUncertainty Quantification

  2. Pattern Over-Generalization of Knowledge Graph Embedding

    Sep 3, 2026Junsik Kim, Kangil KimLink PredictionKG Embedding

  3. Link Prediction or Perdition: the Seeds of Instability in Knowledge Graph Embeddings

    Jun 2, 2026Guillaume Méroué, Fabien Gandon, Pierre MonninLink PredictionKG Embedding