cs.LGMay 28, 2025

B-XAIC Dataset: Benchmarking Explainable AI for Graph Neural Networks Using Chemical Data

Authors: Magdalena Proszewska, Tomasz Danel, Antoni Antoszek, Dawid Rymarczyk

Organizations: University of Edinburgh · Jagiellonian University, Faculty of Mathematics and Computer Science · Jagiellonian University, Faculty of Chemistry · Ardigen SA

Abstract

Understanding the reasoning behind deep learning model predictions is crucial in cheminformatics and drug discovery, where molecular design determines their properties. However, current evaluation frameworks for Explainable AI (XAI) in this domain often rely on artificial datasets or simplified tasks, employing data-derived metrics that fail to capture the complexity of real-world scenarios and lack a direct link to explanation faithfulness. To address this, we introduce B-XAIC, a novel benchmark constructed from real-world molecular data and diverse tasks with known ground-truth rationales for assigned labels. Through a comprehensive evaluation using B-XAIC, we reveal limitations of existing XAI methods for Graph Neural Networks (GNNs) in the molecular domain. This benchmark provides a valuable resource for gaining deeper insights into the faithfulness of XAI, facilitating the development of more reliable and interpretable models.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. WOMBAT: Whitebox Oracle for Molecular Benchmarking and Attribution Testing

    Sep 30, 2026Dominik Matuszek, Bartosz Zieliński, Tomasz Danel +1Gradient-Based AttributionExplainability Evaluation

  2. Measuring What Matters: A Unified Evaluation Framework for GNN Explainability

    Jul 6, 2026Francesco Paolo Nerini, Mirko Zaffaroni, Paolo Baracco +2Explainability EvaluationGNN Explainability

  3. Chem World: A Large-Scale Benchmark and Physics-Informed Framework for Trustworthy Chemical Property Prediction

    Jul 30, 2026Tianyou Bai, Huan Wang, Mingchen Gao +4Computational Quantum ChemistryPhysics-Informed ML