stat.MLSep 27, 2026

HARMONIA: Interpretable Graph Learning through Mixtures of Neural Bases

Authors: Quan D. Bui, Nguyen Do, An Nguyen Dang, Huyen Nguyen, Nhu Duc Minh Nguyen, My T. Thai

Organizations: Center for AI Research, VinUniversity, Hanoi, Vietnam · University of Florida, Gainesville, USA · Posts and Telecommunications Institute of Technology, Hanoi, Vietnam · University of Illinois Chicago, Chicago, USA

Abstract

Existing interpretable graph additive models still face limitations in either computational scalability or modeling flexibility. In terms of structural modeling, previous approaches either face quadratic scaling costs or sacrifice explicit source-to-target contribution decomposition. In terms of feature components, they rely either on per-feature neural networks or on single shared bases with limited feature specialization. We address both problems by introducing HARMONIA: Interpretable Graph Learning through Mixtures of Neural Bases, an interpretable-by-design framework. For feature modeling, HARMONIA introduces a Mixture of Neural Bases (MoNB), which routes features to specialized basis experts, enabling parameter sharing without sacrificing feature-specific specialization. For structural modeling, HARMONIA uses Relative Random Walk Probabilities (RRWP) to capture multi-hop and multi-path relationships, and proposes Sparse RRWP Aggregation (SRA) to compute these interactions through sparse graph propagation without quadratic pairwise complexity. HARMONIA retains a simple additive form in which predictions decompose into feature responses modulated by structural influence. Empirically, HARMONIA achieves stronger explanation recovery than existing interpretable graph baselines while maintaining competitive predictive performance and scaling to graphs with millions of nodes. These results show that interpretable graph learning can remain both faithful and scalable without sacrificing predictive effectiveness.

Figures & tables

Appendix figures & tables25 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. HiSE: A Lightweight Hierarchical Semantic Explainer for Heterogeneous Graph Neural Networks

    Jun 2, 2026Zongrui Li, Yuhang Zhao, Ying Zhao +3Graph Neural NetworksExplainability

  2. Neural Additive and Basis Models with Feature Selection and Interactions

    Jun 18, 2026Yasutoshi Kishimoto, Kota Yamanishi, Takuya Matsuda +1Feature SelectionGeneralized Linear Model

  3. A Generalized Tikhonov Layer for Interpretable-by-design Graph Neural Networks

    May 27, 2026Nicolas Tremblay, Benjamin Ricaud, Filippo Maria BianchiGraph Neural NetworksNeural Network