cs.LGApr 13, 2026

Hypergraph Neural Diffusion: A PDE-Inspired Framework for Hypergraph Message Passing

Authors: Zhiheng Zhou, Mengyao Zhou, Xixun Lin, Xingqin Qi, Guiying Yan

Organizations: School of Mathematics and Statistics, Shandong University · Academy of Mathematics and Systems Science, Chinese Academy of Sciences · School of Mathematical Sciences, University of Chinese Academy of Sciences · Institute of Information Engineering, Chinese Academy of Sciences · School of Cyber Security, University of Chinese Academy of Sciences

Abstract

Hypergraph neural networks (HGNNs) have shown remarkable potential in modeling high-order relationships that naturally arise in many real-world data domains. However, existing HGNNs often suffer from shallow propagation, oversmoothing, and limited adaptability to complex hypergraph structures. In this paper, we propose Hypergraph Neural Diffusion (HND), a novel framework that unifies nonlinear diffusion equations with neural message passing on hypergraphs. HND is grounded in a continuous-time hypergraph diffusion equation, formulated via hypergraph gradient and divergence operators, and modulated by a learnable, structure-aware coefficient matrix over hyperedge-node pairs. This partial differential equation (PDE) based formulation provides a physically interpretable view of hypergraph learning, where feature propagation is understood as an anisotropic diffusion process governed by local inconsistency and adaptive diffusion coefficient. From this perspective, neural message passing becomes a discretized gradient flow that progressively minimizes a diffusion energy functional. We derive rigorous theoretical guarantees, including energy dissipation, solution boundedness via a discrete maximum principle, and stability under explicit and implicit numerical schemes. The HND framework supports a variety of integration strategies such as non-adaptive-step (like Runge-Kutta) and adaptive-step solvers, enabling the construction of deep, stable, and interpretable architectures. Extensive experiments on benchmark datasets demonstrate that HND achieves competitive performance. Our results highlight the power of PDE-inspired design in enhancing the stability, expressivity, and interpretability of hypergraph learning.

Figures & tables

Explore similar work

CardsList
  1. From Diffusion to Reaction-Diffusion: A Dynamical-Systems View of Oversmoothing in Hypergraph Neural Networks

    Jul 17, 2026Zhiheng Zhou, Mengyao Zhou, Yancheng Chen +3Hypergraph Neural NetworksHypergraph Learning

  2. Tackling Over-smoothing on Hypergraphs: A Ricci Flow-guided Neural Diffusion Approach

    Mar 16, 2026Mengyao Zhou, Zhiheng Zhou, Xiao Han +3Hypergraph Neural NetworksHypergraph Learning

  3. Hypergraph Neural Stochastic Diffusion: An SDE Framework for Uncertainty Estimation

    Jul 8, 2026Zhiheng Zhou, Mengyao Zhou, Dengyi Zhao +2Stochastic Differential EquationsUncertainty Quantification