cs.LGApr 22, 2026

Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation Learning

Authors: Yuhan PengJunwen DongYuzhi ZengHao LiCe JuHuitao FengDiaaeldin TahaAnna Wienhard+1 more

Abstract

Graph neural networks face two fundamental challenges rooted in the linear structure of Euclidean vector spaces: (1) Current architectures represent geometry through vectors (directions, gradients), yet many tasks require matrix-valued representations that capture relationships between directions-such as how atomic orientations covary in a molecule. These second-order representations are naturally captured by points on the symmetric positive definite matrices (SPD) manifold; (2) Standard message passing applies shared transformations across edges. Sheaf neural networks address this via edge-specific transformations, but existing formulations remain confined to vector spaces and therefore cannot propagate matrix-valued features. We address both challenges by developing the first sheaf neural network operates natively on the SPD manifold. Our key insight is that the SPD manifold admits a Lie group structure, enabling well-posed analogs of sheaf operators without projecting to Euclidean space. Theoretically, we prove that SPD-valued sheaves are strictly more expressive than Euclidean sheaves: they admit consistent configurations (global sections) that vector-valued sheaves cannot represent, directly translating to richer learned representations. Empirically, our sheaf convolution transforms effectively rank-1 directional inputs into full-rank matrices encoding local geometric structure. Our dual-stream architecture achieves SOTA on 6/7 MoleculeNet benchmarks, with the sheaf framework providing consistent depth robustness.

Explore similar work

CardsList
  1. Gaussian Sheaf Neural Networks

    May 20, 2026André Ribeiro, Ana Luiza Tenório, Tiago da Silva +1Graph Neural NetworksGraph Representation Learning

  2. Hierarchical Pooling for Sheaf Neural Networks

    Jun 18, 2026Dionisia Naddeo, Carlo Abate, Pietro Liò +2SheafGraph Neural Networks