cs.LGJul 8, 2026

Eigenbasis-Independent Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces

Authors: Jiaqing XieYuxin Wang

Abstract

Spectral positional encodings (PEs) for \emph{directed} graphs face two obstacles: magnetic Laplacians require an O(n3)O(n^3) Hermitian eigendecomposition per potential, and their complex eigenvectors are defined only up to unitary gauge, which prior work handles with basis-invariant architectures. We propose learnable spectral PEs of the form hθ(Aq)Rh_θ(A_q)\,R, where AqA_q is a normalized magnetic operator, hθh_θ a learnable scalar spectral response, and RR a block of random probes. Because the PE is a \emph{matrix function} of the operator, it is gauge-invariant by construction. We compute it in a Hermitian block Krylov subspace from sparse matrix--vector products only, prove that k=O(log(1/ε))k = O(\log(1/\varepsilon)) block steps suffice uniformly over heat--resolvent response families, and give a covering-number argument for why low-dimensional structured families generalize where free per-eigenvalue weights overfit. On a directed SBM whose symmetrization is uninformative by construction, direction-blind PEs stay at chance while magnetic Krylov PEs converge to the exact-eigendecomposition oracle as the depth grows. The same probes yield gauge-invariant pairwise features with 1/s1/\sqrt{s} Monte-Carlo error, and the undirected q=0q{=}0 case improves heterophilous benchmarks over no-PE and polynomial baselines.

Explore similar work

CardsList
  1. Rotary Position Encodings for Graphs

    Sep 26, 2025Isaac Reid, Arijit Sehanobish, Cederik Höfs +7Positional EncodingTransformer Architectures