cs.DCNov 4, 2026

Ab Initio Accuracy Beyond the Cutoff: Distributed Message-Passing Equivariant Attention at Tens-of-Millions-of-Atom Scale

Authors: Allex Kan, Ji Zhang, Hao Yin, Hao Li, Owen Fu, Xunxing Chen, Lin Huang, Zion Wang, 

Organizations: IQuest Research, UBio Team and HPC Team, China

Abstract

Molecular dynamics predicts molecular motion from atomic forces and trajectory integration. Density functional theory (DFT) provides first-principles forces, but its O(N3)O(N^3) cost limits simulations to thousands of atoms; empirical force fields scale to millions but miss bond breaking and charge transfer. Equivariant message-passing Transformers learn the ab initio potential at linear cost. Stacked layers propagate information beyond a single cutoff, giving four layers a receptive field up to 23Å. At this frontier, scale is limited by communication: layers exchange boundary features across devices, force backpropagation repeats the exchange, and moving atoms change neighbor graphs and tensor shapes. We present Tessera, a distributed runtime that fixes workload shapes between rebuilds. It sorts atoms along a space-filling curve into equal-count shards, ensuring identical atom counts and tensor shapes per rank. Peer sets scale as K0.5K^{0.5}, not KK. A conservative neighbor skin preserves topology across updates, enabling each rebuild interval to replay as one CUDA Graph. Fused kernels, three-level neighbor search, and overlapped All-to-All complete it. On 512 GPUs, Tessera sustains 30.7M atoms at 89.7% weak-scaling efficiency (77--90% across three per-GPU loads); per-step time rises 1.11--1.29x as machine and problem grow 16x. Graph reuse cuts full-step time 1.87×1.87\times. Across an 8×8\times device increase, neighbor-search cost grows 1.7×1.7\times, versus 3.0×3.0\times for Morton order. In a live 10.2410.24M-atom salt solution, NVE energy drift is 0.42 μ0.42\,μeV/atom/ps over 1010 ps, and structure matches a serial reference. A 10.06M-atom Norovirus capsid sustains 100 ps of NVT at ≈8\approx 8 ps/day on 256 A100 GPUs. Over 200,000 steps, it has no broken bonds or anomalously close pairs and uses three compiled variants, with no graph breaks or eager fallbacks.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. FlashCart: Fast Cartesian Tensor Products for Equivariant Interatomic Potentials

    Oct 5, 2026Viktor Zaverkin, Payman Goodarzi, Sergey V. Sukhomlinov +4Machine Learning Interatomic PotentialsGPU Kernel Optimization

  2. LunaTP: Enabling Efficient and Scalable Tensor Product for Equivariant MLIPs

    Oct 13, 2026Yuanchang Zhou, Mingzhen Li, Chen Wang +3Machine Learning Interatomic PotentialsGPU Kernel Optimization

  3. Making Room for AI: Multi-GPU Molecular Dynamics with Deep Potentials in GROMACS

    Apr 8, 2026Luca Pennati, Andong Hu, Ivy Peng +2Molecular Dynamics SimulationHigh-Performance Computing