cs.LGNov 12, 2026

ISLA: A Coordinate-Free, Measure-Weighted Transformer for Boundary-Driven PDEs

Authors: Peter Sharpe

Organizations: NVIDIA, Santa Clara, California, USA

Abstract

A foundational principle of physics is that all coordinate systems are equally valid: the behavior of a PDE-governed system does not depend on the origin or orientation of the frame, nor on the units or mesh used to write it down, and neither should a surrogate model. Yet the neural surrogates with the lowest errors on today's aerodynamics benchmarks lack these invariances and fail under simple transformations of the same problem: for models trained on PDEs of cars in one pose (i.e., translation and rotation) and from one mesher, rotating the full PDE raises the surface-pressure error from 4% to more than 100%, and re-sampling its boundary raises it to about 30%. We introduce ISLA (Invariant Slice Attention), a slice-attention transformer for steady, boundary-driven PDEs in which no learned operation receives a coordinate and every sum over the boundary is a quadrature. Positions enter only as distances and relative angles to learned slice anchors, lengths are measured in a unit computed from the boundary, and interior points query the boundary through a tree-accelerated learned kernel without influencing one another. With every boundary cell a token and an exact boundary read, ISLA is equivariant to rigid motions and reflections, invariant to the units of its declared data, and consistent under mesh refinement, while at every setting each query is independent of all other queries. On AeroZoo, 2,816 flows that vary in shape, size, speed, and boundary conditions, its mean reference-scaled velocity and pressure errors are at least 3.1 and 3.3 times lower than any baseline's. On AirfRANS its errors are second only to those of a boundary-integral model (GLOBE) and at least 1.6 times lower than those of Transolver and GeoTransolver.

Figures & tables

Appendix figures & tables34 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. AeroZoo: A Benchmark of Well-Posed Flow Problems for Foundation Models of Aerodynamics

    Nov 12, 2026Peter Sharpe, Carmelo Gonzales, Corey Adams +2PDE Surrogate ModelingPDE Foundation Models

  2. LLT: Local Linear Transformer for PDE Operator Learning

    Jul 4, 2026Oded Ovadia, Eli TurkelPDE Surrogate ModelingTransformer Attention