cs.LGNov 3, 2026

Self-Supervised Learning of Universal Latent Spaces for Operator Learning

Authors: Sepehr Mousavi, Levi Lingsch, Siddhartha Mishra, Laura De Lorenzis

Organizations: Department of Mechanical and Process Engineering, ETH Zurich, Switzerland · ETH AI Center, Zurich, Switzerland · Seminar for Applied Mathematics, ETH Zurich, Switzerland

Abstract

Neural operators fit their representation of functions to the task they are trained on, so every new task rebuilds a reduced space from labeled data. Following the self-supervised pre-training that made representations shareable in natural language processing and computer vision, we decouple representation learning from operator learning. A functional autoencoder is pre-trained on analytic functions synthesized on the fly, with no solver and no labels, to represent functions on arbitrary point clouds, and the latent space it induces is frozen and reused across tasks. The representation is exactly equivariant to translation, dilation, and amplitude, and reconstructs solutions of partial differential equations (PDEs) and natural images on geometries it never saw. Being task-agnostic, the latent space can be interpreted in its own right. The whole space is used and decodes to valid fields, it preserves the ordering of distances between physical fields, its geodesics interpolate physical evolutions, and edit directions transfer across fields. With frozen representation maps, a dataset is encoded once and a neural operator is trained entirely on cached embeddings, which saves memory and training time. On 28 tasks in fluid dynamics, solid mechanics, acoustics, and the Helmholtz and Poisson equations, this paradigm can exceed the accuracy of state-of-the-art end-to-end architectures, with up to an order of magnitude higher throughput and memory savings that fit models nearly two orders of magnitude larger on consumer-grade GPUs. At inference, latent rollouts run up to an order of magnitude faster than regular rollouts, and chunked inference processes functions of over half a billion points on a single consumer-grade GPU.

Figures & tables

Appendix figures & tables55 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. HiLNO: A Hierarchical Latent Neural Operator with Multi-Scale Supervision for PDEs on General Geometries

    Sep 16, 2026Zhicheng Hu, Jiacheng Li, Min YangHierarchical Representation LearningMulti-Scale Feature Fusion

  2. Learnable composition for neural operators

    Sep 2, 2026Zituo Chen, Baiming Zhang, Sili DengNeural Surrogate ModelingPorous Media Flow

  3. PANO: Parallel Latent Space Neural Operator for Solving PDEs

    Nov 17, 2026Zijiang Yang, Xiaomeng Wu, Chen Kuang +1PDE Operator LearningNeural Operators