cs.LGMar 10, 2026

Two Teachers Better Than One: Hardware-Physics Co-Guided Distributed Scientific Machine Learning

Authors: Yuchen Yuan, Junhuan Yang, Hao Wan, Yipei Liu, Hanhan Wu, Youzuo Lin, Lei Yang

Organizations: George Mason University, Fairfax, VA, USA · University of North Carolina at Chapel Hill, NC, USA

Abstract

Scientific machine learning (SciML) is increasingly applied to in-field processing, controlling, and monitoring; however, wide-area sensing, real-time demands, and strict energy and reliability constraints make centralized SciML implementation impractical. Most SciML models assume raw data aggregation at a central node, incurring prohibitively high communication latency and energy costs; yet, distributing models developed for general-purpose ML often breaks essential physical principles, resulting in degraded performance. To address these challenges, we introduce EPIC, a hardware- and physics-co-guided distributed SciML framework, using full-waveform inversion (FWI) as a representative task. EPIC performs lightweight local encoding on end devices and physics-aware decoding at a central node. By transmitting compact latent features rather than high-volume raw data and by using cross-attention to capture inter-receiver wavefield coupling, EPIC significantly reduces communication cost while preserving physical fidelity. Evaluated on a distributed testbed with five end devices and one central node, and across 10 datasets from OpenFWI, EPIC reduces latency by 8.9×\times and communication energy by 33.8×\times, while even improving reconstruction fidelity on 8 out of 10 datasets.

Figures & tables

Explore similar work

CardsList
  1. ShardTensor: Domain Parallelism for Scientific Machine Learning

    May 11, 2026Corey Adams, Peter Harrington, Akshay Subramaniam +4Scientific MLDistributed Training

  2. Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers

    Mar 20, 2026Yijiang Li, Zilinghan Li, Kyle Chard +4Federated LearningHeterogeneous Federated Learning

  3. LUMOS: Democratizing SciML Workflows with L0-Regularized Learning for Unified Feature and Parameter Adaptation

    Feb 26, 2026Shouwei Gao, Xu Zheng, Dongsheng Luo +2Scientific MLAutomated Machine Learning