cs.LGNov 11, 2026

PhysXAI: A Theoretical Framework for Diagnosing Physical Hallucinations in Weather Foundation Models

Authors: Anjan Mahapatra, Nikhil Raj

Organizations: Department of Mechanical Engineering, IIITDM Kancheepuram, Chennai, Tamil Nadu, India · Department of Mechanical Engineering, Indian Institute of Technology Kanpur, Kanpur, Uttar Pradesh, India

Abstract

Modern machine learning models for global weather forecasting achieve remarkable predictive accuracy, yet they frequently produce states that violate fundamental physical laws, including conservation of mass, hydrostatic balance, or spectral energy scaling. We term these outputs physical hallucinations and propose PhysXAI, a rigorous diagnostic framework that detects, localises, and attributes such inconsistencies. Unlike existing post-hoc metric suites, PhysXAI is a learnable system that explicitly decouples forecast error from physical plausibility. We formalise the problem through a novel joint condition on numerical and physical residuals, and introduce a multi-branch encoder that extracts representations from conservation, dynamical, spectral, cross-variable, and spatiotemporal residuals. A key innovation is a physics-consistency contrastive learning objective, which we theoretically show the latent representation to be approximately isometric to the physical residual space, ensuring that diagnostic decisions remain grounded in physically meaningful deviations. We further derive an adaptive multi-objective loss with gradient-based weighting to balance competing diagnostic objectives. The framework produces spatially resolved hallucination maps, violation-type classifications, and calibrated Bayesian uncertainty, enabling both detection and interpretable attribution of physical inconsistencies. We conduct a comprehensive comparative evaluation of PhysXAI across ERA5, WeatherBench 2, and MERRA-2, using forecasts from GraphCast, Pangu-Weather, and NeuralGCM, with Python-written code and a fully reproducible experimental protocol. Our theoretical analysis and empirical evaluation establish PhysXAI as a principled framework for diagnosing physical hallucinations and advancing trustworthy AI for weather forecasting.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Models

    Jun 9, 2026Emma Kasteleyn, Timo Maier, Axel Lauer +3Forecasting BenchmarksPhysics-Informed ML

  2. The physics of AI weather models

    May 22, 2026George Craig, Tobias Selz, Matthias Beylich +1AI for ScienceRepresentational Similarity Analysis

  3. Missing the Butterfly and Predicting the Past: Features or Bugs of Accurate AI Weather Models?

    Aug 26, 2026Pedram Hassanzadeh, Weidong Li, Y. Qiang Sun +4Weather ForecastingChaotic Time-Series Prediction