Fault-tolerant shallow recurrent decoders for sparse sensing with missing sensor measurements
Organizations: Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milano, Italy · Department of Mechanical Engineering, Politecnico di Milano, Milano, Italy · Autodesk Research, London, UK · MOX - Department of Mathematics, Politecnico di Milano, Milano, Italy
Abstract
Real-world sensing systems are inherently imperfect: sensors may fail, intermittently disconnect, operate with asynchronous sampling rates, and be subject to noise, leading to measurement streams that are irregular, incomplete, and heterogeneous. Nevertheless, sensing strategies for real-time state reconstruction typically assume synchronous and continuously active sensors, a constraint that substantially limits their applicability in operational environments. In this work, we introduce fault-tolerant sparse sensing strategies in the context of shallow recurrent decoders (SHRED) to enable high-dimensional state estimation from sparse, asynchronous, and missing sensor measurements. Specifically, we consider naive imputation strategies, fault-tolerant recurrent temporal encoders, and we introduce four different transformer-based masking mechanisms to make SHRED explicitly aware of sensor availability through the binary data-availability mask. Moreover, we further introduce a multi-step decoding training objective for SHRED, resulting in smoother latent trajectories and more robust predictions. Throughout a synthetic benchmark and three real-world problems in hydrodynamic and ocean modeling, we show that (i) transformer-based masking mechanisms outperform standard imputation techniques and fault-tolerant recurrent architectures, (ii) the multi-step decoding training objective enhances reconstruction fidelity and robustness in the presence of heterogeneous missing-data patterns, while (iii) the computational efficiency of SHRED is preserved, with no additional inference-time overhead.
Figures & tables
Learning with Missing Data
Learning with missing data develops methods to estimate, predict, and make decisions when variables, labels, modalities, or time points are unobserved.
See all 129 papers