cs.LGNov 2, 2026

Cross-Domain Joint-Embedding Pretraining For Heterogeneous Industrial Time Series

Authors: Jonathan Adam Rico, Nagarajan Raghavan, Senthilnath Jayavelu

Organizations: Engineering Product Development (EPD), SUTD, Singapore · Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore

Abstract

Industrial predictive maintenance and manufacturing tasks frequently contain abundant sensor measurements, but with limited labeled data. We investigate cross-domain self-supervised pretraining using joint-embedding predictive architecture for heterogeneous industrial time series (JEPA-HITS), which learns one encoder from various domains such as battery, semiconductor chemical mechanical planarization (CMP), computer numerical control (CNC) machining, and bearing while preserving dataset-specific temporal scales. We evaluate representation reuse on regression and classification problems under reduced-label downstream training, and leave-one-domain-out (LODO) pretraining. Compared with the same architecture initialized randomly, LODO pretraining reduces RMSE from 10.72 to 7.95 on battery remaining useful life (RUL), 4.34 to 3.89 on CMP, and 13.53 to 11.72 on tool wear regression, while improving bearing fault diagnosis macro-F1 from 0.547 to 0.737. Overall results suggest that unlabeled time series measurements from heterogeneous industrial processes can provide reusable representations for downstream learning with limited labeled data.

Figures & tables

Explore similar work

CardsList
  1. Does Joint-Embedding Predictive Architecture Pretraining Help Time Series Forecasting?

    Sep 16, 2026Yutong Feng, Bowen Liao, See Kiong Ng +1Joint-Embedding Predictive ArchitectureSelf-Supervised Time Series Representation Learning

  2. Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation

    Jun 10, 2026Amir El-Ghoussani, Michele De Vita, Ronald Naumann +1RUL EstimationPredictive Maintenance

  3. FactoryNet: A Large-Scale Dataset toward Industrial Time-Series Foundation Models

    May 9, 2026Jonas Petersen, Pratik Jawahar, Riccardo Maggioni +11ManufacturingIndustrial Anomaly Detection