Class-aware Latent Attention Replay (CLAR): Class Incremental Hazard Diagnosis for Resilient AI in the Manufacturing Industrial Internet
Organizations: Department of Mechanical, Materials, and Industrial Engineering, University of Cincinnati, Cincinnati, OH · Department of Industrial and Systems Engineering, Virginia Tech, Blacksburg, VA
Abstract
Artificial Intelligence (AI) systems provide critical computation services in the Manufacturing Industrial Internet (MII), and their resilience depends on timely diagnosis of hazards across the data, AI pipeline, and cyber-physical layers. During operation, new hazard types keep emerging with only a few samples each, hazards co-occur, and the diagnosis model runs on memory-constrained computation nodes. Replay-based class-incremental learning (CIL) can learn new hazard classes while revisiting a small memory of past samples, but existing methods assume single-label, balanced streams, store high-dimensional raw samples, and select them independently of the classifier. We propose Class-aware Latent Attention Replay (CLAR), which combines a dual buffer that stores mostly compact latent representations with a few raw samples, an Attention Leverage Score (ALS) that upper-bounds the classifier logit and guides class-balanced reservoir sampling, and an exponential-moving-average teacher that slows latent-space drift. For an idealized buffer model, we prove that the buffer is class-balanced and follows an ALS-weighted class distribution, and that below a critical per-class capacity, ALS-guided replay has a lower replay-gradient error than class-balanced uniform replay. In the case study, On hazard diagnosis data from an MII testbed, CLAR achieves the highest mean average weighted F1 score among the evaluated replay methods with the same buffer size
Figures & tables
| Class | Layer | Root cause factor and simulation |
|---|---|---|
| Class 0 | Data | Sensor contamination or failure: % of contaminated or failed sensors among the ten inputs |
| Class 1 | Data | Low signal-to-noise ratio (SNR): random noise injected at controlled scales |
| Class 2 | Data | Distribution change of input variables: Gaussian mixture data with controlled KL divergence |
| Class 3 | Data | Class imbalance: nonconforming-to-conforming ratio within a data batch |
| Class 4 | AI pipeline | Pipeline singularity: % of pipelines forced to produce identical predictions |
| Method | AvgF1 | Forgetting | BWT | AvgF1 | Forgetting | BWT |
|---|---|---|---|---|---|---|
| No Replay | ||||||
| iCaRL | ||||||
| ER | ||||||
| CBRS | ||||||
| FBCR | ||||||
Replay-Based Continual Learning
Replay-based continual learning preserves prior-task knowledge by revisiting stored or generated experience while adapting models to new data.
See all 134 papers