A Comprehensive Benchmark of Source-Free Universal Domain Adaptation on Time Series Representations
Organizations: Univ Rouen Normandie, INSA Rouen Normandie, Universit´e Le Havre Normandie, Normandie Univ, LITIS UR 4108, F-76000 Rouen, France
Abstract
Source-Free Universal Domain Adaptation (SF-UniDA) extends Universal Domain Adaptation by removing access to source data at adaptation time while still handling label-set mismatches between domains. Despite growing interest in this setting for image data, no benchmark exists for time series, which are more challenging. We present the first SF-UniDA benchmark on time series. In addition, we provide the first study of pretrained foundation models as feature extractors for time series domain adaptation. In this context, we identify a critical and previously underexplored limitation of all existing SF-UniDA methods: the inference threshold for unknown-sample rejection is highly sensitive. We address this by proposing a plug-in auto-thresholding module that can be integrated into any SF-UniDA method. Experiments on three well-known time series datasets confirm the suitability of this module. They also highlight that foundation models do not systematically outperform classical backbones and that SF-UniDA tailored for time series is yet to be developed.
Figures & tables
| Model | Type | Architecture | Param. | Input | Pre-training objective | Task |
|---|---|---|---|---|---|---|
| MOMENT [ 5 ] | Encoder | T5 | 40M | Patches | Reconstruction | General-purpose |
| Mantis [ 3 ] | Encoder | ViT | 8M | Tokens | Contrastive learning | Classification |
| Chronos [ 1 ] | Seq2Seq | T5 and LLM | 8M | Scalar quantized | Autoregression | Forecasting |
| Method | Key idea | Unknown detection | Source-free | Threshold-free (Inference) |
|---|---|---|---|---|
| UMAD [ 9 ] | Dual-head classifier consistency | Consistency + MixUP | Weak | ✓ |
| GLC [ 14 ] | Global One Vs All + local k-NN | One Vs All clustering | Full | ✗ |
| GLC++ [ 15 ] | GLC + contrastive loss | One Vs All clustering | Full | ✗ |
| LEAD [ 13 ] | Orthogonal feature decomposition | Gaussian Mixture Model | Full | ✗ |
| Datasets | Methods | Backbones | Foundation Models | |||||
|---|---|---|---|---|---|---|---|---|
| CNN | TFE | S3 | TSLANet | Mantis | Moment | Chronos | ||
| HAR | UniJDOT | 61.0 ∗ (–) | 64.6 ∗ (–) | 54.1 ∗ (–) | 59.7 ∗ (–) | 82.5 (–) | 30.1 (–) | 72.2 (–) |
| UMAD | 52.7 ( 2.5) | 64.6 ( 29.7) | 36.1 ( 7.5) | 43.1 ( 11.5) | 51.2 ( 16.2) | 24.2 ( 11.4) | 46.0 ( 13.3) | |
| GLC | 46.2 ( 4.2) | 42.2 ( 29.0) | 52.3 ( 11.2) | 54.0 ( 5.8) | 53.4 ( 15.8) | 16.7 ( 16.6) | 50.6 ( 28.9) | |
| GLC++ | 44.7 ( 5.4) | 36.4 ( 20.8) | 50.7 ( 5.0) | 54.1 ( 17.8) | 59.6 ( 51.1) | 13.6 ( 10.8) | 50.9 ( 33.8) | |
| LEAD | 43.8 ( 7.2) | 42.3 ( 28.1) | 50.4 ( 4.4) | 53.1 ( 15.5) | 57.8 ( 13.3) | 13.7 ( 11.5) | 50.6 ( 30.7) | |
| Threshold | Backbones | Foundation M. | |||
|---|---|---|---|---|---|
| CNN | TFE | S3Layer | Mantis | Chronos | |
| yen | 46.2 | 42.2 | 52.3 | 53.4 | 50.6 |
| otsu | 44.5 | 42.9 | 49.8 | 45.7 | 42.9 |
| li | 42.0 | 41.3 | 55.3 | 48.0 | 40.3 |