RTSM: Adapting Recursive Models to Multivariate Time-Series Classification
Organizations: Integrated Systems Laboratory, ETH Zürich, Switzerland
Abstract
Accurate multivariate time-series classification requires extracting temporal features and integrating information across a sequence. Weight-tied refinement offers a way to repeatedly process these features without allocating new parameters at each stage. Applying this principle to time series requires choosing both a temporal representation and a latent-state organization suited to classification. We introduce the Recursive Time-Series Model (RTSM), which combines a learned convolutional temporal tokenizer, single-state weight-tied refinement, and a pooled classification readout. Across all 30 UEA datasets, RTSM achieves 72.81% mean accuracy under validation-based configuration and checkpoint selection, the highest observed mean among the 17 evaluated deep-learning models and 1.60 percentage points above MambaSL. Ablations on eight datasets favor the proposed tokenizer over a simple convolutional embedding and the single-state model over the tested two-state variants. The complete classifier reaches 86.10% mean accuracy versus 84.79% for a separately trained tokenizer-only classifier. These findings identify temporal encoding and state organization as key design choices for adapting recursive architectures to time series. The resulting classifier combines competitive accuracy with a shared refinement module whose parameter count is independent of computational depth.
Figures & tables
| Component | TRM | RTSM |
|---|---|---|
| Input | Discrete token embeddings | Convolutional temporal tokens from real-valued sequences |
| State | Prediction state and auxiliary state | One token-level latent state refined using the input tokens |
| Readout | Per-token class logits | Pooled sequence-level class and correctness logits |
| Training | Deep supervision; gradients through the final cycle; correctness-based halting | Same recipe, with correctness targets for sequence classification |
| State structure | ||||
|---|---|---|---|---|
| Tokenizer | None | Two-state shared | Two-state separate | Single state |
| Conv1D | 73.72 | 78.96 | 79.69 | – |
| RTSM | 84.79 | 84.98 | 84.29 | 86.10 |
| Within-step depth | Training supervision | ||||||
|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | One step | Adaptive, up to 16 | Fixed 16 |
| 85.77 | 85.60 | 86.10 | 85.61 | 85.78 | 85.98 | 86.10 | 85.05 |
Appendix figures & tables19 assets
Supplementary material from the paper’s appendix.
Appendix
| MambaSL Protocol | Validation Protocol | |||
| Setting | DL | RTSM | DL | RTSM |
| Train epochs | 100 | 100 | 100 | 100 |
| Seed | 2021 | 2021 | 2021 | 2021 |
| Batch size | 16 † | dataset-specific | 16 | dataset-specific |
| Learning rate | ||||
| LR scheduler | none | constant | none | constant |
| Dataset | Abbr. | Train Cases | Test Cases | Length | Channels | Classes |
|---|---|---|---|---|---|---|
| EthanolConcentration | EC | 261 | 263 | 1751 | 3 | 4 |
| FaceDetection | FD | 5890 | 3524 | 62 | 144 | 2 |
| Handwriting | HW | 150 | 850 | 152 | 3 | 26 |
| Heartbeat | HB | 204 | 205 | 405 | 61 | 2 |
| JapaneseVowels | JV | 270 | 370 | 7–29 | 12 | 9 |
| PEMS-SF | PEMS | 267 | 173 | 144 | 963 | 7 |
| Linear/MLP | Convolutional/spectral/multiscale | ||||||
| DLinear ( 2023 ) | LightTS ( 2022 ) | MTS- Mixers ( 2025 ) | TimesNet ( 2023 ) | Modern TCN ( 2024 ) | TSLANet ( 2024 ) | Time Mixer++ ( 2025b ) | |
| EC | 25.480 | 28.140 | 22.050 | 28.520 | 23.950 | 30.420 | 24.330 |
| FD | 67.820 | 64.560 | 65.580 | 66.030 | 64.100 | 65.490 | 64.390 |
| HW | 21.530 | 19.530 | 14.940 | 27.760 | 19.650 | 56.350 | 26.000 |
| HB | 73.170 | 73.170 | 73.660 | 77.070 | 68.780 | 77.070 | 75.610 |
| JV | 95.680 | 92.970 | 92.970 | 97.840 | 96.220 | 96.490 | 97.030 |
| Configuration | Avg. Acc. (%) |
|---|---|
| Main-text ablations | |
| Conv_tokenizer_only | |
| Conv_3H6L1G_steps16_shared | |
| Conv_3H6L1G_steps16_separate | |
| tokenizer_only | |
| 3H6L1G_steps16_shared | |
| 3H1G_steps16 | tokenizer_only | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Dataset | Seed 0 | Seed 1 | Seed 2 | Mean Std. | Seed 0 | Seed 1 | Seed 2 | Mean Std. | |
| CharacterTrajectories | 99.234 | 99.095 | 98.886 | 95.891 | 96.031 | 96.379 | +2.971 | ||
| PenDigits | 98.571 | 98.742 | 99.085 | 98.485 | 98.113 | 98.228 | +0.524 | ||
| SpokenArabicDigits | 98.408 | 98.681 | 98.590 | 96.362 | 96.771 | 97.317 | +1.743 | ||
| JapaneseVowels | 97.297 | 97.838 | 96.757 | 96.757 | 97.027 | 96.757 | +0.450 | ||
| NATOPS | 91.111 | 89.444 | 91.111 | 89.444 | 92.778 | 93.333 | -1.296 | ||
| 3H1G_steps16 | 3H6L1G_steps16_shared | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Dataset | Seed 0 | Seed 1 | Seed 2 | Mean Std. | Seed 0 | Seed 1 | Seed 2 | Mean Std. | |
| CharacterTrajectories | 99.234 | 99.095 | 98.886 | 99.304 | 98.189 | 98.886 | +0.279 | ||
| PenDigits | 98.571 | 98.742 | 99.085 | 98.856 | 98.571 | 98.370 | +0.200 | ||
| SpokenArabicDigits | 98.408 | 98.681 | 98.590 | 97.954 | 98.090 | 98.363 | +0.424 | ||
| JapaneseVowels | 97.297 | 97.838 | 96.757 | 98.108 | 96.486 | 96.486 | +0.271 | ||
| NATOPS | 91.111 | 89.444 | 91.111 | 82.778 | 77.778 | 95.556 | +5.185 | ||
| 3H6L1G_steps16_shared | tokenizer_only | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Dataset | Seed 0 | Seed 1 | Seed 2 | Mean Std. | Seed 0 | Seed 1 | Seed 2 | Mean Std. | |
| CharacterTrajectories | 99.304 | 98.189 | 98.886 | 95.891 | 96.031 | 96.379 | +2.693 | ||
| PenDigits | 98.856 | 98.571 | 98.370 | 98.485 | 98.113 | 98.228 | +0.324 | ||
| SpokenArabicDigits | 97.954 | 98.090 | 98.363 | 96.362 | 96.771 | 97.317 | +1.319 | ||
| JapaneseVowels | 98.108 | 96.486 | 96.486 | 96.757 | 97.027 | 96.757 | +0.180 | ||
| NATOPS | 82.778 | 77.778 | 95.556 | 89.444 | 92.778 | 93.333 | -6.481 | ||
| 1 | 2 | 4 | 8 | 16 | 32 | 64 | 128 | 256 | 512 | |
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 72.03 | 73.01 | 74.25 | 74.82 | 75.48 | 75.91 | 76.34 | 76.70 | 77.14 | 77.71 |
| 2 | 72.48 | 72.86 | 73.14 | 73.48 | 73.79 | 73.91 | 74.35 | 74.69 | 75.11 | 75.23 |
| 4 | 72.82 | 73.01 | 73.18 | 73.55 | 73.65 | 73.73 | 73.81 | 73.86 | 73.96 | 74.03 |
| 8 | 72.57 | 72.71 | 72.85 | 72.95 | 73.02 | 73.07 | 73.12 | 73.15 | 73.23 | 73.26 |
| 16 | 72.54 | 72.65 | 72.80 | 72.93 | 72.97 | 73.00 | 73.06 | 73.32 | 73.38 | 73.41 |
| 32 | 72.78 | 72.90 | 73.01 | 73.12 | 73.17 | 73.22 | 73.27 | 73.29 | 73.35 | 73.37 |
| Step | Accuracy (%) | CE loss | RMS residual |
|---|---|---|---|
| 1 | 72.42 | 2.5983 | 1.41722 |
| 2 | 72.53 | 2.8313 | 0.19541 |
| 4 | 72.15 | 2.9168 | 0.03303 |
| 8 | 72.56 | 2.9377 | 0.01080 |
| 16 | 72.61 | 2.9470 | 0.00716 |
| 32 | 72.83 | 2.9476 | 0.00684 |
| Det. | Oracle | Headroom | Best-Q | Majority | Min-res. | |
| RTSM | 72.84 | 73.36 | +0.52 | 72.66 | 72.76 | 72.74 |
| Statistic | Headroom (pp) |
|---|---|
| Mean | +0.52 |
| Median | 0.00 |
| Q25 | 0.00 |
| Q75 | +0.37 |
| IQR | 0.37 |
| Minimum | 0.00 |
| Dataset | Det. | Oracle | Headroom | Best-Q | Majority | Min-res. |
|---|---|---|---|---|---|---|
| PS | 24.16 | 29.56 | +5.40 | 23.08 | 23.89 | 23.53 |
| EC | 29.66 | 34.98 | +5.32 | 25.86 | 28.52 | 28.52 |
| FD | 67.22 | 68.22 | +0.99 | 66.97 | 66.91 | 67.00 |
| EP | 94.93 | 95.65 | +0.72 | 95.65 | 94.93 | 94.93 |
| NATO | 95.56 | 96.11 | +0.56 | 95.56 | 95.56 | 95.56 |
| LSST | 65.37 | 65.90 | +0.53 | 65.41 | 65.45 | 65.41 |
| Component | HRM ( Wang et al., 2025a ) | TRM ( Jolicoeur-Martineau, 2025 ) | RTSM (ours) |
| State initialization | frozen random vectors | frozen random vectors | frozen random vector ( only) |
| Update networks | separate , | one shared network | one shared network |
| Gradient schedule | one-step gradient: final and updates only | full backpropagation through the final cycle ( ) | full backpropagation through the final cycle ( ) |
| Deep supervision | up to steps, states detached between steps | up to steps, states detached between steps | up to steps, states detached between steps |
| Halting, training | Q-learning halt/continue head with exploration | correctness-based halt score with BCE and exploration | same as TRM, using sequence-level correctness |
| Halting, evaluation | fixed depth | fixed depth | fixed depth |
Time Series Classification
Time series classification assigns labels to sequential data, using temporal patterns to support decisions in health, sensing, science, and industry.
See all 170 papers