Most existing Time Series Foundation Models (TSFMs) use channel independent modeling and focus on capturing and generalizing temporal dependencies, while neglecting the correlations among channels or overlooking the different aspects of correlations. However, these correlations play a vital role in Multivariate time series forecasting. To address this, we propose a CoRrelation-aware Adapter (CoRA), a lightweight plug-and-play method that requires only fine-tuning with TSFMs and is able to capture different types of correlations, so as to improve forecast performance. Specifically, to reduce complexity, we innovatively decompose the correlation matrix into low-rank Time-Varying and Time-Invariant components. For the Time-Varying component, we further design learnable polynomials to learn dynamic correlations by capturing trends or periodic patterns. To learn positive and negative correlations that appear only among some channels, we introduce a novel dual contrastive learning method that identifies correlations through projection layers, regulated by a Heterogeneous-Partial contrastive loss during training, without introducing additional complexity in the inference stage. Extensive experiments on 10 real-world datasets demonstrate that CoRA can improve TSFMs in multivariate forecasting performance.
Figures & tables
Figure 1: (a) Illustration of three different types of correlations, the formal definitions are provided in Appendix A . (b) Comparisons of different plugins for learning correlations
Figure 2: The framework of CoRA. (a) CoRA begins by learning DCorr in Dynamic Correlation Estimation module. Heterogeneous Division module projects representations into positive and negative spaces for HCorr. Then CoRA conducts H-PCorr Contrastive Learning in each space to guide projection and capture PCorr. (b) The DCorr Estimation module estimates correlations by combining Rule-based Correlations and Learnable Correlations, which are computed by Time-aware Polynomial and Time-Varying and Time-Invariant (T-T) Composition. (c) H-PCorr contrastive learning minimizes distances between strongly correlated channels and maximizes separation between weakly correlated channels in both positive and negative spaces.
Figure 3: The details of DCorr Estimation
Model
LLM-based
Pre-trained
GPT4TS (2023)
CALF (2025)
UniTime (2024)
Moment (2024)
Timer (2024)
TTM (2024)
Plugin
✗
✓
✗
✓
✗
✓
✗
✓
✗
✓
✗
✓
ETTh1
0.468
0.456
0.443
0.434
0.739
0.714
0.550
0.543
0.444
0.432
0.405
0.397
ETTh2
0.375
0.362
0.373
0.367
0.399
0.386
0.370
0.365
0.356
0.350
0.343
0.340
ETTm1
0.389
0.379
0.373
0.364
0.408
0.394
0.455
0.452
0.360
0.356
0.357
0.353
ETTm2
0.279
0.269
0.272
0.264
0.292
0.281
0.279
0.275
0.262
0.257
0.259
0.254
Table 1: Multivariate forecasting results in the 5% few-shot setting with MSE are averaged across four different forecasting horizons H∈{96,192,336,720} .The better results are highlighted in bold . Full and MAE results are available in Appendix E .
Figure 4: Correlation Plugins comparison in 5% few-shot fine-tuning setting.
Table 2: The MSE results of various variants.
Figure 5: Efficiency Analysis of TSFMs with and without the application of CoRA.
Dataset
ETTm2
Weather
Data
3%
5%
10%
20%
3%
5%
10%
20%
TTM
0.263 ±.005
0.259 ±.003
0.256 ±.003
0.250 ±.002
0.237 ±.003
0.226 ±.002
0.224 ±.002
0.216 ±.001
+ CoRA
0.261 ±.004
0.254 ±.002
0.248 ±.001
0.245 ±.001
0.234 ±.003
0.224 ±.002
0.212 ±.001
0.210 ±.001
CALF
0.285 ±.005
0.272 ±.003
0.268 ±.004
0.261 ±.003
0.251 ±.004
0.238 ±.002
0.230 ±.003
0.224 ±.002
+ CoRA
0.283 ±.003
0.264 ±.002
0.260 ±.002
0.254 ±.002
0.248 ±.003
0.231 ±.002
0.223 ±.002
0.219 ±.002
Table 3: MSE results for different data percentage.
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
Dataset
Domain
Frequency
Lengths
Dim
Split
Description
ETTh1
Electricity
1 hour
14,400
7
6:2:2
Power transformer 1, comprising seven indicators such as oil temperature and useful load
ETTh2
Electricity
1 hour
14,400
7
6:2:2
Power transformer 2, comprising seven indicators such as oil temperature and useful load
ETTm1
Electricity
15 mins
57,600
7
6:2:2
Power transformer 1, comprising seven indicators such as oil temperature and useful load
ETTm2
Electricity
15 mins
57,600
7
6:2:2
Power transformer 2, comprising seven indicators such as oil temperature and useful load
Weather
Environment
10 mins
52,696
21
7:1:2
Recorded every for the whole year 2020, which contains 21 meteorological indicators
Electricity
Electricity
1 hour
26,304
321
7:1:2
Electricity records the electricity consumption in kWh every 1 hour from 2012 to 2014
Appendix
Table 4: Statistics of datasets.
Models
Descriptions
Moment ( Goswami et al., 2024 )
Moment is a transformer system pre-trained on a masked time series task. It reconstructs masked portions of time series for tasks like forecasting, classification, anomaly detection, and imputation.
TTM ( Ekambaram et al., 2024b )
It is based on MLP-Mixer blocks with gated attention and multi-resolution sampling. It captures temporal patterns and cross-channel correlations for time-series forecasting, optimized for zero/few-shot learning with low computational cost.
Timer ( Liu et al., 2024e )
Timer is a GPT-style autoregressive model for time series analysis, predicting the next token in single-series sequences. It supports tasks like forecasting, imputation, and anomaly detection across different time series.
CALF ( Liu et al., 2025 )
CALF is a cross-modal knowledge distillation framework that aligns time series data with pre-trained LLMs by leveraging both static and dynamic knowledge, achieving state-of-the-art performance in both long- and short-term forecasting tasks with strong generalization abilities.
GPT4TS ( Zhou et al., 2023 )
GPT4TS fine-tunes the limited parameters of LLM, which demonstrates competitive performance by transferring knowledge from large-scale pre-training text data.
UniTime ( Liu et al., 2024b )
UniTime designs domain instructions to align time series and text modalities.
Appendix
Table 5: Descriptions of time series forecasting models in experiment.
Model
GPT4TS (2023)
CALF (2025)
UniTime (2024)
Plugin
✗
✓
✗
✓
✗
✓
Metric
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
ETTh1
96
0.439
0.447
0.427
0.435
0.407
0.427
0.396
0.417
0.718
0.575
0.690
0.557
192
0.461
0.458
0.449
0.448
0.429
0.443
0.420
0.433
0.750
0.592
0.723
0.573
336
0.464
0.468
0.451
0.458
0.443
0.456
0.433
0.446
0.723
0.592
0.702
0.582
720
0.509
0.512
0.497
0.496
0.495
0.495
0.487
0.484
0.767
0.623
0.739
0.606
Appendix
Table 6: The table reports MSE and MAE of LLM-based models for different forecasting horizons F∈{96,192,336,720} . The better results are highlighted in bold .
Model
Timer (2024)
Moment (2024)
TTM (2024)
CoRA
✗
✓
✗
✓
✗
✓
Metric
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
MSE
MAE
ETTh1
96
0.395
0.409
0.390
0.405
0.409
0.422
0.395
0.411
0.364
0.392
0.357
0.386
192
0.458
0.458
0.453
0.446
0.428
0.436
0.416
0.432
0.391
0.410
0.381
0.400
336
0.496
0.487
0.495
0.479
0.457
0.451
0.449
0.441
0.411
0.430
0.408
0.426
720
0.851
0.652
0.833
0.650
0.483
0.483
0.467
0.473
0.454
0.472
0.444
0.467
Appendix
Table 7: The table reports MSE and MAE of pre-trained models for different forecasting horizons F∈{96,192,336,720} . The better results are highlighted in bold .
Dataset
ETTm2
Electricity
Rate
5%
10%
15%
20%
25%
5%
10%
15%
20%
25%
TTM
0.164
0.162
0.163
0.160
0.157
0.146
0.143
0.145
0.141
0.142
+ LIFT
0.162
0.163
0.161
0.158
0.156
0.149
0.145
0.144
0.139
0.139
+ C-LoRA
0.166
0.163
0.162
0.159
0.155
0.148
0.146
0.147
0.140
0.141
+ CoRA
0.160 ±0.003
0.158 ±0.002
0.159 ±0.003
0.157 ±0.001
0.153 ±0.002
0.143 ±0.003
0.141 ±0.003
0.142 ±0.002
0.138 ±0.002
0.135 ±0.001
Appendix
Table 8: The sampling rate set to {5%, 10%, 15%, 20%, 25%}. Black : the best, Underline : the 2nd best.
Figure 6: Parameter sensitivity of main hyper-parameters in CoRA.
Time-series foundation models (TSFMs) have achieved strong univariate forecasting through large-scale pre-training, yet effectively extending this success to multivariate forecasting remains challenging. To address this, we propose DualWeaver, a novel framework that adapts univariate TSFMs (Uni-TSFMs) for multivariate forecasting by using a pair of learnable, structurally symmetric surrogate series. Generated by a shared auxiliary feature-fusion module that captures cross-variable dependencies, these surrogates are mapped to TSFM-compatible series via the forecasting objective. The symmetric structure enables parameter-free reconstruction of final predictions directly from the surrogates, without additional parametric decoding. A theoretically grounded regularization term is further introduced to enhance robustness against adaptation collapse. Extensive experiments on diverse real-world datasets show that DualWeaver outperforms state-of-the-art multivariate forecasters in both accuracy and stability. We release the code at https://github.com/li-jinpeng/DualWeaver.
Jinpeng Li, Zhongyi Pei, Huaze Xue +3
School of Software, BNRist, Tsinghua University · Tencent
Test-time adaptation (TTA) is a promising paradigm for handling distribution shift in time-series forecasting (TSF), where models adapt at inference time, often leveraging delayed observed data to refine predictions. In the multivariate setting, distribution shifts often exhibit cross-variate dependencies, yet existing TSF-TTA methods adapt each variate independently and ignore this cross-variate structure. Exploiting such structure motivates cross-variate interaction, but coupling variates through backbone predictions introduces direct pathways for mixing uncorrected errors across variates, a concern under the delayed supervision of TSF-TTA. We identify the interaction space as a key design choice, and show that acting on adapter corrections that refine backbone outputs, the correction space, rather than on the predictions themselves, avoids directly propagating backbone errors across variates. We build on this to propose CoRe (Correction-space Interaction Refinement), realizing correction-space interaction through (i) Shared-anchor Correction Refinement (SCR), which combines each variate's correction with a shared anchor through a parameter-efficient bottleneck, and (ii) input-conditioned spectral gating, which adaptively modulates the refinement from the current input window. Across seven backbones, six datasets, and four prediction horizons, CoRe reduces MSE by 25.82% on average over backbones and 10.57% over the state-of-the-art TSF-TTA method, with stronger gains at medium-to-long horizons and modest computational overhead. Data and code are available at: https://github.com/yyddou/CoReTTA
Yuanyuan Deng, Mykola Pechenizkiy, Songgaojun Deng
Eindhoven University of Technology Eindhoven, The Netherlands
Direct forecasting has become a standard paradigm for multivariate time-series forecasting because it predicts the full future horizon in a single pass. However, its training objective is often still decomposed into pointwise errors such as MSE. Such objectives provide stable supervision, but they do not explicitly preserve the structure of the future trajectory: temporal coherence within each variable and relational consistency across variables can both be weakened. We propose CoRe, a model-agnostic learning objective for direct multivariate forecasting. CoRe replaces pointwise supervision with two output-space constraints: a frequency coherence loss that aligns predicted and target spectra, and a low-rank relational graph loss that matches sampled pairwise differences in a target-derived PCA subspace. The resulting objective introduces no trainable parameters and can be applied to existing forecasting backbones by changing only the loss. Experiments on standard benchmarks show that CoRe improves strong baselines, compares favorably with recent forecasting objectives, and remains effective across different backbones, datasets, and hyperparameter settings overall consistently.
Xiaoyu Lin, Huiran Duan, Yining Liu +3
College of Computer and Information Technology, China Three Gorges University, China · City University of New York, USA · University of California, Berkeley, USA +1