cs.LGDec 16, 2024

Embedded Decomposed Transformer for explainable multivariate time series forecasting

Authors: Sanjay Chakraborty, Ibrahim Delibasoglu, Fredrik Heintz

Organizations: Department of Computer and Information Science (IDA), REAL, AIICS, Linköping University, Linköping, Sweden

Abstract

Time series forecasting is an important problem with diverse real-world applications. This paper introduces the Embedded Decomposed Transformer (EDformer) for multivariate time series forecasting. EDformer decomposes the input signal into seasonal and trend components using two complementary strategies: time-domain Average Pooling (AP) based on moving-average smoothing and Frequency-Aware (FA) decomposition based on low-pass filtering in the Fourier domain. The reconstructed multivariate seasonal component is embedded across inverted dimensions, after which attention captures cross-variate correlations and a feed-forward network learns nonlinear representations for each variable. The trend component is forecast through projection and combined with the seasonal prediction to produce the final forecast. We evaluate both decomposition variants on several real-world datasets, showing that EDformer achieves competitive performance, while their relative effectiveness varies across datasets, experimental settings, and temporal characteristics. We further conduct an ablation study isolating the contribution of decomposition, inverted embedding, and the frequency cutoff ratio; a hyperparameter sensitivity analysis over learning rate and batch size; and a statistical significance analysis using Friedman and Wilcoxon signed-rank tests to substantiate the reported performance differences. Finally, model explainability techniques are explored to improve interpretability and provide insights into the features and time steps influencing the forecasting results.

Figures & tables

Explore similar work

CardsList
  1. RankFormer: Rethinking Time Series Transformers through Representation Capacity Analysis and Progressive Decoding

    Oct 27, 2026Peiwang Tang, Cheng HE, Xijie Liang +1Multivariate Time Series ForecastingTime Series Forecasting

  2. SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

    Sep 17, 2026Abraham Ezema, Chijioke Eze, Ferdinanda Ponci +1Multivariate Time Series ForecastingLong-Term Time Series Forecasting

  3. Hopformer: Homogeneity-Pursuit Transformer for Time Series Forecasting

    Jul 24, 2026Wan Zhang, Qinjie Lin, Chan Lee +3Multivariate Time Series ForecastingTime Series Forecasting