Overview

Time Series Transformers apply attention to ordered observations, helping model patterns over time and relationships among multiple variables for forecasting, classification, and anomaly detection. Common approaches use patches, separate temporal and channel-wise attention, or add frequency, spatial, and domain-specific structure; pretrained foundation models also aim to transfer across datasets and tasks. Work increasingly addresses long and irregular sequences, uncertainty, and efficient inference through sparse attention, adaptive tokenization, and hybrid architectures. A central tension is that added complexity does not guarantee better accuracy or generalization: performance depends on the data, forecast horizon, preprocessing, and evaluation, and simple statistical or smaller neural models can remain competitive.

Latest papers

CardsList

151 papers11 papers in the last four weeks, down 21% on the four weeks before. 0.1% of all new papers.

  1. Which Past Matters? Training History and Multi-Forecast Horizon in Equity Transformers

    Nov 17, 2026Chariton ChalvatzisStock Price ForecastingTime Series Forecasting

  2. A plug-in energy-balance freezing module for transformer frost nowcasting without leaf-sensor inputs

    Nov 15, 2026Juyeon Kim, Chaeyeon Yi, Yun Am SeoPhysics-Informed ForecastingPhysics-Informed ML

  3. Conditional Asset Pricing Transformer

    Nov 15, 2026Hao Fu, Xinbing Kong, Zeyu Li +1Quantitative FinanceFinancial Forecasting

  4. Short-Term Forecasting of Heterogeneous Wind Power Fleets: Global Temporal Fusion Transformer Leveraging Static Covariates

    Nov 4, 2026Viktor Walter, Andreas WagnerWind Power ForecastingTime Series Forecasting

  5. Learning From Static Context in Federated Time Series Forecasting

    Nov 4, 2026Viktor Walter, Andreas Wagner, Fabian StrickerTime Series ForecastingFederated Learning Aggregation

  6. Investigating the effects of the patch size in Time Series Foundation Models

    Nov 2, 2026Jad Yehya, Andrei-Tiberiu Pantea, Aymeric Dieuleveut +2Patch-Based Time Series ModelingTime-Series Foundation Models

  7. RATSIFT: Resolution-Adaptive Transformer for Solar Irradiance Forecasting and Temporal Downscaling

    Nov 1, 2026Jesto Peter, Timothy M. Hansen, Hossein Moradi RekabdarkolaeeSolar Irradiance ForecastingMultiscale Time-Series Modeling

  8. RankFormer: Rethinking Time Series Transformers through Representation Capacity Analysis and Progressive Decoding

    Oct 27, 2026Peiwang Tang, Cheng HE, Xijie Liang +1Multivariate Time Series ForecastingTime Series Forecasting

  9. Learning from Points and Patches: A Pre-trained Hybrid Attention Transformer for Time Series Analysis

    Oct 27, 2026Peiwang Tang, Cheng HE, Yupeng Ye +3Self-Supervised Time Series Representation LearningTime Series Transformers

  10. LEAP: a Latent Embedding Anomaly Patch-Transformer for time-series anomaly detection

    Oct 26, 2026Cristhian Moya-Mota, Ignacio Aguilera-Martos, Diego García-Gil +1Time-Series Anomaly DetectionUnsupervised Anomaly Detection

  11. Extreme Low-State Quantized Transformer for Electricity-Load Forecasting

    Oct 20, 2026Muhammad Sabbir Alam, Harindra Sandun Mavikumbure, Victor Cobilean +2Low-Bit QuantizationQuantization-Aware Training

  12. Beyond Static Positional Encoding: Bayesian Time-aware Attention for Non-Stationary Long-term Time Series Forecasting

    Oct 14, 2026Xinjie Lan, Yunbo Mei, Leheng Zhou +1Long-Term Time Series ForecastingNon-Stationary Time Series Forecasting

  13. Cross-Market Meta-Learning for Electricity Price Forecasting

    Oct 12, 2026Delaram Pirhayatifard, Terrence AlsupElectricity Price ForecastingTime Series Forecasting

  14. Probabilistic Ship Trajectory Forecasting using Transformer Models on AIS Data

    Oct 9, 2026Frederik E. T. SchöllerVessel Trajectory PredictionProbabilistic Forecasting

  15. Timer-M1: A Multivariate Time Series Foundation Model via Learning Primitives

    Oct 8, 2026Haoran Zhang, Haixuan Liu, Xingjian Su +5Multivariate Time Series ForecastingTime-Series Foundation Models

  16. DSTNet: Dynamic Spectral Trajectory Network for Causal Multi-Horizon Financial Forecasting

    Oct 7, 2026Aashish Bohra, Lokendra VishwakarmFinancial ForecastingTime Series Forecasting

  17. Transformer-Based Time-Series Inference of Lindblad Dynamics in Open Quantum Systems

    Oct 5, 2026Julian Guam, Jianqing LiuQuantum System IdentificationSystem Identification

  18. STCFormer: Adaptive Spatio-Temporal Modeling with Dynamic Cluster Transformer for Station-based Weather Forecasting

    Sep 30, 2026Rongwen Li, Haixin Xie, Mingyang Wang +5Multivariate Time Series ForecastingClustering

  19. Association profile conditioning in a set-temporal transformer for cross-session intracortical motor decoding

    Sep 30, 2026Xinyuan Zhang, Handong Mo, Pengfei Wen +5Set TransformerTransformer

  20. Universality and Generalization of Causal Transformers Across Context Lengths

    Sep 28, 2026Takashi Furuya, Maarten V. de Hoop, Gabriel PeyréNeural Network GeneralizationTransformer Expressivity

  21. Progressive Memory Transformer: Memory-Aware Attention for Time-Series

    Sep 25, 2026Tord Sture Stangeland, Andreas Köhler, Steffen Mæland +1Self-Supervised Time Series Representation LearningTemporal Representation Learning

  22. AI-based detection of worsening heart failure from low-resolution telemonitoring data

    Sep 24, 2026Erik Aerts, Yinan Yu, Annika Rosengren +5Remote Patient MonitoringTime Series Transformers

  23. Evaluating Accuracy and Probabilistic Reliability of Zero-Shot Time Series Foundation Models

    Sep 22, 2026Panagiotis Michael, Moysis Symeonides, Demetris TrihinasZero-Shot Time Series ForecastingTime Series Transformers

  24. Benchmarking Hybrid Deep Learning Architectures for Predictive Maintenance in Industry 4.0

    Sep 18, 2026Zhengyang, Gu, Joseph E. Hernandez +4Hybrid Transformer ArchitecturesPredictive Maintenance

  25. A Lightweight Plug-in Gate for Transformer-Based Time-Series Forecasters

    Sep 17, 2026Hongkai Zhuang, Tao Huang, Chen HouTime Series ForecastingTime Series Transformers

  26. SETTer: Sparse-Encoder Transformer for Long-term Multivariate Time Series Forecasting

    Sep 17, 2026Abraham Ezema, Chijioke Eze, Ferdinanda Ponci +1Multivariate Time Series ForecastingLong-Term Time Series Forecasting

  27. On the role of the tokenizer in ECG transformer models

    Sep 14, 2026Jiawei Li, Fabio Bonassi, Johan Sundström +2Electrocardiogram ClassificationTime Series Transformers