cs.LGFeb 6, 2026

DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters

Authors: Haoran Zhang, Haixuan Liu, Yong Liu, Yunzhong Qiu, Yuxuan Wang, Jianmin Wang, Mingsheng Long

Organizations: School of Software, BNRist, Tsinghua University

Abstract

While generative modeling facilitates probabilistic time series forecasting, incorporating heterogeneous exogenous information remains challenging. Diffusion Transformers (DiT) provide a scalable framework for conditional generation, yet their adaptation to forecasting calls for conditioning mechanisms tailored to time series. Endogenous targets and exogenous covariates differ in sources, semantics, and statistical characteristics, while sharing temporal coordinates that support fine-grained conditional guidance. Covariates can describe future variability and temporal dependence beyond the conditional mean targeted by direct regression. Motivated by these considerations, we propose Diffusion Transformers for Time Series (DiTS), a Multimodal Diffusion Transformer for covariate-aware forecasting. DiTS models endogenous targets and exogenous covariates as distinct modalities, jointly conditioning future generation on target history and available covariates. Flow matching makes covariate-dependent distributional information relevant to velocity prediction conditioned on noisy future states. We introduce Time-aligned Modulation, extending AdaLN with the temporal-alignment prior to generate patch-wise modulation parameters from aligned covariates and diffusion time. Across diverse covariate-aware forecasting tasks, DiTS achieves strong performance in both deterministic and probabilistic forecasting, demonstrating the effectiveness of conditional generation for both point and distributional forecasting.

Explore similar work

CardsList
  1. ReDiTT: Retrieval Augmented Conditional Diffusion Transformers for Asynchronous Time Series

    Jul 14, 2026Saiyue Lyu, Zhitian Zhang, Ruizhi Deng +1Long-Horizon ForecastingDiffusion Transformers

  2. DynG-Diff: A State-Aware Dynamic Guidance Diffusion Framework for Probabilistic Time Series Forecasting

    Sep 2, 2026Zhente Zhang, Zhengwei Ni, Wei FanMultivariate Time Series ForecastingProbabilistic Forecasting

  3. QiYao-M: Multimodal Time Series Foundation Model with Role-Aware Modeling of Endogenous and Exogenous Modalities

    Sep 28, 2026Hanyin Cheng, Linfeng Wang, Zhengbo Qu +7Time Series Foundation ModelsMultimodal Classification