cs.LGFeb 8, 2026

CausalCompass: Evaluating the Robustness of Time-Series Causal Discovery in Misspecified Scenarios

Authors: Huiyang Yi, Xiaojian Shen, Yonggang Wu, Duxin Chen, He Wang, Wenwu Yu

Organizations: Southeast University, Nanjing, China · Jilin University, Changchun, China

Abstract

Causal discovery from time series is a fundamental task in machine learning. However, its widespread adoption is hindered by a reliance on untestable causal assumptions and by the lack of robustness-oriented evaluation in existing benchmarks. To address these challenges, we propose CausalCompass, a flexible and extensible benchmark framework designed to assess the robustness of time-series causal discovery (TSCD) methods under violations of modeling assumptions. To demonstrate the practical utility of CausalCompass, we conduct extensive benchmarking of representative TSCD algorithms across eight assumption-violation scenarios. Our experimental results indicate that no single method consistently attains optimal performance across all settings. Nevertheless, in most scenarios, the methods exhibiting superior overall performance are deep learning-based approaches. We further provide hyperparameter sensitivity analyses to deepen the understanding of these findings. We additionally conduct ablation experiments to explain the strong performance of deep learning-based methods under assumption violations. We also find that NTS-NOTEARS relies on standardized preprocessing in practice, performing poorly in the vanilla setting but exhibiting strong performance after standardization. Finally, our work aims to provide a comprehensive and systematic evaluation of TSCD methods under assumption violations, thereby facilitating their broader adoption in real-world applications. The user-friendly implementation, documentation and datasets are available at https://github.com/huiyang-yi/CausalCompass.

Figures & tables

Appendix figures & tables17 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. TCD-Arena: Assessing Robustness of Time Series Causal Discovery Methods Against Assumption Violations

    May 4, 2026Gideon Stein, Niklas Penzel, Tristan Piater +1Time-Series Causal DiscoveryCausal Discovery

  2. Causal-Audit: A Framework for Risk Assessment of Assumption Violations in Time-Series Causal Discovery

    Apr 2, 2026Marco Ruiz, Miguel Arana-Catania, David R. Ardila +1Time-Series Causal DiscoveryCausal Discovery

  3. One Thing Leads to Another: The Essentials of Time Series Causal Discovery

    Oct 9, 2026Kurt Butler, Damian Machlanski, Michael P. J. Camilleri +5Time-Series Causal DiscoveryCausal Discovery