cs.LGNov 10, 2026

Generalizing Causal Decision-Making: Markov Equivalence, Transportability and Counterfactuals

Authors: Min Woo Park, Sanghack Lee

Organizations: Seoul National University Seoul, Republic of Korea

Abstract

Structural causal bandits use causal knowledge to guide exploration when reward mechanisms are unknown. This paper extends the approach to partially known causal structure, information from other environments, and realizable counterfactual actions. First, we develop graphical criteria for minimal intervention sets under Markov equivalence and characterize possibly-optimal minimal intervention sets for maximal ancestral graphs. A search algorithm finds sets that are possibly optimal in at least one graph represented by a partial ancestral graph. Second, we derive target reward bounds from source distributions through partial transportability, accounting for non-manipulable variables. Dominance relations provide further bounds for action pruning and restricted exploration, with a regret guarantee under valid prior bounds. Third, we formulate counterfactual structural causal bandits over actions supported by specified experimental capabilities. Graphical characterizations of minimality and possible optimality yield algorithms that remove equivalent or dominated choices while preserving an optimal action. Experiments with specified structural causal models examine how these reductions and transferred bounds affect learning. Together, these results clarify how causal knowledge and experimental capabilities determine which actions merit exploration and guide learning within the retained action space.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Minimal Search Space for Conditional Causal Bandits

    Feb 10, 2025Francisco N. F. Q. Simoes, Itai Feigenbaum, Mehdi Dastani +1Multi-Armed BanditsCausal Bandits

  2. Minimax Optimal Regret for Causal Logistic Bandits with Counterfactual Fairness

    Oct 1, 2026Junhyuk Huh, Seoungbin Bae, Dabeen LeeMulti-Armed BanditsMinimax Regret

  3. Information-Directed Sampling for Causal Bandits

    Jul 17, 2026Muhammad Qasim Elahi, Murat Kocaoglu, Mahsa GhasemiThompson SamplingMulti-Armed Bandits