Causal Bandit

Causal bandits address the problem of sequentially selecting interventions in a system governed by causal relationships to maximize cumulative reward, aiming to learn optimal intervention strategies efficiently. Current research focuses on developing algorithms that adapt to unknown causal structures, often employing linear models or generalized linear models, and addressing challenges like non-stationarity, hidden confounders, and budgeted interventions. This field is significant for its potential to improve decision-making in various applications, from personalized recommendations to optimizing complex systems where understanding and manipulating causal effects is crucial. Recent work emphasizes achieving near-optimal regret bounds while handling model uncertainty and diverse intervention types.

Papers

November 6, 2024

Partial Structure Discovery is Sufficient for No-regret Learning in Causal Bandits
Muhammad Qasim Elahi, Mahsa Ghasemi, Murat Kocaoglu
Causal Discovery Causal Graph Bandit Algorithm Causal Bandit Structure Discovery Regret Learning

November 4, 2024

Linear Causal Bandits: Unknown Graph and Soft Interventions
Zirui Yan, Ali Tajer
Causal Graph Unseen Graph Causal Bandit Interventional Data Optimal Intervention Soft Intervention

August 20, 2024

Asymmetric Graph Error Control with Low Complexity in Causal Bandits
Chen Peng, Di Zhang, Urbashi Mitra
Causal Graph Causal Structure Non Stationary Error Feedback Low Complexity Structural Causal Causal Bandit

July 1, 2024

Causal Bandits: The Pareto Optimal Frontier of Adaptivity, a Reduction to Linear Bandits, and Limitations around Unknown Marginals
Ziyi Liu, Idan Attias, Daniel M. Roy
Multi Armed Bandit Adaptive Importance Causal Structure Linear Bandit Marginal Distribution Minimax Regret Pareto Frontier Causal Bandit

May 28, 2024

Causal Contextual Bandits with Adaptive Context
Rahul Madhavan, Aurghya Maiti, Gaurav Sinha, Siddharth Barman
Regret Guarantee Causal Bandit Instance Level Causal

May 13, 2024

Improved Bound for Robust Causal Bandits with Linear Models
Zirui Yan, Arpan Mukherjee, Burak Varıcı, Ali Tajer
Causal Model Cumulative Regret Linear Model Sub Linear Regret Minimax Regret Causal Bandit Improved Bound

March 1, 2024

Causal Bandits with General Causal Models and Interventions
Zirui Yan, Dennis Wei, Dmitriy Katz-Rogozhnikov, Prasanna Sattigeri, Ali Tajer
Causal Structure Structural Causal Model Cumulative Regret Health Intervention Causal Bandit

January 15, 2024

Confounded Budgeted Causal Bandits
Fateme Jamshidi, Jalal Etesami, Negar Kiyavash
Multi Armed Bandit Causal Graph Cumulative Regret Causal Bandit

October 30, 2023

Robust Causal Bandits for Linear Models
Zirui Yan, Arpan Mukherjee, Burak Varıcı, Ali Tajer
Cumulative Regret Linear Model Sub Linear Regret Minimax Regret Causal Bandit

June 13, 2023

Additive Causal Bandits with Unknown Graph
Alan Malek, Virginia Aglietti, Silvia Chiappa
Causal Graph Linear Bandit Bandit Feedback Causal Bandit Unseen Graph

May 9, 2023

Learning Personalized Page Content Ranking Using Customer Representation
Xin Shen, Yan Zhao, Sujan Perera, Yujia Liu, Jinyun Yan, Mitchell Goodman
Movie Recommendation Customer Service Bandit Algorithm Causal Bandit Customer Behavior

May 8, 2023

Learning Good Interventions in Causal Graphs via Covering
Ayush Sawarni, Rahul Madhavan, Gaurav Sinha, Siddharth Barman
Causal Graph Regret Guarantee Causal Bandit Optimal Intervention Intervention Based Learning

January 31, 2023

Combinatorial Causal Bandits without Graph Skeleton
Shi Feng, Nuoya Xiong, Wei Chen
Causal Graph Causal Bandit Skeleton Graph

January 26, 2023

Causal Bandits without Graph Learning
Mikhail Konobeev, Jalal Etesami, Negar Kiyavash
Causal Graph Graph Learning Regret Bound Efficient Algorithm Reward Structure Causal Bandit

August 26, 2022

Causal Bandits for Linear Structural Equation Models
Burak Varici, Karthikeyan Shanmugam, Prasanna Sattigeri, Ali Tajer
Cumulative Regret Structural Equation Causal Bandit Causal Graphical Model

June 16, 2022

Combinatorial Pure Exploration of Causal Bandits
Nuoya Xiong, Wei Chen
Causal Bandit Adaptive Exploration Combinatorial Pure Exploration

June 4, 2022

Combinatorial Causal Bandits
Shi Feng, Wei Chen
Causal Inference Causal Structure Generalized Linear Model Causal Bandit

February 10, 2022

Adaptively Exploiting d-Separators with Causal Bandits
Blair Bilodeau, Linbo Wang, Daniel M. Roy
Multi Armed Bandit Optimal Regret Minimax Optimization Causal Bandit Multi Separator Problem

December 3, 2021

Chronological Causal Bandits
Neil Dhir
Multi Armed Bandit Decision Making Causal Bandit Monoclonal Antibody