Learning Good Interventions in Causal Graphs via Covering
Not on the map. Why?
Abstract (arXiv)
We study the causal bandit problem that entails identifying a near-optimal intervention from a specified set A of (possibly non-atomic) interventions over a given causal graph. Here, an optimal intervention in A is one that maximizes the expected value for a designated reward variable in the graph, and we use the standard notion of simple regret to quantify near optimality. Considering Bernoulli random variables and for causal graphs on N vertices with constant in-degree, prior work has achieved a worst case guarantee of widetildeO (N/√T) for simple regret. The current work utilizes the idea of covering interventions (which are not necessarily contained within A) and establishes a simple regret guarantee of widetildeO(√N/T). Notably, and in contrast to prior work, our simple regret bound depends only on explicit parameters of the problem instance. We also go beyond prior work and achieve a simple regret guarantee for causal graphs with unobserved variables. Further, we perform experiments to show improvements over baselines in this setting.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 8 May 2023.
Builds on
12 of 33 references.
References · 12
- 2017Minimax Regret Bounds for Reinforcement Learningcited by 503
- 2019Introduction to Multi-Armed Banditscited by 481
- 2016Causal Bandits: Learning Good Interventions via Causal Inferencecited by 101
- 2017Identifying Best Interventions through Online Importance Samplingcited by 39
- 2020Budgeted and Non-budgeted Causal Banditscited by 38
- 2021Causal Bandits with Unknown Graph Structurecited by 37
- 2018Learning and Testing Causal Models with Interventionscited by 29
- 2016Contextual Bandits with Latent Confounders: An NMF Approachcited by 26
- 2018Causal Bandits with Propagating Inferencecited by 23
- 2022Causal Bandits for Linear Structural Equation Modelscited by 19
- 2021A Causal Bandit Approach to Learning Good Atomic Interventions in Presence of Unobserved Confounderscited by 15
- 2022Combinatorial Pure Exploration of Causal Banditscited by 9
Built on by
Citing papers per year: 2024: 4; 2025: 1.
5 papers.
- 2024Causal Bandits with General Causal Models and Interventionscited by 7
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventionscited by 5
- 2024Improved Bound for Robust Causal Bandits with Linear Modelscited by 2
- 2025The Minimal Search Space for Conditional Causal Banditscited by 1
- 2024Learning Mixtures of Unknown Causal Interventionscited by 0
- 2025The Minimal Search Space for Conditional Causal Bandits10 Feb 2025
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventions4 Nov 2024
- 2024Learning Mixtures of Unknown Causal Interventions31 Oct 2024
- 2024Improved Bound for Robust Causal Bandits with Linear Models13 May 2024
- 2024Causal Bandits with General Causal Models and Interventions1 Mar 2024