Graph Learning Is Suboptimal in Causal Bandits
Not on the map. Why?
Abstract (arXiv)
We study regret minimization in causal bandits under causal sufficiency where the underlying causal structure is not known to the agent. Previous work has focused on identifying the reward's parents and then applying classic bandit methods to them, or jointly learning the parents while minimizing regret. We investigate whether such strategies are optimal. Somewhat counterintuitively, our results show that learning the parent set is suboptimal. We do so by proving that there exist instances where regret minimization and parent identification are fundamentally conflicting objectives. We further analyze both the known and unknown parent set size regimes, establish novel regret lower bounds that capture the combinatorial structure of the action space. Building on these insights, we propose nearly optimal algorithms that bypass graph and parent recovery, demonstrating that parent identification is indeed unnecessary for regret minimization. Experiments confirm that there exists a large performance gap between our method and existing baselines in various environments.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 19 Oct 2025.
Builds on
33 of 52 references.
References · 33
- 2021D'ya like DAGs? A Survey on Structure Learning and Causal Discoverycited by 211
- 2015Multi-armed Bandit Models for the Optimal Design of Clinical Trials: Benefits and Challengescited by 114
- 2016Causal Bandits: Learning Good Interventions via Causal Inferencecited by 101
- 2015Online Learning with Feedback Graphs: Beyond Banditscited by 80
- 2022Greedy Relaxations of the Sparsest Permutation Algorithmcited by 64
- 2014Nonstochastic Multi-Armed Bandits with Graph-Structured Feedbackcited by 61
- 2019A Survey on Practical Applications of Multi-Armed and Contextual Banditscited by 45
- 2017Identifying Best Interventions through Online Importance Samplingcited by 39
- 2020Budgeted and Non-budgeted Causal Banditscited by 38
- 2021Causal Bandits with Unknown Graph Structurecited by 37
- 2022Revisiting Simple Regret: Fast Rates for Returning a Good Armcited by 25
- 2018Causal Bandits with Propagating Inferencecited by 23
21 more
- 2022Causal Bandits for Linear Structural Equation Modelscited by 19
- 2022Adaptively Exploiting d-Separators with Causal Banditscited by 18
- 2020On Regret with Multiple Best Armscited by 16
- 2022Combinatorial Causal Banditscited by 16
- 2024Recursive Causal Discoverycited by 12
- 2023Causal Bandits without Graph Learningcited by 10
- 2023Additive Causal Bandits with Unknown Graphcited by 10
- 2024Multi-Armed Bandits with Interferencecited by 10
- 2019Polynomial Cost of Adaptation for X -Armed Banditscited by 9
- 2022Combinatorial Pure Exploration of Causal Banditscited by 9
- 2023Combinatorial Causal Bandits without Graph Skeletoncited by 7
- 2024Linear Causal Bandits: Unknown Graph and Soft Interventionscited by 5
- 2024Partial Structure Discovery is Sufficient for No-regret Learning in Causal Banditscited by 5
- 2025Pure Exploration Beyond Reward Feedback: The Role of Post-Action Contextcited by 5
- 2025Graph-Dependent Regret Bounds in Multi-Armed Bandits with Interferencecited by 5
- 2024Confounded Budgeted Causal Banditscited by 4
- 2024Causal Bandits: The Pareto Optimal Frontier of Adaptivity, a Reduction to Linear Bandits, and Limitations around Unknown Marginalscited by 2
- 2024Asymmetric Graph Error Control with Low Complexity in Causal Banditscited by 2
- 2024QWO: Speeding Up Permutation-Based Causal Discovery in LiGAMscited by 1
- 2025The Minimal Search Space for Conditional Causal Banditscited by 1
- 2025Recommendations with Sparse Comparison Data: Provably Fast Convergence for Nonconvex Matrix Factorizationcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.