mlsanityData to 13 Oct 2026

Transferring Information Across Interventions in Causal Bayesian Optimization

arXiv 2606.01457 ↗First posted 31 May 2026cs.AI cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Bayesian optimization is a popular way to optimize expensive systems, where every experiment, simulation, or intervention costs time or money. In its standard form, it treats the variables we control as plain inputs to a black box and cannot tell apart mere correlation from a real cause and effect. Causal Bayesian optimization closes part of this gap by using a known causal graph together with observational data to decide which variables are worth intervening on. Existing methods, however, learn the effect of each possible intervention almost in isolation, even though in a causal system these effects usually share the same underlying mechanisms. We propose graph-coupled causal Bayesian optimization, which ties the different intervention effects together through the uncertainty we have about a small set of shared causal parameters. The result is a causal kernel that lets evidence collected from one intervention improve our estimate of related interventions. For identifiable linear Gaussian causal models, we show that this kernel has low rank, bounded by the number of shared parameters rather than by the size of the intervention menu. This in turn yields an information-gain bound that grows only logarithmically in the optimization horizon, and a regret bound that cleanly separates three sources of error: optimization, causal estimation, and the choice of which intervention sets to consider. We also describe nonlinear and adaptive extensions. Across theory-aligned Gaussian systems, shared-mechanism stress tests, and standard causal optimization benchmarks, the method keeps the benefits of causal Bayesian optimization while transferring information across related interventions, with the clearest gains when direct interventions on the target's parents are unavailable and sparse interventional data must be reused across a large family of candidate interventions.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

23 of 33 references.

References · 23

  1. 2018A Tutorial on Bayesian Optimizationcited by 739
  2. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 177
  3. 2020On Information Gain and Regret Bounds in Gaussian Process Banditscited by 156
  4. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 140
  5. 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 115
  6. 2015Bayesian optimization for materials designcited by 79
  7. 2021YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimizationcited by 61
  8. 2021Misspecified Gaussian Process Bandit Optimizationcited by 53
  9. 2021Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domainscited by 47
  10. 2021Neural Contextual Bandits without Regretcited by 40
  11. 2020Causal Bayesian Optimizationcited by 39
  12. 2022Thinking inside the box: A tutorial on grey-box Bayesian optimizationcited by 26
11 more
  1. 2024Cost-aware Bayesian Optimization via the Pandora's Box Gittins Indexcited by 16
  2. 2022Regret Bounds for Expected Improvement Algorithms in Gaussian Process Bandit Optimizationcited by 14
  3. 2022Causal Entropy Optimizationcited by 13
  4. 2025Improved Regret Bounds for Gaussian Process Upper Confidence Bound in Bayesian Optimizationcited by 13
  5. 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximationcited by 8
  6. 2023Constrained Causal Bayesian Optimizationcited by 6
  7. 2023Functional Causal Bayesian Optimizationcited by 5
  8. 2023Adversarial Causal Bayesian Optimizationcited by 4
  9. 2024Causal Bayesian Optimization via Exogenous Distribution Learningcited by 3
  10. 2026Multi-Objective Multi-Fidelity Bayesian Optimization with Causal Priorscited by 2
  11. 2026Extending Multi-Source Bayesian Optimization With Causality Principlescited by 1

Built on by

Not cited yet.