Step-DAD: Semi-Amortized Policy-Based Bayesian Experimental Design
Not on the map. Why?
Abstract (arXiv)
We develop a semi-amortized, policy-based, approach to Bayesian experimental design (BED) called Stepwise Deep Adaptive Design (Step-DAD). Like existing, fully amortized, policy-based BED approaches, Step-DAD trains a design policy upfront before the experiment. However, rather than keeping this policy fixed, Step-DAD periodically updates it as data is gathered, refining it to the particular experimental instance. This test-time adaptation improves both the flexibility and the robustness of the design strategy compared with existing approaches. Empirically, Step-DAD consistently demonstrates superior decision-making and robustness compared with current state-of-the-art BED methods.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 37 of its 80 references that are in the map. First posted on arXiv 18 Jul 2025.
Builds on
37 of 80 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
- 2017Deep Setscited by 1,421
- 2020MOPO: Model-based Offline Policy Optimizationcited by 636
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
- 2023Efficient Online Reinforcement Learning with Offline Datacited by 363
- 2019Monte Carlo Gradient Estimation in Machine Learningcited by 283
- 2022Online Decision Transformercited by 196
- 2022Hybrid RL: Using Both Offline and Online Data Can Make RL Efficientcited by 161
- 2023Modern Bayesian Experimental Designcited by 125
- 2019Variational Bayesian Optimal Experimental Designcited by 116
25 more
- 2021Deep Adaptive Design: Amortizing Sequential Bayesian Experimental Designcited by 106
- 2017On Nesting Monte Carlo Estimatorscited by 83
- 2016Likelihood-free inference by ratio estimationcited by 81
- 2021On Statistical Bias In Active Learning: How and When To Fix Itcited by 75
- 2013Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizationscited by 70
- 2021Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoodscited by 61
- 2019A Unified Stochastic Gradient Approach to Designing Bayesian-Optimal Experimentscited by 58
- 2020Bayesian Experimental Design for Implicit Models by Mutual Information Neural Estimationcited by 56
- 2022Optimizing Sequential Experimental Design with Deep Reinforcement Learningcited by 46
- 2021Bayesian decision-making under misspecified priors with applications to meta-learningcited by 44
- 2018Efficient Bayesian Experimental Design for Implicit Modelscited by 34
- 2016Sequential Bayesian optimal experimental design via approximate dynamic programmingcited by 28
- 2021Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Boundscited by 27
- 2021Bayesian Sequential Optimal Experimental Design for Nonlinear Models Using Policy Gradient Reinforcement Learningcited by 24
- 2020Sequential Bayesian Experimental Design for Implicit Models via Mutual Informationcited by 23
- 2024Amortized Bayesian Experimental Design for Decision-Makingcited by 21
- 2022Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Modelscited by 16
- 2022Robust Expected Information Gain for Optimal Bayesian Experimental Design Using Ambiguity Setscited by 12
- 2024Nesting Particle Filters for Experimental Design in Dynamical Systemscited by 12
- 2024Bayesian Experimental Design via Contrastive Diffusionscited by 11
- 2018Bayesian design of experiments for intractable likelihood models using coupled auxiliary models and multivariate emulationcited by 10
- 2019Bayesian decision-theoretic design of experiments under an alternative modelcited by 8
- 2022Characterizing the robustness of Bayesian adaptive experimental designs to active learning biascited by 8
- 2024PASOA- PArticle baSed Bayesian Optimal Adaptive designcited by 5
- 2024Recursive Nested Filtering for Efficient Amortized Bayesian Experimental Designcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 9.
12 papers.
- 2025BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Designcited by 24
- 2025JADAI: Jointly Amortizing Adaptive Design and Bayesian Inferencecited by 4
- 2025A Geometric Approach to Optimal Experimental Designcited by 3
- 2026Constrained Bayesian Experimental Design via Online Planningcited by 2
- 2026Efficient Adaptive Data Acquisition via Pretrained Belief Representationscited by 2
- 2026Bayesian Experimental Design via Score Matchingcited by 1
- 2026Sequential Design of Genetic Circuits Under Uncertainty With Reinforcement Learningcited by 0
- 2026Goal-driven Bayesian Optimal Experimental Design for Robust Decision-Making Under Model Uncertaintycited by 0
- 2026Can In-Context Learning Support Intrinsic Curiosity?cited by 0
- 2026FairBED: A Bayesian Experimental Design Approach to Gathering Fairer Datacited by 0
- 2026NeuronSifter: An Agent-in-Twin for Prioritizing Central Nervous System Interventions with World Action Modelscited by 0
- 2026Information-theoretic receding-horizon active learning of nonlinear dynamical systemscited by 0
- 2026Information-theoretic receding-horizon active learning of nonlinear dynamical systems29 Sep 2026
- 2026NeuronSifter: An Agent-in-Twin for Prioritizing Central Nervous System Interventions with World Action Models28 Sep 2026
- 2026Bayesian Experimental Design via Score Matching9 Jul 2026
- 2026Efficient Adaptive Data Acquisition via Pretrained Belief Representations23 Jun 2026
- 2026FairBED: A Bayesian Experimental Design Approach to Gathering Fairer Data22 Jun 2026
- 2026Can In-Context Learning Support Intrinsic Curiosity?17 Jun 2026
- 2026Constrained Bayesian Experimental Design via Online Planning26 May 2026
- 2026Goal-driven Bayesian Optimal Experimental Design for Robust Decision-Making Under Model Uncertainty25 May 2026
- 2026Sequential Design of Genetic Circuits Under Uncertainty With Reinforcement Learning7 May 2026
- 2025JADAI: Jointly Amortizing Adaptive Design and Bayesian Inference28 Dec 2025
- 2025A Geometric Approach to Optimal Experimental Design16 Oct 2025
- 2025BED-LLM: Intelligent Information Gathering with LLMs and Bayesian Experimental Design28 Aug 2025