Asynchronous Batch Bayesian Optimisation with Improved Local Penalisation
Not on the map. Why?
Abstract (arXiv)
Batch Bayesian optimisation (BO) has been successfully applied to hyperparameter tuning using parallel computing, but it is wasteful of resources: workers that complete jobs ahead of others are left idle. We address this problem by developing an approach, Penalising Locally for Asynchronous Bayesian Optimisation on k workers (PLAyBOOK), for asynchronous parallel BO. We demonstrate empirically the efficacy of PLAyBOOK and its variants on synthetic tasks and a real-world problem. We undertake a comparison between synchronous and asynchronous BO, and show that asynchronous BO often outperforms synchronous batch BO in both wall-clock time and number of function evaluations.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 0; 2024: 2; 2025: 1; 2026: 4.
17 papers.
Sort:
- 2021GIBBON: General-purpose Information-Based Bayesian OptimisatioNcited by 47
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2022Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scalecited by 13
- 2025LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithmscited by 10
- 2021A portfolio approach to massively parallel Bayesian optimizationcited by 9
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
- 2021DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecturecited by 6
- 2022Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimizationcited by 6
- 2022A penalisation method for batch multi-objective Bayesian optimisation with application in heat exchanger designcited by 5
- 2022Batch Bayesian Optimization via Particle Gradient Flowscited by 2
- 2024A Unified Gaussian Process for Branching and Nested Hyperparameter Optimizationcited by 0
5 more
- 2024Scalable Batch Bayesian Optimization Via Subspace Acquisition Functionscited by 0
- 2026Standard Acquisition Is Sufficient for Asynchronous Bayesian Optimizationcited by 0
- 2026ALMAB-DC: Active Learning, Multi-Armed Bandits, and Distributed Computing for Sequential Experimental Design and Black-Box Optimizationcited by 0
- 2026mlr3mbo: Bayesian Optimization in Rcited by 0
- 2026Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does notcited by 0
- 2026Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does not12 May 2026
- 2026mlr3mbo: Bayesian Optimization in R31 Mar 2026
- 2026ALMAB-DC: Active Learning, Multi-Armed Bandits, and Distributed Computing for Sequential Experimental Design and Black-Box Optimization22 Mar 2026
- 2026Standard Acquisition Is Sufficient for Asynchronous Bayesian Optimization13 Mar 2026
- 2025LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithms27 May 2025
- 2024Scalable Batch Bayesian Optimization Via Subspace Acquisition Functions25 Nov 2024
- 2024A Unified Gaussian Process for Branching and Nested Hyperparameter Optimization19 Jan 2024
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization11 Nov 2022
- 2022Batch Bayesian Optimization via Particle Gradient Flows10 Sep 2022
- 2022Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization1 Jul 2022
- 2022A penalisation method for batch multi-objective Bayesian optimisation with application in heat exchanger design27 Jun 2022
- 2022SnAKe: Bayesian Optimization with Pathwise Exploration31 Jan 2022
5 more
- 2022Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scale18 Jan 2022
- 2021A portfolio approach to massively parallel Bayesian optimization18 Oct 2021
- 2021DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture13 Sep 2021
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL30 Jun 2021
- 2021GIBBON: General-purpose Information-Based Bayesian OptimisatioN5 Feb 2021
- 2021GIBBON: General-purpose Information-Based Bayesian OptimisatioNcited by 47
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimizationcited by 16
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2022Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scalecited by 13
- 2025LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithmscited by 10
- 2021A portfolio approach to massively parallel Bayesian optimizationcited by 9
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
- 2021DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecturecited by 6
- 2022Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimizationcited by 6
- 2022A penalisation method for batch multi-objective Bayesian optimisation with application in heat exchanger designcited by 5
- 2022Batch Bayesian Optimization via Particle Gradient Flowscited by 2
- 2024A Unified Gaussian Process for Branching and Nested Hyperparameter Optimizationcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Efficient Conditioning Why Pseudo Observation Batch Bayesian Optimization Works When It Does not12 May 2026
- 2026mlr3mbo: Bayesian Optimization in R31 Mar 2026
- 2026ALMAB-DC: Active Learning, Multi-Armed Bandits, and Distributed Computing for Sequential Experimental Design and Black-Box Optimization22 Mar 2026
- 2026Standard Acquisition Is Sufficient for Asynchronous Bayesian Optimization13 Mar 2026
- 2025LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithms27 May 2025
- 2024Scalable Batch Bayesian Optimization Via Subspace Acquisition Functions25 Nov 2024
- 2024A Unified Gaussian Process for Branching and Nested Hyperparameter Optimization19 Jan 2024
- 2022Combining Multi-Fidelity Modelling and Asynchronous Batch Bayesian Optimization11 Nov 2022
- 2022Batch Bayesian Optimization via Particle Gradient Flows10 Sep 2022
- 2022Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization1 Jul 2022
- 2022A penalisation method for batch multi-objective Bayesian optimisation with application in heat exchanger design27 Jun 2022
- 2022SnAKe: Bayesian Optimization with Pathwise Exploration31 Jan 2022
12 newest of 17 All 17 (JSON)