Bayesian Optimization in AlphaGo
Not on the map. Why?
Abstract (arXiv)
During the development of AlphaGo, its many hyper-parameters were tuned with Bayesian optimization multiple times. This automatic tuning process resulted in substantial improvements in playing strength. For example, prior to the match with Lee Sedol, we tuned the latest AlphaGo agent and this improved its win-rate from 50% to 66.5% in self-play games. This tuned version was deployed in the final match. Of course, since we tuned AlphaGo many times during its development cycle, the compounded contribution was even higher than this percentage. It is our hope that this brief case study will be of interest to Go fans, and also provide Bayesian optimization practitioners with some insights and inspiration.
Key facts. Cited by 55 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 12; 2023: 14; 2024: 7; 2025: 6; 2026: 3.
55 papers.
Sort:
By area:
- 2021Well-tuned Simple Nets Excel on Tabular Datasetscited by 151
- 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 147
- 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 70
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 70
- 2022Joint Entropy Search for Maximally-Informed Bayesian Optimizationcited by 55
- 2021GIBBON: General-purpose Information-Based Bayesian OptimisatioNcited by 47
- 2021Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Searchcited by 34
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learningcited by 31
- 2021Active Offline Policy Selectioncited by 26
- 2023Self-Correcting Bayesian Optimization through Bayesian Active Learningcited by 22
- 2021Automatic Termination for Hyperparameter Optimizationcited by 21
- 2022Bayesian Generational Population-Based Trainingcited by 20
38 more
- 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
- 2023Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoMLcited by 16
- 2023PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspacescited by 15
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigmcited by 14
- 2024Bayesian Optimization via Continual Variational Last Layer Trainingcited by 13
- 2021Neural Process for Black-Box Model Optimization Under Bayesian Frameworkcited by 11
- 2022Automated Reinforcement Learning: An Overviewcited by 9
- 2022c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimizationcited by 9
- 2023OpenBox: A Python Toolkit for Generalized Black-box Optimizationcited by 9
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRLcited by 8
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processescited by 8
- 2021Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Accelerationcited by 7
- 2022Event-Triggered Time-Varying Bayesian Optimizationcited by 7
- 2022Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimatorcited by 7
- 2021Episodic Policy Gradient Trainingcited by 5
- 2022Bayesian Optimization For Multi-Objective Mixed-Variable Problemscited by 5
- 2023High-dimensional Bayesian Optimization with Group Testingcited by 5
- 2021Mixed Variable Bayesian Optimization with Frequency Modulated Kernelscited by 4
- 2023Dynamic Update-to-Data Ratio: Minimizing World Model Overfittingcited by 4
- 2023Python Tool for Visualizing Variability of Pareto Fronts over Multiple Runscited by 4
- 2024Generalized Population-Based Training for Hyperparameter Optimization in Reinforcement Learningcited by 4
- 2025Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learningcited by 4
- 2022Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimizationcited by 3
- 2023Stochastic Bayesian Optimization with Unknown Continuous Context Distribution via Kernel Density Estimationcited by 3
- 2024Adaptive Q-Network: On-the-fly Target Selection for Deep Reinforcement Learningcited by 3
- 2024A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapescited by 3
- 2021Achieving Real-Time Object Detection on MobileDevices with Neural Pruning Searchcited by 2
- 2023Python Wrapper for Simulating Multi-Fidelity Optimization on HPO Benchmarks without Any Waitcited by 2
- 2025Leveraging Axis-Aligned Subspaces for High-Dimensional Bayesian Optimization with Group Testingcited by 2
- 2022Practitioner Motives to Use Different Hyperparameter Optimization Methodscited by 1
- 2022Improving Multi-fidelity Optimization with a Recurring Learning Rate for Hyperparameter Tuningcited by 1
- 2024A Bayesian Approach to Online Planningcited by 1
- 2021Automatic tuning of hyper-parameters of reinforcement learning algorithms using Bayesian optimization with behavioral cloningcited by 0
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holescited by 0
- 2023Bayesian Optimization Meets Self-Distillationcited by 0
- 2023Identification of stormwater control strategies and their associated uncertainties using Bayesian Optimizationcited by 0
- 2025HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networkscited by 0
- 2025BOOST: A Data-Driven Framework for the Automated Joint Selection of Kernel and Acquisition Functions in Bayesian Optimizationcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Near-Optimal Regret in Adversarial Kernel Bandits26 May 2026
- 2026mlr3mbo: Bayesian Optimization in R31 Mar 2026
- 2026Standard Acquisition Is Sufficient for Asynchronous Bayesian Optimization13 Mar 2026
- 2025Co-Exploration and Co-Exploitation via Shared Structure in Multi-Task Bandits14 Dec 2025
- 2025Batch Acquisition Function Evaluations and Decouple Optimizer Updates for Faster Bayesian Optimization17 Nov 2025
- 2025BOOST: A Data-Driven Framework for the Automated Joint Selection of Kernel and Acquisition Functions in Bayesian Optimization4 Aug 2025
- 2025Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learning8 May 2025
- 2025HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networks27 Apr 2025
- 2025Leveraging Axis-Aligned Subspaces for High-Dimensional Bayesian Optimization with Group Testing8 Apr 2025
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes29 Dec 2024
- 2024Bayesian Optimization via Continual Variational Last Layer Training12 Dec 2024
- 2024A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapes17 Oct 2024
38 more
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigm5 Jun 2024
- 2024A Bayesian Approach to Online Planning4 Jun 2024
- 2024Adaptive Q-Network: On-the-fly Target Selection for Deep Reinforcement Learning25 May 2024
- 2024Generalized Population-Based Training for Hyperparameter Optimization in Reinforcement Learning12 Apr 2024
- 2023Stochastic Bayesian Optimization with Unknown Continuous Context Distribution via Kernel Density Estimation16 Dec 2023
- 2023High-dimensional Bayesian Optimization with Group Testing5 Oct 2023
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning21 Jun 2023
- 2023Identification of stormwater control strategies and their associated uncertainties using Bayesian Optimization29 May 2023
- 2023Python Wrapper for Simulating Multi-Fidelity Optimization on HPO Benchmarks without Any Wait27 May 2023
- 2023Python Tool for Visualizing Variability of Pareto Fronts over Multiple Runs15 May 2023
- 2023OpenBox: A Python Toolkit for Generalized Black-box Optimization26 Apr 2023
- 2023Bayesian Optimization Meets Self-Distillation25 Apr 2023
- 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance21 Apr 2023
- 2023Self-Correcting Bayesian Optimization through Bayesian Active Learning21 Apr 2023
- 2023PED-ANOVA: Efficiently Quantifying Hyperparameter Importance in Arbitrary Subspaces20 Apr 2023
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes24 Mar 2023
- 2023Dynamic Update-to-Data Ratio: Minimizing World Model Overfitting17 Mar 2023
- 2023Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML15 Mar 2023
- 2022Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator13 Dec 2022
- 2022c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization26 Nov 2022
- 2022Improving Multi-fidelity Optimization with a Recurring Learning Rate for Hyperparameter Tuning26 Sep 2022
- 2022Event-Triggered Time-Varying Bayesian Optimization23 Aug 2022
- 2022Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimization23 Jul 2022
- 2022Bayesian Generational Population-Based Training19 Jul 2022
- 2022Joint Entropy Search for Maximally-Informed Bayesian Optimization9 Jun 2022
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimization23 Apr 2022
- 2022Practitioner Motives to Use Different Hyperparameter Optimization Methods3 Mar 2022
- 2022Bayesian Optimization For Multi-Objective Mixed-Variable Problems30 Jan 2022
- 2022Automated Reinforcement Learning: An Overview13 Jan 2022
- 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problems11 Jan 2022
- 2021Automatic tuning of hyper-parameters of reinforcement learning algorithms using Bayesian optimization with behavioral cloning15 Dec 2021
- 2021Episodic Policy Gradient Training3 Dec 2021
- 2021Automatic Mapping of the Best-Suited DNN Pruning Schemes for Real-Time Mobile Acceleration22 Nov 2021
- 2021Risk-averse Heteroscedastic Bayesian Optimization5 Nov 2021
- 2021Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search18 Aug 2021
- 2021Tuning Mixed Input Hyperparameters on the Fly for Efficient Population Based AutoRL30 Jun 2021
- 2021Achieving Real-Time Object Detection on MobileDevices with Neural Pruning Search28 Jun 2021
- 2021Well-tuned Simple Nets Excel on Tabular Datasets21 Jun 2021
50 newest of 55 All 55 (JSON)
- 2024Generalized Population-Based Training for Hyperparameter Optimization in Reinforcement Learningcited by 4
- 2024Adaptive Q-Network: On-the-fly Target Selection for Deep Reinforcement Learningcited by 3
- 2025HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networkscited by 0
- 2025HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networks27 Apr 2025
- 2024Adaptive Q-Network: On-the-fly Target Selection for Deep Reinforcement Learning25 May 2024
- 2024Generalized Population-Based Training for Hyperparameter Optimization in Reinforcement Learning12 Apr 2024
- 2023Bayesian Optimization Meets Self-Distillationcited by 0
- 2023Bayesian Optimization Meets Self-Distillation25 Apr 2023
- 2021Well-tuned Simple Nets Excel on Tabular Datasetscited by 151
- 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 147
- 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 70
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 70
- 2022Joint Entropy Search for Maximally-Informed Bayesian Optimizationcited by 55
- 2021GIBBON: General-purpose Information-Based Bayesian OptimisatioNcited by 47
- 2021Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Searchcited by 34
- 2023PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learningcited by 31
- 2021Active Offline Policy Selectioncited by 26
- 2023Self-Correcting Bayesian Optimization through Bayesian Active Learningcited by 22
- 2021Automatic Termination for Hyperparameter Optimizationcited by 21
- 2022Bayesian Generational Population-Based Trainingcited by 20
12 most cited of 49 All 49 (JSON)
- 2026Near-Optimal Regret in Adversarial Kernel Bandits26 May 2026
- 2026mlr3mbo: Bayesian Optimization in R31 Mar 2026
- 2026Standard Acquisition Is Sufficient for Asynchronous Bayesian Optimization13 Mar 2026
- 2025Co-Exploration and Co-Exploitation via Shared Structure in Multi-Task Bandits14 Dec 2025
- 2025Batch Acquisition Function Evaluations and Decouple Optimizer Updates for Faster Bayesian Optimization17 Nov 2025
- 2025BOOST: A Data-Driven Framework for the Automated Joint Selection of Kernel and Acquisition Functions in Bayesian Optimization4 Aug 2025
- 2025Put CASH on Bandits: A Max K-Armed Problem for Automated Machine Learning8 May 2025
- 2025Leveraging Axis-Aligned Subspaces for High-Dimensional Bayesian Optimization with Group Testing8 Apr 2025
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes29 Dec 2024
- 2024Bayesian Optimization via Continual Variational Last Layer Training12 Dec 2024
- 2024A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapes17 Oct 2024
- 2024Position: A Call to Action for a Human-Centered AutoML Paradigm5 Jun 2024
12 newest of 49 All 49 (JSON)