The Vizier Gaussian Process Bandit Algorithm
Not on the map. Why?
Abstract (arXiv)
Google Vizier has performed millions of optimizations and accelerated numerous research and production systems at Google, demonstrating the success of Bayesian optimization as a large-scale service. Over multiple years, its algorithm has been improved considerably, through the collective experiences of numerous research efforts and user feedback. In this technical report, we discuss the implementation details and design choices of the current default algorithm provided by Open Source Vizier. Our experiments on standardized benchmarks reveal its robustness and versatility against well-established industry baselines on multiple practical modes.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 15 of its 39 references that are in the map. First posted on arXiv 21 Aug 2024.
Builds on
15 of 39 references.
References · 15
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
- 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
- 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 144
- 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
- 2017TensorFlow Distributionscited by 105
- 2020HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisationcited by 81
- 2019Combinatorial Bayesian Optimization using the Graph Cartesian Productcited by 78
- 2020Random Hypervolume Scalarizations for Provable Multi-Objective Black Box Optimizationcited by 60
- 2013Parallel Gaussian Process Optimization with Upper Confidence Bound and Pure Explorationcited by 50
- 2022Bayesian Optimization over Discrete and Mixed Spaces via Probabilistic Reparameterizationcited by 35
- 2022Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimizationcited by 17
Built on by
Citing papers per year: 2024: 2; 2025: 10; 2026: 2.
14 papers.
Sort:
By area:
- 2025Performance Prediction for Large Systems via Text-to-Text Regressioncited by 14
- 2024Language Model Embeddings Can Be Sufficient for Bayesian Optimizationcited by 8
- 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximationcited by 8
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddingscited by 6
- 2025Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Modelscited by 5
- 2025RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learningcited by 5
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?cited by 3
- 2025Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectivescited by 2
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimizationcited by 2
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimizationcited by 1
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimizationcited by 1
- 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherencecited by 1
- 2026Beyond Trial-and-Error: Agentic Optimization for Image-to-Video Adherence12 Aug 2026
- 2026Efficient Heteroscedastic Bayesian Optimization for Risk-Aware AutoRL29 Jul 2026
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization29 Oct 2025
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization3 Oct 2025
- 2025RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learning5 Sep 2025
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization3 Sep 2025
- 2025Performance Prediction for Large Systems via Text-to-Text Regression26 Jun 2025
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings8 Jun 2025
- 2025Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives27 May 2025
- 2025ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding26 Apr 2025
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?5 Mar 2025
- 2025Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models21 Feb 2025
- 2025Performance Prediction for Large Systems via Text-to-Text Regressioncited by 14
- 2024Language Model Embeddings Can Be Sufficient for Bayesian Optimizationcited by 8
- 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximationcited by 8
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddingscited by 6
- 2025Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Modelscited by 5
- 2025RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learningcited by 5
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?cited by 3
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimizationcited by 2
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimizationcited by 1
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimizationcited by 1
- 2025ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understandingcited by 0
- 2026Efficient Heteroscedastic Bayesian Optimization for Risk-Aware AutoRLcited by 0
- 2026Efficient Heteroscedastic Bayesian Optimization for Risk-Aware AutoRL29 Jul 2026
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization29 Oct 2025
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization3 Oct 2025
- 2025RoboBallet: Planning for Multi-Robot Reaching with Graph Neural Networks and Reinforcement Learning5 Sep 2025
- 2025FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization3 Sep 2025
- 2025Performance Prediction for Large Systems via Text-to-Text Regression26 Jun 2025
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings8 Jun 2025
- 2025ALF: Advertiser Large Foundation Model for Multi-Modal Advertiser Understanding26 Apr 2025
- 2025Deterministic Global Optimization of the Acquisition Function in Bayesian Optimization: To Do or Not To Do?5 Mar 2025
- 2025Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models21 Feb 2025
- 2024Global Optimization of Gaussian Process Acquisition Functions Using a Piecewise-Linear Kernel Approximation22 Oct 2024
- 2024Language Model Embeddings Can Be Sufficient for Bayesian Optimization14 Oct 2024