BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization
Not on the map. Why?
Abstract (arXiv)
Bayesian optimization provides sample-efficient global optimization for a broad range of applications, including automatic machine learning, engineering, physics, and experimental design. We introduce BoTorch, a modern programming framework for Bayesian optimization that combines Monte-Carlo (MC) acquisition functions, a novel sample average approximation optimization approach, auto-differentiation, and variance reduction techniques. BoTorch's modular design facilitates flexible specification and optimization of probabilistic models written in PyTorch, simplifying implementation of new acquisition functions. Our approach is backed by novel theoretical convergence results and made practical by a distinctive algorithmic foundation that leverages fast predictive distributions, hardware acceleration, and deterministic optimization. We also propose a novel "one-shot" formulation of the Knowledge Gradient, enabled by a combination of our theoretical and software contributions. In experiments, we demonstrate the improved sample efficiency of BoTorch relative to other popular libraries.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 3; 2023: 2; 2024: 10; 2025: 0; 2026: 4.
28 papers.
Sort:
By area:
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
- 2024Diffusion Models as Constrained Samplers for Optimization with Unknown Constraintscited by 33
- 2021Fast Adaptation with Linearized Neural Networkscited by 32
- 2021Ps and Qs: Quantization-aware pruning for efficient low latency neural network inferencecited by 31
- 2021Geometry-aware Bayesian Optimization in Robotics using Riemannian Mat'ern Kernelscited by 24
- 2023qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson samplingcited by 11
- 2021Revisiting Bayesian Optimization in the light of the COCO benchmarkcited by 10
- 2024Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networkscited by 10
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processescited by 9
- 2021BoGraph: Structured Bayesian Optimization From Logs for Expensive Systems with Many Parameterscited by 6
- 2024Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modelingcited by 5
- 2021High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDBcited by 4
16 more
- 2021Cost-Efficient Online Hyperparameter Optimizationcited by 2
- 2021Bayesian Optimization for Min Max Optimizationcited by 2
- 2024Optimal Initialization of Batch Bayesian Optimizationcited by 2
- 2024Bayesian Optimization for Hyperparameters Tuning in Neural Networkscited by 2
- 2024Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objectivecited by 2
- 2024Dimensionality Reduction Techniques for Global Bayesian Optimisationcited by 1
- 2022Online Stochastic Variational Gaussian Process Mapping for Large-Scale SLAM in Real Timecited by 0
- 2022Bayesian Optimization of 2D Echocardiography Segmentationcited by 0
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holescited by 0
- 2024Multifidelity Cross-validationcited by 0
- 2024Estimating the Causal Effects of T Cell Receptorscited by 0
- 2024BOTS: Batch Bayesian Optimization of Extended Thompson Sampling for Severely Episode-Limited RL Settingscited by 0
- 2026Novelty-Driven Target-Space Discovery in Automated Electron and Scanning Probe Microscopycited by 0
- 2026BOxCrete: A Bayesian Optimization Open-Source AI Model for Concrete Strength Forecasting and Mix Optimizationcited by 0
- 2026Scalable Derivative Gaussian Processes via Exact Gradient Reductioncited by 0
- 2026La Agente 'Optima: Towards Agentic Self-Driving Laboratoriescited by 0
- 2026La Agente 'Optima: Towards Agentic Self-Driving Laboratories3 Sep 2026
- 2026Scalable Derivative Gaussian Processes via Exact Gradient Reduction1 Jun 2026
- 2026BOxCrete: A Bayesian Optimization Open-Source AI Model for Concrete Strength Forecasting and Mix Optimization23 Mar 2026
- 2026Novelty-Driven Target-Space Discovery in Automated Electron and Scanning Probe Microscopy17 Mar 2026
- 2024Dimensionality Reduction Techniques for Global Bayesian Optimisation12 Dec 2024
- 2024Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling11 Dec 2024
- 2024BOTS: Batch Bayesian Optimization of Extended Thompson Sampling for Severely Episode-Limited RL Settings30 Nov 2024
- 2024Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objective27 Nov 2024
- 2024Bayesian Optimization for Hyperparameters Tuning in Neural Networks29 Oct 2024
- 2024Estimating the Causal Effects of T Cell Receptors18 Oct 2024
- 2024Multifidelity Cross-validation1 Jul 2024
- 2024Optimal Initialization of Batch Bayesian Optimization27 Apr 2024
16 more
- 2024Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networks3 Apr 2024
- 2024Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints28 Feb 2024
- 2023qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson sampling24 Oct 2023
- 2023Applications of Gaussian Processes at Extreme Lengthscales: From Molecules to Black Holes24 Mar 2023
- 2022Bayesian Optimization of 2D Echocardiography Segmentation17 Nov 2022
- 2022Online Stochastic Variational Gaussian Process Mapping for Large-Scale SLAM in Real Time10 Nov 2022
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization17 Feb 2022
- 2021BoGraph: Structured Bayesian Optimization From Logs for Expensive Systems with Many Parameters16 Dec 2021
- 2021Geometry-aware Bayesian Optimization in Robotics using Riemannian Mat'ern Kernels2 Nov 2021
- 2021Bayesian Optimization for Min Max Optimization29 Jul 2021
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processes12 Jun 2021
- 2021Revisiting Bayesian Optimization in the light of the COCO benchmark30 Mar 2021
- 2021High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDB30 Mar 2021
- 2021Fast Adaptation with Linearized Neural Networks2 Mar 2021
- 2021Ps and Qs: Quantization-aware pruning for efficient low latency neural network inference22 Feb 2021
- 2021Cost-Efficient Online Hyperparameter Optimization17 Jan 2021
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
- 2021Fast Adaptation with Linearized Neural Networkscited by 32
- 2021Ps and Qs: Quantization-aware pruning for efficient low latency neural network inferencecited by 31
- 2021Geometry-aware Bayesian Optimization in Robotics using Riemannian Mat'ern Kernelscited by 24
- 2023qPOTS: Efficient batch multiobjective Bayesian optimization via Pareto optimal Thompson samplingcited by 11
- 2021Revisiting Bayesian Optimization in the light of the COCO benchmarkcited by 10
- 2024Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networkscited by 10
- 2021SKIing on Simplices: Kernel Interpolation on the Permutohedral Lattice for Scalable Gaussian Processescited by 9
- 2021BoGraph: Structured Bayesian Optimization From Logs for Expensive Systems with Many Parameterscited by 6
- 2024Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modelingcited by 5
- 2021High-Dimensional Bayesian Optimization with Multi-Task Learning for RocksDBcited by 4
- 2021Cost-Efficient Online Hyperparameter Optimizationcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Scalable Derivative Gaussian Processes via Exact Gradient Reduction1 Jun 2026
- 2026BOxCrete: A Bayesian Optimization Open-Source AI Model for Concrete Strength Forecasting and Mix Optimization23 Mar 2026
- 2026Novelty-Driven Target-Space Discovery in Automated Electron and Scanning Probe Microscopy17 Mar 2026
- 2024Dimensionality Reduction Techniques for Global Bayesian Optimisation12 Dec 2024
- 2024Bayesian optimized deep ensemble for uncertainty quantification of deep neural networks: a system safety case study on sodium fast reactor thermal stratification modeling11 Dec 2024
- 2024BOTS: Batch Bayesian Optimization of Extended Thompson Sampling for Severely Episode-Limited RL Settings30 Nov 2024
- 2024Derivation of Closed Form of Expected Improvement for Gaussian Process Trained on Log-Transformed Objective27 Nov 2024
- 2024Bayesian Optimization for Hyperparameters Tuning in Neural Networks29 Oct 2024
- 2024Estimating the Causal Effects of T Cell Receptors18 Oct 2024
- 2024Multifidelity Cross-validation1 Jul 2024
- 2024Optimal Initialization of Batch Bayesian Optimization27 Apr 2024
- 2024Composite Bayesian Optimization In Function Spaces Using NEON -- Neural Epistemic Operator Networks3 Apr 2024
12 newest of 26 All 26 (JSON)