Truncated Variance Reduction: A Unified Approach to Bayesian Optimization and Level-Set Estimation
Not on the map. Why?
Abstract (arXiv)
We present a new algorithm, truncated variance reduction (TruVaR), that treats Bayesian optimization (BO) and level-set estimation (LSE) with Gaussian processes in a unified fashion. The algorithm greedily shrinks a sum of truncated variances within a set of potential maximizers (BO) or unclassified points (LSE), which is updated based on confidence bounds. TruVaR is effective in several important settings that are typically non-trivial to incorporate into myopic algorithms, including pointwise costs and heteroscedastic noise. We provide a general theoretical guarantee for TruVaR covering these aspects, and use it to recover and strengthen existing results on BO and LSE. Moreover, we provide a new result for a setting where one can select from a number of noise levels having associated costs. We demonstrate the effectiveness of the algorithm on both synthetic and real-world data sets.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 8; 2023: 6; 2024: 10; 2025: 4; 2026: 5.
40 papers.
Sort:
By area:
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2021Misspecified Gaussian Process Bandit Optimizationcited by 52
- 2021Value-at-Risk Optimization with Gaussian Processescited by 19
- 2021Nearly Optimal Algorithms for Level Set Estimationcited by 17
- 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2021Lenient Regret and Good-Action Identification in Gaussian Process Banditscited by 12
- 2021Entropy-based adaptive design for contour finding and estimating reliabilitycited by 10
- 2022Graph Neural Network Banditscited by 10
- 2023Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimationcited by 8
- 2024Active Fine-Tuning of Multi-Task Policiescited by 8
- 2022Movement Penalized Bayesian Optimization with Application to Wind Energy Systemscited by 7
28 more
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processescited by 7
- 2022Look-Ahead Acquisition Functions for Bernoulli Level Set Estimationcited by 6
- 2024Variational Search Distributionscited by 6
- 2024Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Needcited by 4
- 2024Regret Analysis for Randomized Gaussian Process Upper Confidence Boundcited by 4
- 2024Sample-efficient Bayesian Optimisation Using Known Invariancescited by 4
- 2024Active Level Set Estimation for Continuous Search Space with Theoretical Guaranteecited by 3
- 2024Active Learning for Level Set Estimation Using Randomized Straddle Algorithmscited by 3
- 2025Distributionally Robust Active Learning for Gaussian Process Regressioncited by 3
- 2022Relaxed Gaussian process interpolation: a goal-oriented approach to Bayesian optimizationcited by 2
- 2023Provably Efficient Bayesian Optimization with Unknown Gaussian Process Hyperparameter Estimationcited by 2
- 2023Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraintscited by 2
- 2023Practical Path-based Bayesian Optimizationcited by 2
- 2024Active Few-Shot Fine-Tuningcited by 2
- 2022Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedbackcited by 1
- 2022Benefits of Monotonicity in Safe Exploration with Gaussian Processescited by 1
- 2023Efficient Determination of Safety Requirements for Perception Systemscited by 1
- 2024Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Priorcited by 1
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validationcited by 1
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systemscited by 1
- 2026CASHomon Sets: Efficient Rashomon Sets Across Multiple Model Classes and their Hyperparameterscited by 1
- 2022Online Subset Selection using α-Core with no Augmented Regretcited by 0
- 2023A Finite-Horizon Approach to Active Level Set Estimationcited by 0
- 2025An (ε,δ)-accurate level set estimation with a stopping criterioncited by 0
- 2026High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functionscited by 0
- 2026Multi-Objective Coverage via Constraint Active Searchcited by 0
- 2026Towards Regret Guarantees for One-Step Lookahead Bayesian Optimizationcited by 0
- 2026Online Adaptive Kernel Mixing for Gaussian Process Decision Makingcited by 0
- 2026Online Adaptive Kernel Mixing for Gaussian Process Decision Making17 Sep 2026
- 2026Towards Regret Guarantees for One-Step Lookahead Bayesian Optimization31 May 2026
- 2026CASHomon Sets: Efficient Rashomon Sets Across Multiple Model Classes and their Hyperparameters16 Mar 2026
- 2026Multi-Objective Coverage via Constraint Active Search17 Feb 2026
- 2026High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functions12 Feb 2026
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems27 Oct 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
- 2025An (ε,δ)-accurate level set estimation with a stopping criterion26 Mar 2025
- 2025Distributionally Robust Active Learning for Gaussian Process Regression24 Feb 2025
- 2024Sample-efficient Bayesian Optimisation Using Known Invariances22 Oct 2024
- 2024Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior8 Oct 2024
- 2024Active Fine-Tuning of Multi-Task Policies7 Oct 2024
28 more
- 2024Variational Search Distributions10 Sep 2024
- 2024Regret Analysis for Randomized Gaussian Process Upper Confidence Bound2 Sep 2024
- 2024Active Learning for Level Set Estimation Using Randomized Straddle Algorithms6 Aug 2024
- 2024Active Level Set Estimation for Continuous Search Space with Theoretical Guarantee26 Feb 2024
- 2024Active Few-Shot Fine-Tuning13 Feb 2024
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processes13 Feb 2024
- 2024Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Need3 Feb 2024
- 2023Practical Path-based Bayesian Optimization1 Dec 2023
- 2023A Finite-Horizon Approach to Active Level Set Estimation18 Oct 2023
- 2023Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints12 Oct 2023
- 2023Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimation25 Jul 2023
- 2023Efficient Determination of Safety Requirements for Perception Systems3 Jul 2023
- 2023Provably Efficient Bayesian Optimization with Unknown Gaussian Process Hyperparameter Estimation12 Jun 2023
- 2022Benefits of Monotonicity in Safe Exploration with Gaussian Processes3 Nov 2022
- 2022Movement Penalized Bayesian Optimization with Application to Wind Energy Systems14 Oct 2022
- 2022Online Subset Selection using α-Core with no Augmented Regret28 Sep 2022
- 2022Graph Neural Network Bandits13 Jul 2022
- 2022Relaxed Gaussian process interpolation: a goal-oriented approach to Bayesian optimization7 Jun 2022
- 2022Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedback15 May 2022
- 2022Look-Ahead Acquisition Functions for Bernoulli Level Set Estimation18 Mar 2022
- 2022SnAKe: Bayesian Optimization with Pathwise Exploration31 Jan 2022
- 2021Misspecified Gaussian Process Bandit Optimization9 Nov 2021
- 2021Risk-averse Heteroscedastic Bayesian Optimization5 Nov 2021
- 2021Nearly Optimal Algorithms for Level Set Estimation2 Nov 2021
- 2021Optimal Order Simple Regret for Gaussian Process Bandits20 Aug 2021
- 2021Entropy-based adaptive design for contour finding and estimating reliability24 May 2021
- 2021Value-at-Risk Optimization with Gaussian Processes13 May 2021
- 2021Lenient Regret and Good-Action Identification in Gaussian Process Bandits11 Feb 2021
- 2024Active Fine-Tuning of Multi-Task Policiescited by 8
- 2024Active Fine-Tuning of Multi-Task Policies7 Oct 2024
- 2021Optimal Order Simple Regret for Gaussian Process Banditscited by 52
- 2021Misspecified Gaussian Process Bandit Optimizationcited by 52
- 2021Value-at-Risk Optimization with Gaussian Processescited by 19
- 2021Nearly Optimal Algorithms for Level Set Estimationcited by 17
- 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
- 2022SnAKe: Bayesian Optimization with Pathwise Explorationcited by 14
- 2021Lenient Regret and Good-Action Identification in Gaussian Process Banditscited by 12
- 2021Entropy-based adaptive design for contour finding and estimating reliabilitycited by 10
- 2022Graph Neural Network Banditscited by 10
- 2023Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimationcited by 8
- 2022Movement Penalized Bayesian Optimization with Application to Wind Energy Systemscited by 7
- 2024Transition Constrained Bayesian Optimization via Markov Decision Processescited by 7
12 most cited of 39 All 39 (JSON)
- 2026Online Adaptive Kernel Mixing for Gaussian Process Decision Making17 Sep 2026
- 2026Towards Regret Guarantees for One-Step Lookahead Bayesian Optimization31 May 2026
- 2026CASHomon Sets: Efficient Rashomon Sets Across Multiple Model Classes and their Hyperparameters16 Mar 2026
- 2026Multi-Objective Coverage via Constraint Active Search17 Feb 2026
- 2026High-dimensional Level Set Estimation with Trust Regions and Double Acquisition Functions12 Feb 2026
- 2025Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems27 Oct 2025
- 2025Multi-Metric Adaptive Experimental Design Under a Fixed Budget with Validation3 Jun 2025
- 2025An (ε,δ)-accurate level set estimation with a stopping criterion26 Mar 2025
- 2025Distributionally Robust Active Learning for Gaussian Process Regression24 Feb 2025
- 2024Sample-efficient Bayesian Optimisation Using Known Invariances22 Oct 2024
- 2024Robust Transfer Learning for Active Level Set Estimation with Locally Adaptive Gaussian Process Prior8 Oct 2024
- 2024Variational Search Distributions10 Sep 2024
12 newest of 39 All 39 (JSON)