Looping in the Human Collaborative and Explainable Bayesian Optimization
Not on the map. Why?
Abstract (arXiv)
Like many optimizers, Bayesian optimization often falls short of gaining user trust due to opacity. While attempts have been made to develop human-centric optimizers, they typically assume user knowledge is well-specified and error-free, employing users mainly as supervisors of the optimization process. We relax these assumptions and propose a more balanced human-AI partnership with our Collaborative and Explainable Bayesian Optimization (CoExBO) framework. Instead of explicitly requiring a user to provide a knowledge model, CoExBO employs preference learning to seamlessly integrate human insights into the optimization, resulting in algorithmic suggestions that resonate with user preference. CoExBO explains its candidate selection every iteration to foster trust, empowering users with a clearer grasp of the optimization. Furthermore, CoExBO offers a no-harm guarantee, allowing users to make mistakes; even with extreme adversarial interventions, the algorithm converges asymptotically to a vanilla Bayesian optimization. We validate CoExBO's efficacy through human-AI teaming experiments in lithium-ion battery design, highlighting substantial improvements over conventional methods. Code is available https://github.com/ma921/CoExBO.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 49 of its 100 references that are in the map. First posted on arXiv 26 Oct 2023.
Builds on
49 of 100 references.
References · 49
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
- 2014Bayesian Optimization with Unknown Constraintscited by 109
- 2019Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuningcited by 91
- 2017Preferential Bayesian Optimizationcited by 72
- 2022πBO: Augmenting Acquisition Functions with User Beliefs for Bayesian Optimizationcited by 69
- 2014Input Warping for Bayesian Optimization of Non-stationary Functionscited by 66
- 2021Pre-trained Gaussian Processes for Bayesian Optimizationcited by 63
- 2018A General Framework for Multi-fidelity Bayesian Optimization with Gaussian Processescited by 52
37 more
- 2015Predictive Entropy Search for Bayesian Optimization with Unknown Constraintscited by 51
- 2018Dirichlet-based Gaussian Processes for Large-scale Calibrated Classificationcited by 50
- 2022Preference Exploration for Efficient Bayesian Optimization with Multiple Outcomescited by 41
- 2015GLASSES: Relieving The Myopia Of Bayesian Optimisationcited by 38
- 2021RKHS-SHAP: Shapley Values for Kernel Methodscited by 30
- 2021Positively Weighted Kernel Quadrature via Subsamplingcited by 25
- 2020Sequential Gallery for Interactive Visual Design Optimizationcited by 24
- 2021Deconditional Downscaling with Gaussian Processescited by 24
- 2020Incorporating Expert Prior in Bayesian Optimisation via Space Warpingcited by 23
- 2021Prior knowledge elicitation: The past, present, and futurecited by 23
- 2023qEUBO: A Decision-Theoretic Acquisition Function for Preferential Bayesian Optimizationcited by 23
- 2020Randomised Gaussian Process Upper Confidence Bound for Bayesian Optimisationcited by 22
- 2019Multi-Attribute Bayesian Optimization With Interactive Preference Learningcited by 21
- 2020Projective Preferential Bayesian Optimizationcited by 21
- 2021BayesIMP: Uncertainty Quantification for Causal Data Fusioncited by 21
- 2022Fast Bayesian Inference with Batch Bayesian Quadrature via Kernel Recombinationcited by 20
- 2023Towards Practical Preferential Bayesian Optimization with Skew Gaussian Processescited by 19
- 2023Explaining the Uncertain: Stochastic Shapley Values for Gaussian Process Modelscited by 19
- 2022Multi-Fidelity Bayesian Optimization with Unreliable Information Sourcescited by 17
- 2021Autonomous optimization of nonaqueous battery electrolytes via robotic experimentation and machine learningcited by 16
- 2023Randomized Gaussian Process Upper Confidence Bound with Tighter Bayesian Regret Boundscited by 16
- 2016Convergence guarantees for kernel-based quadrature rules in misspecified settingscited by 15
- 2015Sync-Rank: Robust Ranking, Constrained Ranking and Rank Aggregation via Eigenvector and Semidefinite Programming Synchronizationcited by 14
- 2020Learning Inconsistent Preferences with Gaussian Processescited by 11
- 2020Incorporating Expert Prior Knowledge into Experimental Design via Posterior Samplingcited by 10
- 2020Spectral Ranking with Covariatescited by 8
- 2022Bayesian Model Selection of Lithium-Ion Battery Models via Bayesian Quadraturecited by 8
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learningcited by 8
- 2023SOBER: Highly Parallel Bayesian Optimization and Bayesian Quadrature over Discrete and Mixed Spacescited by 7
- 2022Sparse Bayesian Optimizationcited by 6
- 2022Explaining Preferences with Shapley Valuescited by 6
- 2022Bayesian Optimization Augmented with Actively Elicited Expert Knowledgecited by 6
- 2023BO-Muse: A human expert and AI teaming framework for accelerated experimental designcited by 6
- 2023Adaptive Batch Sizes for Active Learning A Probabilistic Numerics Approachcited by 6
- 2020Human Strategic Steering Improves Performance of Interactive Optimizationcited by 5
- 2023Learning Choice Functions with Gaussian Processescited by 5
- 2022HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processescited by 4
Built on by
Citing papers per year: 2024: 9; 2025: 9; 2026: 9.
27 papers.
Sort:
By area:
- 2025Language-Based Bayesian Optimization Research Assistant (BORA)cited by 13
- 2025LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimizationcited by 13
- 2024Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaborationcited by 12
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoMLcited by 9
- 2024Explainable Bayesian Optimizationcited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 7
- 2025Exact Shapley Attributions in Quadratic-time for FANOVA Gaussian Processescited by 6
- 2024Principled Bayesian Optimisation in Collaboration with Human Expertscited by 5
- 2024A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Liftingcited by 3
- 2024How Useful is Intermittent, Asynchronous Expert Feedback for Bayesian Optimization?cited by 2
- 2024HR-Bandit: Human-AI Collaborated Linear Recourse Banditcited by 2
- 2025Comparative Explanations: Explanation Guided Decision Making for Human-in-the-Loop Preference Selectioncited by 2
15 more
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Designcited by 2
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimizationcited by 2
- 2024Anchor-Based Heteroscedastic Noise for Preferential Bayesian Optimizationcited by 1
- 2024Building Trust in Black-box Optimization: A Comprehensive Framework for Explainabilitycited by 1
- 2025Distilling and exploiting quantitative insights from Large Language Models for enhanced Bayesian optimization of chemical reactionscited by 1
- 2026Human-in-the-Loop Meta Bayesian Optimization for Fusion Energy and Scientific Applicationscited by 1
- 2026In-Context Black-Box Optimization with Unreliable Feedbackcited by 1
- 2026Regret Analysis of Guided Diffusion for Black-Box Optimization over Structured Inputscited by 1
- 2025Consecutive Preferential Bayesian Optimizationcited by 0
- 2026Dynamic Hyperparameter Importance for Efficient Multi-Objective Optimizationcited by 0
- 2026BONSAI: Bayesian Optimization with Natural Simplicity and Interpretabilitycited by 0
- 2026Regime-Conditioned Evaluation in Multi-Context Bayesian Optimizationcited by 0
- 2026Elicitation-Augmented Bayesian Optimizationcited by 0
- 2026A Human-in-the-Loop Bayesian Optimization Framework for Constraint-Aware Bioprocess Developmentcited by 0
- 2026Agentic High-Dimensional Bayesian Optimization with Hypothesis- and Evidence-Guided Searchcited by 0
- 2026Agentic High-Dimensional Bayesian Optimization with Hypothesis- and Evidence-Guided Search28 Sep 2026
- 2026A Human-in-the-Loop Bayesian Optimization Framework for Constraint-Aware Bioprocess Development17 Jun 2026
- 2026Elicitation-Augmented Bayesian Optimization12 May 2026
- 2026Regret Analysis of Guided Diffusion for Black-Box Optimization over Structured Inputs11 May 2026
- 2026In-Context Black-Box Optimization with Unreliable Feedback7 May 2026
- 2026Regime-Conditioned Evaluation in Multi-Context Bayesian Optimization6 May 2026
- 2026Human-in-the-Loop Meta Bayesian Optimization for Fusion Energy and Scientific Applications30 Apr 2026
- 2026BONSAI: Bayesian Optimization with Natural Simplicity and Interpretability6 Feb 2026
- 2026Dynamic Hyperparameter Importance for Efficient Multi-Objective Optimization6 Jan 2026
- 2025Consecutive Preferential Bayesian Optimization7 Nov 2025
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization4 Nov 2025
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Design24 Sep 2025
15 more
- 2025Exact Shapley Attributions in Quadratic-time for FANOVA Gaussian Processes20 Aug 2025
- 2025LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization20 May 2025
- 2025Distilling and exploiting quantitative insights from Large Language Models for enhanced Bayesian optimization of chemical reactions11 Apr 2025
- 2025Comparative Explanations: Explanation Guided Decision Making for Human-in-the-Loop Preference Selection1 Apr 2025
- 2025PABBO: Preferential Amortized Black-Box Optimization2 Mar 2025
- 2025Language-Based Bayesian Optimization Research Assistant (BORA)27 Jan 2025
- 2024HR-Bandit: Human-AI Collaborated Linear Recourse Bandit18 Oct 2024
- 2024Building Trust in Black-box Optimization: A Comprehensive Framework for Explainability18 Oct 2024
- 2024Principled Bayesian Optimisation in Collaboration with Human Experts14 Oct 2024
- 2024How Useful is Intermittent, Asynchronous Expert Feedback for Bayesian Optimization?10 Jun 2024
- 2024Anchor-Based Heteroscedastic Noise for Preferential Bayesian Optimization23 May 2024
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoML13 May 2024
- 2024A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Lifting18 Apr 2024
- 2024Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration7 Mar 2024
- 2024Explainable Bayesian Optimization24 Jan 2024
- 2025Language-Based Bayesian Optimization Research Assistant (BORA)cited by 13
- 2025LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimizationcited by 13
- 2024Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaborationcited by 12
- 2024Hyperparameter Importance Analysis for Multi-Objective AutoMLcited by 9
- 2024Explainable Bayesian Optimizationcited by 8
- 2025PABBO: Preferential Amortized Black-Box Optimizationcited by 7
- 2025Exact Shapley Attributions in Quadratic-time for FANOVA Gaussian Processescited by 6
- 2024Principled Bayesian Optimisation in Collaboration with Human Expertscited by 5
- 2024A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Liftingcited by 3
- 2024HR-Bandit: Human-AI Collaborated Linear Recourse Banditcited by 2
- 2025Comparative Explanations: Explanation Guided Decision Making for Human-in-the-Loop Preference Selectioncited by 2
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Designcited by 2
12 most cited of 24 All 24 (JSON)
- 2026A Human-in-the-Loop Bayesian Optimization Framework for Constraint-Aware Bioprocess Development17 Jun 2026
- 2026Elicitation-Augmented Bayesian Optimization12 May 2026
- 2026In-Context Black-Box Optimization with Unreliable Feedback7 May 2026
- 2026Regime-Conditioned Evaluation in Multi-Context Bayesian Optimization6 May 2026
- 2026Human-in-the-Loop Meta Bayesian Optimization for Fusion Energy and Scientific Applications30 Apr 2026
- 2026BONSAI: Bayesian Optimization with Natural Simplicity and Interpretability6 Feb 2026
- 2026Dynamic Hyperparameter Importance for Efficient Multi-Objective Optimization6 Jan 2026
- 2025Consecutive Preferential Bayesian Optimization7 Nov 2025
- 2025Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization4 Nov 2025
- 2025BioBO: Biology-informed Bayesian Optimization for Perturbation Design24 Sep 2025
- 2025Exact Shapley Attributions in Quadratic-time for FANOVA Gaussian Processes20 Aug 2025
- 2025LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization20 May 2025
12 newest of 24 All 24 (JSON)