OpenBox: A Python Toolkit for Generalized Black-box Optimization
Not on the map. Why?
Abstract (arXiv)
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face challenges when applying BBO methods to their problems at hand with existing software packages in terms of applicability, performance, and efficiency. This paper presents OpenBox, an open-source BBO toolkit with improved usability. It implements user-friendly interfaces and visualization for users to define and manage their tasks. The modular design behind OpenBox facilitates its flexible deployment in existing systems. Experimental results demonstrate the effectiveness and efficiency of OpenBox over existing systems. The source code of OpenBox is available at https://github.com/PKU-DAIR/open-box.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 35 of its 73 references that are in the map. First posted on arXiv 26 Apr 2023.
Builds on
35 of 73 references.
References · 35
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2017Forward and Reverse Gradient-Based Hyperparameter Optimizationcited by 232
- 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
- 2019Variational Bayesian Optimal Experimental Designcited by 116
- 2015Batch Bayesian Optimization via Local Penalizationcited by 103
- 2019An Open Source AutoML Benchmarkcited by 85
- 2020Scalable Constrained Bayesian Optimizationcited by 84
- 2020Max-value Entropy Search for Multi-Objective Bayesian Optimization with Constraintscited by 81
23 more
- 2018Bayesian Optimization of Combinatorial Structurescited by 64
- 2018BOCK : Bayesian Optimization with Cylindrical Kernelscited by 62
- 2019OpenML-Python: an extensible Python API for OpenMLcited by 62
- 2018Bayesian Optimization in AlphaGocited by 55
- 2022BBTv2: Towards a Gradient-Free Future with Large Language Modelscited by 53
- 2015Predictive Entropy Search for Bayesian Optimization with Unknown Constraintscited by 51
- 2015A General Framework for Constrained Bayesian Optimization using Information-based Searchcited by 50
- 2019An ADMM Based Framework for AutoML Pipeline Configurationcited by 47
- 2021OpenBox: A Generalized Black-box Optimization Servicecited by 46
- 2020Fair Bayesian Optimizationcited by 45
- 2022Uncertainty-Aware Search Framework for Multi-Objective Bayesian Optimizationcited by 43
- 2022PaSca: a Graph Neural Architecture Search System under the Scalable Paradigmcited by 37
- 2020Efficient Automatic CASH via Rising Banditscited by 30
- 2021Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental Evaluationcited by 22
- 2018Autotune: A Derivative-free Optimization Framework for Hyperparameter Tuningcited by 20
- 2017GPflowOpt: A Bayesian Optimization Library using TensorFlowcited by 18
- 2020MFES-HB: Efficient Hyperband with Multi-Fidelity Quality Measurementscited by 18
- 2022Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimizationcited by 17
- 2022Towards Dynamic and Safe Configuration Tuning for Cloud Databasescited by 16
- 2017ZOOpt: Toolbox for Derivative-Free Optimizationcited by 12
- 2022LlamaTune: Sample-Efficient DBMS Configuration Tuningcited by 12
- 2021Automated Hyperparameter Optimization Challenge at CIKM 2021 AnalyticCupcited by 3
- 2023Rover: An online Spark SQL tuning service via generalized transfer learningcited by 3
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 5; 2026: 2.
9 papers.
- 2023SMT 2.0: A Surrogate Modeling Toolbox with a focus on Hierarchical and Mixed Variables Gaussian Processescited by 27
- 2025OptunaHub: A Platform for Black-Box Optimizationcited by 14
- 2025Modeling Hierarchical Spaces: A Review and Unified Framework for Surrogate-Based Architecture Designcited by 3
- 2026Tree-Structured Synergy of Large Language Models and Bayesian Optimization for Efficient CASHcited by 2
- 2023Towards General and Efficient Online Tuning for Sparkcited by 1
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimizationcited by 1
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimizationcited by 1
- 2025Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptionscited by 0
- 2026CDS4RAG: Cyclic Dual-Sequential Hyperparameter Optimization for RAGcited by 0
- 2026CDS4RAG: Cyclic Dual-Sequential Hyperparameter Optimization for RAG8 May 2026
- 2026Tree-Structured Synergy of Large Language Models and Bayesian Optimization for Efficient CASH18 Jan 2026
- 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimization29 Oct 2025
- 2025Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions26 Oct 2025
- 2025ZeroShotOpt: Towards Zero-Shot Pretrained Models for Efficient Black-Box Optimization3 Oct 2025
- 2025OptunaHub: A Platform for Black-Box Optimization3 Oct 2025
- 2025Modeling Hierarchical Spaces: A Review and Unified Framework for Surrogate-Based Architecture Design27 Jun 2025
- 2023Towards General and Efficient Online Tuning for Spark5 Sep 2023
- 2023SMT 2.0: A Surrogate Modeling Toolbox with a focus on Hierarchical and Mixed Variables Gaussian Processes23 May 2023