mlsanityData to 7 Oct 2026

OptunaHub: A Platform for Black-Box Optimization

arXiv 2510.02798 ↗First posted 3 Oct 2025cs.LG cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

Black-box optimization (BBO) underpins advances in domains such as AutoML and Materials Informatics, yet implementations of algorithms and benchmarks remain fragmented across research communities. We introduce OptunaHub (https://hub.optuna.org/), a community-oriented, decentralized platform for distributing BBO components under a unified Optuna-compatible interface. OptunaHub enables independent publication, discovery, and reuse of optimization algorithms and benchmark problems through a lightweight Python module, a contributor-driven registry, and a searchable web interface. The source code is publicly available in the hrefhttps://github.com/optuna/optunahubtextttoptunahub, hrefhttps://github.com/optuna/optunahub-registrytextttoptunahub-registry, and hrefhttps://github.com/optuna/optunahub-webtextttoptunahub-web repositories under the Optuna organization on GitHub (https://github.com/optuna/).

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 3 Oct 2025.

Builds on

22 of 33 references.

References · 22

  1. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  2. 2020NAS-Bench-201: Extending the Scope of Reproducible Neural Architecture Searchcited by 412
  3. 2021SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimizationcited by 229
  4. 2020pymoo: Multi-objective Optimization in Pythoncited by 196
  5. 2021Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020cited by 146
  6. 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 143
  7. 2016COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Settingcited by 135
  8. 2024Large Language Models to Enhance Bayesian Optimizationcited by 127
  9. 2021HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPOcited by 111
  10. 2020NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Sizecited by 98
  11. 2020HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisationcited by 81
  12. 2023PFNs4BO: In-Context Learning for Bayesian Optimizationcited by 70
10 more
  1. 2021YAHPO Gym -- An Efficient Multi-Objective Multi-Fidelity Benchmark for Hyperparameter Optimizationcited by 61
  2. 2019Tabular Benchmarks for Joint Architecture and Hyperparameter Optimizationcited by 57
  3. 2017PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimizationcited by 40
  4. 2018IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristicscited by 28
  5. 2024The AI Community Building the Future? A Quantitative Analysis of Development Activity on Hugging Face Hubcited by 18
  6. 2022Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimizationcited by 17
  7. 2023OpenBox: A Python Toolkit for Generalized Black-box Optimizationcited by 9
  8. 2024Large-scale Benchmarking of Metaphor-based Optimization Heuristicscited by 8
  9. 2023Single and Multi-Objective Optimization Benchmark Problems Focusing on Human-Powered Aircraft Designcited by 3
  10. 2024CatCMA : Stochastic Optimization for Mixed-Category Problemscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 13.

14 papers.

Sort:

By area:

  1. 2026Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearchcited by 12
  2. 2025SemanticOpt: Towards LLM-Based Semantic Black-Box Optimizationcited by 1
  3. 2026Towards plausibility in time series counterfactual explanationscited by 1
  4. 2026Beyond the Laplacian: Doubly Stochastic Matrices for Graph Neural Networkscited by 0
  5. 2026A Probabilistic Consensus-Driven Approach for Robust Counterfactual Explanationscited by 0
  6. 2026Financially Guided Deep Portfolio Optimizationcited by 0
  7. 2026Optuna Constrained Tree-Structured Parzen Estimator Is a Joint Density Generalization of c-TPEcited by 0
  8. 2026SpeechDx: A Multi-Task Benchmark for Clinical Speech AIcited by 0
  9. 2026Bayesian Complete-Pooling in Cross-Subject Classification for Motor Imagery Electroencephalogramcited by 0
  10. 2026BBOWP-Bench: Evaluating LLMs on Black-Box Optimization Word Problemscited by 0
  11. 2026Beyond the Gegenbauer Paradigm: q-Orthogonal Kernels for Machine Learningcited by 0
  12. 2026A Hybrid Framework of Vision Transformer and Gated Recurrent Unit for Detection of Mosquito Diseasescited by 0
2 more
  1. 2026Abliteration Mitigation via Refusal Aliasescited by 0
  2. 2026AURA: Angular Update Rate Adaptation for training complex-valued neural networkscited by 0