mlsanityData to 7 Oct 2026

BEACON: A Bayesian Optimization Inspired Strategy for Efficient Novelty Search

arXiv 2406.03616 ↗First posted 5 Jun 2024stat.ML cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Novelty search (NS) aims to uncover diverse system behaviors through simulation or experiment without requiring a pre-specified scalar objective. This capability is especially relevant to modern discovery problems in chemistry, materials science, and molecular design, where researchers often seek broad coverage of attainable property space rather than a single optimum and where each evaluation may require a costly computation or experiment. For such expensive black-box settings, we propose BEACON, a sample-efficient NS strategy inspired by Bayesian optimization principles. BEACON models the input-to-outcome mapping using multi-output Gaussian processes and selects new inputs by scoring how far plausible posterior outcomes lie from a denoised archive of previously observed outcomes. This gives a distance-based novelty acquisition that accounts for predictive uncertainty and observational noise while operating directly in continuous outcome space, rather than requiring direct optimization over a discretized partition of behaviors. By leveraging efficient posterior sampling together with scalable high-dimensional Gaussian process models, the proposed framework can be extended to settings with large data sets and high-dimensional design variables. We demonstrate BEACON on established benchmark problems together with real-world case studies in materials and molecular discovery. Across these settings, BEACON consistently discovers broader sets of distinct behaviors than several competing baselines under limited evaluation budgets.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 74 references that are in the map. First posted on arXiv 5 Jun 2024.

Builds on

21 of 74 references.

References · 21

  1. 2016OpenAI Gymcited by 1,684
  2. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
  3. 2018A Tutorial on Bayesian Optimizationcited by 734
  4. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 603
  5. 2015Illuminating search spaces by mapping elitescited by 406
  6. 2017On Kernelized Multi-armed Banditscited by 348
  7. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 176
  8. 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 144
  9. 2016GPflow: A Gaussian process library using TensorFlowcited by 139
  10. 2021High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspacescited by 139
  11. 2020Efficiently Sampling Functions from Gaussian Process Posteriorscited by 125
  12. 2013A Literature Survey of Benchmark Functions For Global Optimization Problemscited by 75
9 more
  1. 2020SoftSort: A Continuous Relaxation for the argsort Operatorcited by 66
  2. 2022GAUCHE: A Library for Gaussian Processes in Chemistrycited by 40
  3. 2020Scalable Thompson Sampling using Sparse Gaussian Process Modelscited by 39
  4. 2021Bayesian Optimization with High-Dimensional Outputscited by 32
  5. 2022Discovering Many Diverse Solutions with Bayesian Optimizationcited by 29
  6. 2022Fast Bayesian Optimization of Needle-in-a-Haystack Problems using Zooming Memory-Based Initialization (ZoMBI)cited by 14
  7. 2019Novelty Search for Deep Reinforcement Learning Policy Network Weights by Action Sequence Edit Metric Distancecited by 9
  8. 2020Novelty Search makes Evolvability Inevitablecited by 6
  9. 2024Accelerating Black-Box Molecular Property Optimization by Adaptively Learning Sparse Subspacescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.