Global optimization of Lipschitz functions
Not on the map. Why?
Abstract (arXiv)
The goal of the paper is to design sequential strategies which lead to efficient optimization of an unknown function under the only assumption that it has a finite Lipschitz constant. We first identify sufficient conditions for the consistency of generic sequential algorithms and formulate the expected minimax rate for their performance. We introduce and analyze a first algorithm called LIPO which assumes the Lipschitz constant to be known. Consistency, minimax rates for LIPO are proved, as well as fast rates under an additional H"older like condition. An adaptive version of LIPO is also introduced for the more realistic setup where the Lipschitz constant is unknown and has to be estimated along with the optimization. Similar theoretical guarantees are shown to hold for the adaptive LIPO algorithm and a numerical assessment is provided at the end of the paper to illustrate the potential of this strategy with respect to state-of-the-art methods over typical benchmark problems for global optimization.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 8; 2023: 7; 2024: 6; 2025: 4; 2026: 3.
39 papers.
Sort:
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2024Task Facet Learning: A Structured Approach to Prompt Optimizationcited by 17
- 2021Discrepancy-Based Active Learning for Domain Adaptationcited by 16
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2024On Safety in Safe Bayesian Optimizationcited by 15
- 2021GoTube: Scalable Stochastic Verification of Continuous-Depth Modelscited by 12
- 2022Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functionscited by 11
- 2022On the Generalization for Transfer Learning: An Information-Theoretic Analysiscited by 11
- 2023Max-Sliced Mutual Informationcited by 10
- 2021Cumulative Regret Analysis of the Piyavskii--Shubert Algorithm and Its Variants for Global Optimizationcited by 9
- 2021Instance-Dependent Bounds for Zeroth-order Lipschitz Optimization with Error Certificatescited by 7
- 2022Global Optimization with Parametric Function Approximationcited by 7
27 more
- 2022Comparative analysis of machine learning methods for active flow controlcited by 6
- 2024Boosting Soft Q-Learning by Boundingcited by 4
- 2021Optimised one-class classification performancecited by 3
- 2021Query Attack by Multi-Identity Surrogatescited by 3
- 2023Certified Multi-Fidelity Zeroth-Order Optimizationcited by 3
- 2025Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constantscited by 3
- 2022Efficient Minimax Optimal Global Optimization of Lipschitz Continuous Multivariate Functionscited by 2
- 2024Stein Boltzmann Sampling: A Variational Approach for Global Optimizationcited by 2
- 2024Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributionscited by 2
- 2025ECPv2: Fast, Efficient, and Scalable Global Optimization of Lipschitz Functionscited by 2
- 2021Wave-Informed Matrix Factorization with Global Optimality Guaranteescited by 1
- 2022Combining Lipschitz and RBF Surrogate Models for High-dimensional Computationally Expensive Problemscited by 1
- 2023A unified weighting framework for evaluating nearest neighbour classificationcited by 1
- 2026Active Bipartite Ranking with Smooth Posterior Distributionscited by 1
- 2021Training Deep Neural Networks via Branch-and-Boundcited by 0
- 2021High-Dimensional Simulation Optimization via Brownian Fields and Sparse Gridscited by 0
- 2021Power of human-algorithm collaboration in solving combinatorial optimization problemscited by 0
- 20221D to nD: A Meta Algorithm for Multivariate Global Optimization via Univariate Optimizerscited by 0
- 2023Multi-task neural networks by learned contextual inputscited by 0
- 2023Efficient Lipschitzian Global Optimization of H"older Continuous Multivariate Functionscited by 0
- 2023Robustness Analysis of Continuous-Depth Models with Lagrangian Techniquescited by 0
- 2023Wave Physics-informed Matrix Factorizationscited by 0
- 2024Beyond Trend Following: Deep Learning for Market Trend Predictioncited by 0
- 2025Hadamard-Riemannian Optimization for Margin-Variance Ensemblecited by 0
- 2025Signal-Aware Workload Shifting Algorithms with Uncertainty-Quantified Predictorscited by 0
- 2026A Unified Non-Parametric and Interpretable Point Cloud Analysis via t-FCW Graph Representationcited by 0
- 2026Lipschitz Optimization for Formal Verification of Homographiescited by 0
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026A Unified Non-Parametric and Interpretable Point Cloud Analysis via t-FCW Graph Representation14 May 2026
- 2026Active Bipartite Ranking with Smooth Posterior Distributions27 Feb 2026
- 2025ECPv2: Fast, Efficient, and Scalable Global Optimization of Lipschitz Functions20 Nov 2025
- 2025Signal-Aware Workload Shifting Algorithms with Uncertainty-Quantified Predictors30 Sep 2025
- 2025Hadamard-Riemannian Optimization for Margin-Variance Ensemble12 Sep 2025
- 2025Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constants6 Feb 2025
- 2024Boosting Soft Q-Learning by Bounding26 Jun 2024
- 2024Task Facet Learning: A Structured Approach to Prompt Optimization15 Jun 2024
- 2024Beyond Trend Following: Deep Learning for Market Trend Prediction10 Jun 2024
- 2024On Safety in Safe Bayesian Optimization19 Mar 2024
- 2024Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions23 Feb 2024
27 more
- 2024Stein Boltzmann Sampling: A Variational Approach for Global Optimization7 Feb 2024
- 2023Wave Physics-informed Matrix Factorizations21 Dec 2023
- 2023A unified weighting framework for evaluating nearest neighbour classification28 Nov 2023
- 2023Max-Sliced Mutual Information28 Sep 2023
- 2023Robustness Analysis of Continuous-Depth Models with Lagrangian Techniques23 Aug 2023
- 2023Certified Multi-Fidelity Zeroth-Order Optimization2 Aug 2023
- 2023Efficient Lipschitzian Global Optimization of H"older Continuous Multivariate Functions24 Mar 2023
- 2023Multi-task neural networks by learned contextual inputs1 Mar 2023
- 2022Global Optimization with Parametric Function Approximation16 Nov 2022
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distances17 Oct 2022
- 20221D to nD: A Meta Algorithm for Multivariate Global Optimization via Univariate Optimizers6 Sep 2022
- 2022On the Generalization for Transfer Learning: An Information-Theoretic Analysis12 Jul 2022
- 2022Efficient Minimax Optimal Global Optimization of Lipschitz Continuous Multivariate Functions6 Jun 2022
- 2022Combining Lipschitz and RBF Surrogate Models for High-dimensional Computationally Expensive Problems29 Apr 2022
- 2022Comparative analysis of machine learning methods for active flow control23 Feb 2022
- 2022Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functions18 Jan 2022
- 2021Cumulative Regret Analysis of the Piyavskii--Shubert Algorithm and Its Variants for Global Optimization24 Aug 2021
- 2021Power of human-algorithm collaboration in solving combinatorial optimization problems25 Jul 2021
- 2021Wave-Informed Matrix Factorization with Global Optimality Guarantees19 Jul 2021
- 2021High-Dimensional Simulation Optimization via Brownian Fields and Sparse Grids19 Jul 2021
- 2021GoTube: Scalable Stochastic Verification of Continuous-Depth Models18 Jul 2021
- 2021Query Attack by Multi-Identity Surrogates31 May 2021
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure23 Apr 2021
- 2021Training Deep Neural Networks via Branch-and-Bound5 Apr 2021
- 2021Discrepancy-Based Active Learning for Domain Adaptation5 Mar 2021
- 2021Optimised one-class classification performance4 Feb 2021
- 2021Instance-Dependent Bounds for Zeroth-order Lipschitz Optimization with Error Certificates3 Feb 2021
- 2022Statistical, Robustness, and Computational Guarantees for Sliced Wasserstein Distancescited by 41
- 2024Task Facet Learning: A Structured Approach to Prompt Optimizationcited by 17
- 2021Discrepancy-Based Active Learning for Domain Adaptationcited by 16
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2024On Safety in Safe Bayesian Optimizationcited by 15
- 2021GoTube: Scalable Stochastic Verification of Continuous-Depth Modelscited by 12
- 2022Low Regret Binary Sampling Method for Efficient Global Optimization of Univariate Functionscited by 11
- 2022On the Generalization for Transfer Learning: An Information-Theoretic Analysiscited by 11
- 2023Max-Sliced Mutual Informationcited by 10
- 2021Cumulative Regret Analysis of the Piyavskii--Shubert Algorithm and Its Variants for Global Optimizationcited by 9
- 2021Instance-Dependent Bounds for Zeroth-order Lipschitz Optimization with Error Certificatescited by 7
- 2022Global Optimization with Parametric Function Approximationcited by 7
12 most cited of 39 All 39 (JSON)
- 2026Lipschitz Optimization for Formal Verification of Homographies22 May 2026
- 2026A Unified Non-Parametric and Interpretable Point Cloud Analysis via t-FCW Graph Representation14 May 2026
- 2026Active Bipartite Ranking with Smooth Posterior Distributions27 Feb 2026
- 2025ECPv2: Fast, Efficient, and Scalable Global Optimization of Lipschitz Functions20 Nov 2025
- 2025Signal-Aware Workload Shifting Algorithms with Uncertainty-Quantified Predictors30 Sep 2025
- 2025Hadamard-Riemannian Optimization for Margin-Variance Ensemble12 Sep 2025
- 2025Every Call is Precious: Global Optimization of Black-Box Functions with Unknown Lipschitz Constants6 Feb 2025
- 2024Boosting Soft Q-Learning by Bounding26 Jun 2024
- 2024Task Facet Learning: A Structured Approach to Prompt Optimization15 Jun 2024
- 2024Beyond Trend Following: Deep Learning for Market Trend Prediction10 Jun 2024
- 2024On Safety in Safe Bayesian Optimization19 Mar 2024
- 2024Parameter-Free Algorithms for Performative Regret Minimization under Decision-Dependent Distributions23 Feb 2024
12 newest of 39 All 39 (JSON)