mlsanityData to 14 Oct 2026

Constraint-Aware Discrete Black-Box Optimization Using Tensor Decomposition

arXiv 2609.09370 ↗First posted 8 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Discrete black-box optimization is often addressed using approaches such as Sequential Model-Based Optimization (SMBO), which aims to improve sample efficiency by fitting surrogate models that approximate a costly objective function over a discrete search space. In many real-world problems, the set of feasible inputs is often given by logical constraints known in advance. However, existing surrogate modeling techniques generally fail to capture the symbolic rules governing feasibility in discrete input spaces. In this paper, we propose a surrogate modeling approach based on tensor decomposition that captures the structure of discrete search spaces while directly integrating feasibility information. To implement this approach, we formulate surrogate model training as a constrained polynomial optimization problem and solve a relaxed formulation using a differentiable penalty term derived from T-norms. Our experiments on both synthetic and real-world benchmarks, including a pressure vessel design task, demonstrate that the proposed method improves sample efficiency by effectively guiding the search away from infeasible regions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 35 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

18 of 35 references.

References · 18

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018A Tutorial on Bayesian Optimizationcited by 744
  3. 2019AutoML: A Survey of the State-of-the-Artcited by 390
  4. 2017A Semantic Loss Function for Deep Learning with Symbolic Knowledgecited by 270
  5. 2020Logic Tensor Networkscited by 199
  6. 2017Neural-Symbolic Learning and Reasoning: A Survey and Interpretationcited by 196
  7. 2023Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performancecited by 147
  8. 2016Tensor Ring Decompositioncited by 127
  9. 2014Bayesian Optimization with Unknown Constraintscited by 109
  10. 2022Semantic Probabilistic Layers for Neuro-Symbolic Learningcited by 103
  11. 2015Bayesian optimization for materials designcited by 80
  12. 2016Bayesian optimization under mixed constraints with a slack-variable augmented Lagrangiancited by 29
6 more
  1. 2024A survey and benchmark of high-dimensional Bayesian optimization of discrete sequencescited by 23
  2. 2021Constrained Discrete Black-Box Optimization using Mixed-Integer Programmingcited by 16
  3. 2022TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learningcited by 15
  4. 2022Tree ensemble kernels for Bayesian optimization with known constraints over mixed-feature spacescited by 14
  5. 2023Learning Regions of Interest for Bayesian Optimization with Adaptive Level-Set Estimationcited by 8
  6. 2022Optimization of Functions Given in the Tensor Train Formatcited by 7

Built on by

Not cited yet.