mlsanityData to 7 Oct 2026

SCOPE: Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization

arXiv 2607.27630 ↗First posted 30 Jul 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Black-box combinatorial optimization requires systematically identifying high-quality solutions under a limited evaluation budget, yet the unknown objective function provides little guidance for deciding where the search should explore next. We introduce SCOPE, a general framework for Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization. Rather than directly optimizing the inaccessible objective, SCOPE learns a set of synthetic objectives conditioned on the accumulated search history, where each objective is designed to expose a distinct and potentially useful preference over candidate solutions. These objectives are then used to evolve search policies that generate diverse candidates, whose true quality is subsequently assessed through black-box evaluations. The outer loop adaptively updates and selects synthetic objectives according to how effectively their induced policies discover promising regions. In contrast, the inner loop returns a portfolio of top-performing policies to reduce the risk of relying on a single surrogate preference. This formulation reframes objective design as a mechanism for guiding policy exploration, enabling the search process to exploit observed evidence while maintaining structured diversity across discrete solution spaces. Extensive experiments across multiple benchmark problems demonstrate that SCOPE consistently improves black-box search performance under limited evaluation budgets and generalizes well across diverse combinatorial structures.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

30 of 63 references.

References · 30

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2017Deep reinforcement learning from human preferencescited by 3,846
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  5. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  6. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  7. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
  8. 2023Teaching Large Language Models to Self-Debugcited by 963
  9. 2021Measuring Coding Challenge Competence With APPScited by 879
  10. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  11. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
  12. 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
18 more
  1. 2022CodeT: Code Generation with Generated Testscited by 369
  2. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  3. 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
  4. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
  5. 2023Motif: Intrinsic Motivation from Artificial Intelligence Feedbackcited by 99
  6. 2014ParamILS: An Automatic Algorithm Configuration Frameworkcited by 88
  7. 2019Combinatorial Bayesian Optimization using the Graph Cartesian Productcited by 78
  8. 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
  9. 2020Safe Imitation Learning via Fast Bayesian Reward Inference from Preferencescited by 73
  10. 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
  11. 2018Bayesian Optimization of Combinatorial Structurescited by 64
  12. 2019Bayesian Optimisation over Multiple Continuous and Categorical Inputscited by 55
  13. 2024Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemblecited by 43
  14. 2024MaestroMotif: Skill Design from Artificial Intelligence Feedbackcited by 24
  15. 2025HiFo-Prompt: Prompting with Hindsight and Foresight for LLM-based Automatic Heuristic Designcited by 13
  16. 2023Automated Design of Metaheuristic Algorithms: A Surveycited by 12
  17. 2019Stochastic Load Balancing on Unrelated Machinescited by 1
  18. 2026Back to the Beginning of Heuristic Design: Bridging Code and Knowledge with LLMscited by 1

Built on by

Not cited yet.