SCOPE: Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization
Not on the map. Why?
Abstract (arXiv)
Black-box combinatorial optimization requires systematically identifying high-quality solutions under a limited evaluation budget, yet the unknown objective function provides little guidance for deciding where the search should explore next. We introduce SCOPE, a general framework for Synthetic Conditional Objectives for Policy Evolution in Black-Box Combinatorial Optimization. Rather than directly optimizing the inaccessible objective, SCOPE learns a set of synthetic objectives conditioned on the accumulated search history, where each objective is designed to expose a distinct and potentially useful preference over candidate solutions. These objectives are then used to evolve search policies that generate diverse candidates, whose true quality is subsequently assessed through black-box evaluations. The outer loop adaptively updates and selects synthetic objectives according to how effectively their induced policies discover promising regions. In contrast, the inner loop returns a portfolio of top-performing policies to reduce the risk of relying on a single surrogate preference. This formulation reframes objective design as a mechanism for guiding policy exploration, enabling the search process to exploit observed evidence while maintaining structured diversity across discrete solution spaces. Extensive experiments across multiple benchmark problems demonstrate that SCOPE consistently improves black-box search performance under limited evaluation budgets and generalizes well across diverse combinatorial structures.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 63 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
30 of 63 references.
References · 30
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
- 2023Teaching Large Language Models to Self-Debugcited by 963
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 492
- 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
18 more
- 2022CodeT: Code Generation with Generated Testscited by 369
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2023Text2Reward: Reward Shaping with Language Models for Reinforcement Learningcited by 153
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
- 2023Motif: Intrinsic Motivation from Artificial Intelligence Feedbackcited by 99
- 2014ParamILS: An Automatic Algorithm Configuration Frameworkcited by 88
- 2019Combinatorial Bayesian Optimization using the Graph Cartesian Productcited by 78
- 2024DrEureka: Language Model Guided Sim-To-Real Transfercited by 78
- 2020Safe Imitation Learning via Fast Bayesian Reward Inference from Preferencescited by 73
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2018Bayesian Optimization of Combinatorial Structurescited by 64
- 2019Bayesian Optimisation over Multiple Continuous and Categorical Inputscited by 55
- 2024Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemblecited by 43
- 2024MaestroMotif: Skill Design from Artificial Intelligence Feedbackcited by 24
- 2025HiFo-Prompt: Prompting with Hindsight and Foresight for LLM-based Automatic Heuristic Designcited by 13
- 2023Automated Design of Metaheuristic Algorithms: A Surveycited by 12
- 2019Stochastic Load Balancing on Unrelated Machinescited by 1
- 2026Back to the Beginning of Heuristic Design: Bridging Code and Knowledge with LLMscited by 1
Built on by
Not cited yet.