Learning to Control Local Search for Combinatorial Optimization
Not on the map. Why?
Abstract (arXiv)
Combinatorial optimization problems are encountered in many practical contexts such as logistics and production, but exact solutions are particularly difficult to find and usually NP-hard for considerable problem sizes. To compute approximate solutions, a zoo of generic as well as problem-specific variants of local search is commonly used. However, which variant to apply to which particular problem is difficult to decide even for experts. In this paper we identify three independent algorithmic aspects of such local search algorithms and formalize their sequential selection over an optimization process as Markov Decision Process (MDP). We design a deep graph neural network as policy model for this MDP, yielding a learned controller for local search called NeuroLS. Ample experimental evidence shows that NeuroLS is able to outperform both, well-known general purpose local search controllers from Operations Research as well as latest machine learning-based approaches.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 27 Jun 2022.
Builds on
33 of 51 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2017Graph Attention Networkscited by 8,923
- 2016Layer Normalizationcited by 5,669
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2015Pointer Networkscited by 895
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2018Implicit Quantile Networks for Distributional Reinforcement Learningcited by 369
21 more
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 318
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 269
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 236
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
- 2020Solving Mixed Integer Programs Using Neural Networkscited by 182
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 164
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 140
- 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
- 2020Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphscited by 115
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 100
- 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
- 2021Graph Neural Network Guided Local Search for the Traveling Salesperson Problemcited by 70
- 2021Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learningcited by 52
- 2017Solving a New 3D Bin Packing Problem with Deep Reinforcement Learning Methodcited by 31
- 2021ScheduleNet: Learn to solve multi-agent scheduling problems with reinforcement learningcited by 31
- 2020Learning to Solve Vehicle Routing Problems with Time Windows through Joint Attentioncited by 29
- 2022Supervised Permutation Invariant Networks for Solving the CVRP with Bounded Fleet Sizecited by 2
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 6; 2026: 2.
18 papers.
Sort:
By area:
- 2024Self-Labeling the Job Shop Scheduling Problemcited by 23
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimizationcited by 14
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategycited by 12
- 2023Too Big, so Fail? -- Enabling Neural Construction Methods to Solve Large-Scale Routing Problemscited by 6
- 2023Routing Arena: A Benchmark Suite for Neural Routing Solverscited by 5
- 2024Moco: A Learnable Meta Optimizer for Combinatorial Optimizationcited by 5
- 2024Offline reinforcement learning for job-shop scheduling problemscited by 2
- 2023Swap-based Deep Reinforcement Learning for Facility Location Problems in Networkscited by 1
- 2024Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problemcited by 1
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimizationcited by 1
- 2023RELS-DQN: A Robust and Efficient Local Search Framework for Combinatorial Optimizationcited by 0
6 more
- 2025Discovering new robust local search algorithms with neuro-evolutioncited by 0
- 2025Unraveling the Rainbow: can value-based methods schedule?cited by 0
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solverscited by 0
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problemscited by 0
- 2026Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop Schedulingcited by 0
- 2026TriSearch: Learning to Optimize Triangulations via Bistellar Flipscited by 0
- 2026TriSearch: Learning to Optimize Triangulations via Bistellar Flips28 May 2026
- 2026Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop Scheduling3 Mar 2026
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimization5 Sep 2025
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problems12 Aug 2025
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solvers4 Aug 2025
- 2025Unraveling the Rainbow: can value-based methods schedule?6 May 2025
- 2025BOPO: Neural Combinatorial Optimization via Best-anchored and Objective-guided Preference Optimization10 Mar 2025
- 2025Discovering new robust local search algorithms with neuro-evolution8 Jan 2025
- 2024Offline reinforcement learning for job-shop scheduling problems21 Oct 2024
- 2024Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problem4 Sep 2024
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Survey20 Jun 2024
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategy11 Feb 2024
6 more
- 2024Moco: A Learnable Meta Optimizer for Combinatorial Optimization7 Feb 2024
- 2024Self-Labeling the Job Shop Scheduling Problem22 Jan 2024
- 2023Swap-based Deep Reinforcement Learning for Facility Location Problems in Networks25 Dec 2023
- 2023Routing Arena: A Benchmark Suite for Neural Routing Solvers6 Oct 2023
- 2023Too Big, so Fail? -- Enabling Neural Construction Methods to Solve Large-Scale Routing Problems29 Sep 2023
- 2023RELS-DQN: A Robust and Efficient Local Search Framework for Combinatorial Optimization11 Apr 2023
- 2024Self-Labeling the Job Shop Scheduling Problemcited by 23
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategycited by 12
- 2023Too Big, so Fail? -- Enabling Neural Construction Methods to Solve Large-Scale Routing Problemscited by 6
- 2023Routing Arena: A Benchmark Suite for Neural Routing Solverscited by 5
- 2024Moco: A Learnable Meta Optimizer for Combinatorial Optimizationcited by 5
- 2023Swap-based Deep Reinforcement Learning for Facility Location Problems in Networkscited by 1
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimizationcited by 1
- 2023RELS-DQN: A Robust and Efficient Local Search Framework for Combinatorial Optimizationcited by 0
- 2025Discovering new robust local search algorithms with neuro-evolutioncited by 0
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solverscited by 0
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problemscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop Scheduling3 Mar 2026
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimization5 Sep 2025
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problems12 Aug 2025
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solvers4 Aug 2025
- 2025Discovering new robust local search algorithms with neuro-evolution8 Jan 2025
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Survey20 Jun 2024
- 2024Rethinking the Capacity of Graph Neural Networks for Branching Strategy11 Feb 2024
- 2024Moco: A Learnable Meta Optimizer for Combinatorial Optimization7 Feb 2024
- 2024Self-Labeling the Job Shop Scheduling Problem22 Jan 2024
- 2023Swap-based Deep Reinforcement Learning for Facility Location Problems in Networks25 Dec 2023
- 2023Routing Arena: A Benchmark Suite for Neural Routing Solvers6 Oct 2023
- 2023Too Big, so Fail? -- Enabling Neural Construction Methods to Solve Large-Scale Routing Problems29 Sep 2023
12 newest of 13 All 13 (JSON)