DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimization
Not on the map. Why?
Abstract (arXiv)
Ant Colony Optimization (ACO) is a meta-heuristic algorithm that has been successfully applied to various Combinatorial Optimization Problems (COPs). Traditionally, customizing ACO for a specific problem requires the expert design of knowledge-driven heuristics. In this paper, we propose DeepACO, a generic framework that leverages deep reinforcement learning to automate heuristic designs. DeepACO serves to strengthen the heuristic measures of existing ACO algorithms and dispense with laborious manual design in future ACO applications. As a neural-enhanced meta-heuristic, DeepACO consistently outperforms its ACO counterparts on eight COPs using a single neural architecture and a single set of hyperparameters. As a Neural Combinatorial Optimization method, DeepACO performs better than or on par with problem-specific methods on canonical routing problems. Our code is publicly available at https://github.com/henry-yeh/DeepACO.
Key facts. Cited by 77 papers in the map (data through 7 Oct 2026). Builds on 50 of its 95 references that are in the map. First posted on arXiv 25 Sep 2023.
Builds on
50 of 95 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2015Pointer Networkscited by 882
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 557
38 more
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 265
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 183
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 162
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 161
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 127
- 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 102
- 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
- 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 99
- 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
- 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2021Graph Neural Network Guided Local Search for the Traveling Salesperson Problemcited by 70
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2021The Transformer Network for the Traveling Salesman Problemcited by 59
- 2023Pointerformer: Deep Reinforced Multi-Pointer Transformer for the Traveling Salesman Problemcited by 49
- 2021Learning to Schedule Heuristics in Branch-and-Boundcited by 45
- 2023H-TSP: Hierarchically Solving the Large-Scale Travelling Salesman Problemcited by 43
- 2021Learning Large Neighborhood Search Policy for Integer Programmingcited by 35
- 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
- 2022Learning to Solve Vehicle Routing Problems: A Surveycited by 16
- 2020Boosting Ant Colony Optimization via Solution Prediction and Machine Learningcited by 7
- 2023Neural Airport Ground Handlingcited by 7
- 2022Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problemcited by 6
- 2022Improving Ant Colony Optimization Efficiency for Solving Large TSP Instancescited by 6
- 2022Neural Combinatorial Optimization: a New Player in the Fieldcited by 6
- 2017An improved Ant Colony System for the Sequential Ordering Problemcited by 1
- 2020A Weighted Population Update Rule for PACO Applied to the Single Machine Total Weighted Tardiness Problemcited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 22; 2025: 36; 2026: 18.
77 papers.
Sort:
By area:
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2024Learning to Handle Complex Constraints for Vehicle Routing Problemscited by 29
- 2025Large Language Models as End-to-end Combinatorial Optimization Solverscited by 27
- 2024Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithmscited by 23
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
- 2025Preference Optimization for Combinatorial Optimization Problemscited by 11
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problemscited by 10
38 more
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problemscited by 10
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 10
- 2025FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimizationcited by 10
- 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimizationcited by 8
- 2024LLMs for Cold-Start Cutting Plane Separator Configurationcited by 8
- 2024Ensembling Prioritized Hybrid Policies for Multi-agent Pathfindingcited by 7
- 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimizationcited by 7
- 2025Learning-Guided Rolling Horizon Optimization for Long-Horizon Flexible Job-Shop Schedulingcited by 7
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 7
- 2025Hybrid-Balance GFlowNet for Solving Vehicle Routing Problemscited by 7
- 2024Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and Morecited by 6
- 2025Learning for routing: A guided review of recent developments and future directionscited by 6
- 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problemscited by 6
- 2024Moco: A Learnable Meta Optimizer for Combinatorial Optimizationcited by 5
- 2024Neural Solver Selection for Combinatorial Optimizationcited by 5
- 2025Neural Genetic Search in Discrete Spacescited by 5
- 2025Learning to Segment for Vehicle Routing Problemscited by 5
- 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMscited by 5
- 2024A Unified Framework for Combinatorial Optimization Based on Graph Neural Networkscited by 4
- 2024Memory-Enhanced Neural Solvers for Routing Problemscited by 4
- 2025RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Modelscited by 4
- 2026Survey on Neural Routing Solverscited by 4
- 2024Learning Heuristics for Transit Network Design and Improvement with Deep Reinforcement Learningcited by 3
- 2024MARCO: A Memory-Augmented Reinforcement Framework for Combinatorial Optimizationcited by 3
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLMcited by 3
- 2025Probing Neural Combinatorial Optimization Modelscited by 3
- 2026TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Designcited by 3
- 2023An Edge-Aware Graph Autoencoder Trained on Scale-Imbalanced Data for Traveling Salesman Problemscited by 2
- 2025Pheromone-based Learning of Optimal Reasoning Pathscited by 2
- 2025Unrealized Expectations: Comparing AI Methods vs Classical Algorithms for Maximum Independent Setcited by 2
- 2025Accelerating Vehicle Routing via AI-Initialized Genetic Algorithmscited by 2
- 2026RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experiencecited by 2
- 2024On Size and Hardness Generalization in Unsupervised Learning for the Travelling Salesman Problemcited by 1
- 2025USPR: Learning a Unified Solver for Profiled Routingcited by 1
- 2025Multimodal Fused Learning for Solving the Generalized Traveling Salesman Problem in Robotic Task Planningcited by 1
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problemscited by 1
50 most cited of 77 All 77 (JSON)
- 2026SimpleEvol: An Agent-Loop Framework for LLM-Driven Automated Heuristic Design with Minimal Human Priors29 Sep 2026
- 2026Just Initialize: A Training-Free Initialization Component for Large-Scale Routing Optimization28 Sep 2026
- 2026Learning Spatiotemporal Decision Priors for Efficient Path Planning under Partial Observability24 Jul 2026
- 2026RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experience13 Jul 2026
- 2026Beyond Static Priors: Dynamic Neural Guidance for Large-Scale Ant Colony Optimization2 Jun 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Neural Cluster First, Route Second: Capacitated Vehicle Routing via Differentiable Optimal Transport10 May 2026
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
- 2026Aligning LLMs with Graph Neural Solvers for Combinatorial Optimization28 Mar 2026
- 2026SRG: Score-based Relaxation-guided Generation for Mixed Integer Linear Programming25 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Beyond Solving: Prescriptive Probing for Neural Routing Solvers6 Feb 2026
38 more
- 2026Small Shifts, Large Gains: Unlocking Traditional TSP Heuristic Guided-Sampling via Unsupervised Neural Instance Modification31 Jan 2026
- 2026Beyond the Node: Clade-level Selection for Efficient MCTS in Automatic Heuristic Design31 Jan 2026
- 2026TIDE: Tuning-Integrated Dynamic Evolution for LLM-Based Automated Heuristic Design29 Jan 2026
- 2026PathWise: Planning through World Model for Automated Heuristic Design via Self-Evolving LLMs28 Jan 2026
- 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problems26 Jan 2026
- 2026Enabling Population-Based Architectures for Neural Combinatorial Optimization13 Jan 2026
- 2025CogMCTS: A Novel Cognitive-Guided Monte Carlo Tree Search Framework for Iterative Heuristic Evolution with Large Language Models9 Dec 2025
- 2025Probing Neural Combinatorial Optimization Models25 Oct 2025
- 2025Empowering Targeted Neighborhood Search via Hyper Tour for Large-Scale TSP23 Oct 2025
- 2025Multi-Action Self-Improvement for Neural Combinatorial Optimization14 Oct 2025
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLM13 Oct 2025
- 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems8 Oct 2025
- 2025Hybrid-Balance GFlowNet for Solving Vehicle Routing Problems6 Oct 2025
- 2025Test-Time Search in Neural Graph Coarsening Procedures for the Capacitated Vehicle Routing Problem1 Oct 2025
- 2025ViTSP: A Vision Language Models Guided Framework for Solving Large-Scale Traveling Salesman Problems27 Sep 2025
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalization27 Sep 2025
- 2025Large Language Models as End-to-end Combinatorial Optimization Solvers21 Sep 2025
- 2025Learn to Relax with Large Language Models: Solving Constraint Optimization Problems via Bidirectional Coevolution16 Sep 2025
- 2025An Efficient Hybridization of Graph Representation Learning and Metaheuristics for the Constrained Incremental Graph Drawing Problem21 Aug 2025
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problems12 Aug 2025
- 2025Hybrid Node-Destroyer Model with Large Neighborhood Search for Solving the Capacitated Vehicle Routing Problem12 Aug 2025
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solvers4 Aug 2025
- 2025Learning for routing: A guided review of recent developments and future directions30 Jun 2025
- 2025Learning to Segment for Vehicle Routing Problems22 Jun 2025
- 2025Multimodal Fused Learning for Solving the Generalized Traveling Salesman Problem in Robotic Task Planning20 Jun 2025
- 2025Latent Guided Sampling for Combinatorial Optimization4 Jun 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimization27 May 2025
- 2025RedAHD: Reduction-Based End-to-End Automatic Heuristic Design with Large Language Models26 May 2025
- 2025FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimization22 May 2025
- 2025Preference Optimization for Combinatorial Optimization Problems13 May 2025
- 2025USPR: Learning a Unified Solver for Profiled Routing8 May 2025
- 2025Accelerating Vehicle Routing via AI-Initialized Genetic Algorithms8 Apr 2025
- 2025Multi-Dimensional AGV Path Planning in 3D Warehouses Using Ant Colony Optimization and Advanced Neural Networks30 Mar 2025
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimization20 Mar 2025
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problems3 Mar 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2025Learning-Guided Rolling Horizon Optimization for Long-Horizon Flexible Job-Shop Scheduling18 Feb 2025
- 2025Neural Genetic Search in Discrete Spaces9 Feb 2025
50 newest of 77 All 77 (JSON)
- 2025Pheromone-based Learning of Optimal Reasoning Pathscited by 2
- 2025Pheromone-based Learning of Optimal Reasoning Paths31 Jan 2025
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2024Learning to Handle Complex Constraints for Vehicle Routing Problemscited by 29
- 2025Large Language Models as End-to-end Combinatorial Optimization Solverscited by 27
- 2024Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithmscited by 23
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problemscited by 10
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problemscited by 10
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 10
12 most cited of 71 All 71 (JSON)
- 2026Just Initialize: A Training-Free Initialization Component for Large-Scale Routing Optimization28 Sep 2026
- 2026Learning Spatiotemporal Decision Priors for Efficient Path Planning under Partial Observability24 Jul 2026
- 2026RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experience13 Jul 2026
- 2026Beyond Static Priors: Dynamic Neural Guidance for Large-Scale Ant Colony Optimization2 Jun 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Neural Cluster First, Route Second: Capacitated Vehicle Routing via Differentiable Optimal Transport10 May 2026
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
- 2026Aligning LLMs with Graph Neural Solvers for Combinatorial Optimization28 Mar 2026
- 2026SRG: Score-based Relaxation-guided Generation for Mixed Integer Linear Programming25 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Beyond Solving: Prescriptive Probing for Neural Routing Solvers6 Feb 2026
- 2026Small Shifts, Large Gains: Unlocking Traditional TSP Heuristic Guided-Sampling via Unsupervised Neural Instance Modification31 Jan 2026
12 newest of 71 All 71 (JSON)