Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problems
Not on the map. Why?
Abstract (arXiv)
We present a novel deep reinforcement learning method to learn construction heuristics for vehicle routing problems. In specific, we propose a Multi-Decoder Attention Model (MDAM) to train multiple diverse policies, which effectively increases the chance of finding good solutions compared with existing methods that train only one policy. A customized beam search strategy is designed to fully exploit the diversity of MDAM. In addition, we propose an Embedding Glimpse layer in MDAM based on the recursive nature of construction, which can improve the quality of each policy by providing more informative embeddings. Extensive experiments on six different routing problems show that our method significantly outperforms the state-of-the-art deep learning based models.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 13; 2023: 22; 2024: 18; 2025: 24; 2026: 13.
100 papers.
Sort:
By area:
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 127
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 102
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
38 more
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2024INViT: A Generalizable Routing Problem Solver with Invariant Nested View Transformercited by 43
- 2023Combinatorial Optimization with Policy Adaptation using Latent Space Searchcited by 41
- 2024GOAL: A Generalist Combinatorial Optimization Agent Learnercited by 39
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2021Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learningcited by 35
- 2021Learning Large Neighborhood Search Policy for Integer Programmingcited by 35
- 2024PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimizationcited by 35
- 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvementcited by 32
- 2021Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problemcited by 31
- 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
- 2024Self-Improved Learning for Scalable Neural Combinatorial Optimizationcited by 29
- 2024Learning to Handle Complex Constraints for Vehicle Routing Problemscited by 29
- 2023ASP: Learn a Universal Neural Solver!cited by 27
- 2024Cross-Problem Learning for Solving Vehicle Routing Problemscited by 24
- 2023Meta-SAGE: Scale Meta-Learning Scheduled Adaptation with Guided Exploration for Mitigating Scale Shift on Combinatorial Optimizationcited by 23
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2021An Overview and Experimental Study of Learning-based Optimization Algorithms for Vehicle Routing Problemcited by 22
- 2023Efficient Meta Neural Heuristic for Multi-Objective Combinatorial Optimizationcited by 21
- 2021Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problemscited by 20
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
- 2022Learning to Solve Vehicle Routing Problems: A Surveycited by 16
- 2025Learning to Reduce Search Space for Generalizable Neural Routing Solvercited by 14
- 2023Neural Multi-Objective Combinatorial Optimization with Diversity Enhancementcited by 13
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
- 2022Reinforced Lin-Kernighan-Helsgaun Algorithms for the Traveling Salesman Problemscited by 12
- 2023Continuation Path Learning for Homotopy Optimizationcited by 12
- 2025Preference Optimization for Combinatorial Optimization Problemscited by 11
- 2023Learning Large Neighborhood Search for Vehicle Routing in Airport Ground Handlingcited by 10
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problemscited by 10
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problemscited by 10
- 2025Learning to Insert for Constructive Neural Vehicle Routing Solvercited by 10
- 2025An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problemcited by 9
50 most cited of 100 All 100 (JSON)
- 2026MiLoop: Selective Memory Propagation for Neural Combinatorial Optimization1 Oct 2026
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026Baseline-Free Policy Optimization for Neural Combinatorial Optimization9 Jun 2026
- 2026Deft Scheduling of Dynamic Cloud Workflows with Varying Deadlines via Mixture-of-Experts31 May 2026
- 2026MViewRouter: Internalizing Geometric Equivariance via Multi-view Alternating Attention for Combinatorial Routing31 May 2026
- 2026LINC: Decoupling Local Consequence Scoring from Hidden Matching in Constructive Neural Routing7 May 2026
- 2026Critic-Free Deep Reinforcement Learning for Maritime Coverage Path Planning on Irregular Hexagonal Grids30 Mar 2026
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solvers28 Feb 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026GREAT-EER: Graph Edge Attention Network for Emergency Evacuation Responses16 Feb 2026
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problems27 Jan 2026
38 more
- 2026Generating Diverse TSP Tours via a Combination of Graph Pointer Network and Dispersion3 Jan 2026
- 2025Enhancing the Cross-Size Generalization for Solving Vehicle Routing Problems via Continual Learning11 Oct 2025
- 2025A Unified Deep Reinforcement Learning Approach for Close Enough Traveling Salesman Problem3 Oct 2025
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimization5 Sep 2025
- 2025Edge-Selector Model Applied for Local Search Neighborhood for Solving Vehicle Routing Problems12 Aug 2025
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solvers4 Aug 2025
- 2025VAGPO: Vision-augmented Asymmetric Group Preference Optimization for Graph Routing Problems3 Aug 2025
- 2025Efficient Neural Combinatorial Optimization Solver for the Min-max Heterogeneous Capacitated Vehicle Routing Problem28 Jul 2025
- 2025LRM-1B: Towards Large Routing Model4 Jul 2025
- 2025Learning for routing: A guided review of recent developments and future directions30 Jun 2025
- 2025EFormer: An Effective Edge-based Transformer for Vehicle Routing Problems19 Jun 2025
- 2025Latent Guided Sampling for Combinatorial Optimization4 Jun 2025
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver3 Jun 2025
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degrees30 May 2025
- 2025Learning to Search for Vehicle Routing with Multiple Time Windows29 May 2025
- 2025Learning to Insert for Constructive Neural Vehicle Routing Solver20 May 2025
- 2025Preference Optimization for Combinatorial Optimization Problems13 May 2025
- 2025Multi-Dimensional AGV Path Planning in 3D Warehouses Using Ant Colony Optimization and Advanced Neural Networks30 Mar 2025
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problems16 Mar 2025
- 2025Learning to Reduce Search Space for Generalizable Neural Routing Solver5 Mar 2025
- 2025Adversarial Generative Flow Network for Solving Vehicle Routing Problems3 Mar 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptation15 Feb 2025
- 2025An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problem23 Jan 2025
- 2025Diversity Optimization for Travelling Salesman Problem via Deep Reinforcement Learning1 Jan 2025
- 2024DeepMDV: Global Spatial Matching for Multi-depot Vehicle Routing Problems26 Nov 2024
- 2024Learn to Solve Vehicle Routing Problems ASAP: A Neural Optimization Approach for Time-Constrained Vehicle Routing Problems with Finite Vehicle Fleet7 Nov 2024
- 2024Learning to Handle Complex Constraints for Vehicle Routing Problems28 Oct 2024
- 2024Take a Step and Reconsider: Sequence Decoding for Self-Improved Neural Combinatorial Optimization24 Jul 2024
- 2024DISCO: Efficient Diffusion Solver for Large-Scale Combinatorial Optimization Problems28 Jun 2024
- 2024Memory-Enhanced Neural Solvers for Routing Problems24 Jun 2024
- 2024GOAL: A Generalist Combinatorial Optimization Agent Learner21 Jun 2024
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives1 Jun 2024
- 2024Cross-Problem Learning for Solving Vehicle Routing Problems17 Apr 2024
- 2024Deep Reinforcement Learning for Traveling Purchaser Problems3 Apr 2024
- 2024Self-Improved Learning for Scalable Neural Combinatorial Optimization28 Mar 2024
- 2024Less Is More -- On the Importance of Sparsification for Transformers and Graph Neural Networks for TSP25 Mar 2024
- 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvement22 Mar 2024
50 newest of 100 All 100 (JSON)
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2025An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problemcited by 9
- 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptationcited by 1
- 2025Boosting Cross-problem Generalization in Diffusion-Based Neural Combinatorial Solver via Inference Time Adaptation15 Feb 2025
- 2025An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problem23 Jan 2025
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization16 Feb 2023
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
- 2022DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problemscited by 127
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021NeuroLKH: Combining Deep Learning Model with Lin-Kernighan-Helsgaun Heuristic for Solving the Traveling Salesman Problemcited by 102
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
12 most cited of 94 All 94 (JSON)
- 2026MiLoop: Selective Memory Propagation for Neural Combinatorial Optimization1 Oct 2026
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026MViewRouter: Internalizing Geometric Equivariance via Multi-view Alternating Attention for Combinatorial Routing31 May 2026
- 2026LINC: Decoupling Local Consequence Scoring from Hidden Matching in Constructive Neural Routing7 May 2026
- 2026Critic-Free Deep Reinforcement Learning for Maritime Coverage Path Planning on Irregular Hexagonal Grids30 Mar 2026
- 2026Efficient Decoder Scaling Strategy for Neural Routing Solvers28 Feb 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026GREAT-EER: Graph Edge Attention Network for Emergency Evacuation Responses16 Feb 2026
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problems27 Jan 2026
- 2026Generating Diverse TSP Tours via a Combination of Graph Pointer Network and Dispersion3 Jan 2026
- 2025Enhancing the Cross-Size Generalization for Solving Vehicle Routing Problems via Continual Learning11 Oct 2025
12 newest of 94 All 94 (JSON)