Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalization
Not on the map. Why?
Abstract (arXiv)
Vehicle routing problems (VRPs), which can be found in numerous real-world applications, have been an important research topic for several decades. Recently, the neural combinatorial optimization (NCO) approach that leverages a learning-based model to solve VRPs without manual algorithm design has gained substantial attention. However, current NCO methods typically require building one model for each routing problem, which significantly hinders their practical application for real-world industry problems with diverse attributes. In this work, we make the first attempt to tackle the crucial challenge of cross-problem generalization. In particular, we formulate VRPs as different combinations of a set of shared underlying attributes and solve them simultaneously via a single model through attribute composition. In this way, our proposed model can successfully solve VRPs with unseen attribute combinations in a zero-shot generalization manner. Extensive experiments are conducted on eleven VRP variants, benchmark datasets, and industry logistic scenarios. The results show that the unified model demonstrates superior performance in the eleven VRPs, reducing the average gap to around 5% from over 20% in the existing approach and achieving a significant performance boost on benchmark datasets as well as a real-world logistics application. The source code is included in https://github.com/FeiLiu36/MTNCO.
Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). Builds on 27 of its 53 references that are in the map. First posted on arXiv 23 Feb 2024.
Builds on
27 of 53 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2015Pointer Networkscited by 895
- 2017A Survey on Multi-Task Learningcited by 840
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
- 2018Attention, Learn to Solve Routing Problems!cited by 656
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 538
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
15 more
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 185
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 162
- 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
- 2017Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learningcited by 98
- 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 98
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 62
- 2022Pareto Set Learning for Neural Multi-objective Combinatorial Optimizationcited by 56
- 2021Independent Prototype Propagation for Zero-Shot Compositionalitycited by 42
- 2021Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustnesscited by 35
- 2021Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problemcited by 31
- 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
- 2022On the Generalization of Neural Combinatorial Optimization Heuristicscited by 24
- 2021Analytics and Machine Learning in Vehicle Routing Researchcited by 22
- 2019A concise guide to existing and emerging vehicle routing problem variantscited by 17
Built on by
Citing papers per year: 2024: 11; 2025: 20; 2026: 19.
50 papers.
Sort:
By area:
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 70
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 55
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 37
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2025Learning to Reduce Search Space for Generalizable Neural Routing Solvercited by 14
- 2025ARS: Automatic Routing Solver with Large Language Modelscited by 13
- 2025FlexiReg: Flexible Urban Region Representation Learningcited by 13
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 11
- 2024Instance-Conditioned Adaptation for Large-scale Generalization of Neural Routing Solvercited by 9
38 more
- 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimizationcited by 8
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degreescited by 8
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 8
- 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimizationcited by 7
- 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDPcited by 7
- 2025Fine-tuning Large Language Model for Automated Algorithm Designcited by 6
- 2026Survey on Neural Routing Solverscited by 4
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solverscited by 3
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLMcited by 3
- 2025RoME: Domain-Robust Mixture-of-Experts for MILP Solution Prediction across Domainscited by 3
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problemscited by 3
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problemscited by 2
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPscited by 2
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solvercited by 2
- 2024RL-SPH: Learning to Achieve Feasible Solutions for Integer Linear Programscited by 1
- 2025USPR: Learning a Unified Solver for Profiled Routingcited by 1
- 2025Hierarchical Optimization via LLM-Guided Objective Evolution for Mobility-on-Demand Systemscited by 1
- 2026UrbanVerse: Learning Urban Region Representation Across Cities and Taskscited by 1
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTScited by 1
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solvercited by 1
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problemscited by 1
- 2024Multi-Agent Environments for Vehicle Routing Problemscited by 0
- 2025LRM-1B: Towards Large Routing Modelcited by 0
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessmentcited by 0
- 2025A Unified Model for Multi-Task Drone Routing in Post-Disaster Road Assessmentcited by 0
- 2025ARC: Leveraging Compositional Representations for Cross-Problem Learning on VRPscited by 0
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problemscited by 0
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Taskscited by 0
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?cited by 0
- 2026Enhancing Cross-Problem Vehicle Routing via Federated Learningcited by 0
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routingcited by 0
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problemscited by 0
- 2026Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Expertscited by 0
- 2026LaT: LLM-as-Trainer for Multi-Task Vehicle Routing Solverscited by 0
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglementcited by 0
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routingcited by 0
- 2026Multi-Task Evolution for Zero-Shot Cross-Problem Generalization using LLMscited by 0
- 2026Multi-Task Evolution for Zero-Shot Cross-Problem Generalization using LLMs2 Oct 2026
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026LaT: LLM-as-Trainer for Multi-Task Vehicle Routing Solvers20 Jul 2026
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems9 Jun 2026
- 2026Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts26 May 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problems14 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing30 Apr 2026
- 2026Enhancing Cross-Problem Vehicle Routing via Federated Learning12 Apr 2026
38 more
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPs2 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problems17 Feb 2026
- 2026UrbanVerse: Learning Urban Region Representation Across Cities and Tasks17 Feb 2026
- 2026Keep Rehearsing and Refining: Lifelong Learning Vehicle Routing under Continually Drifting Tasks30 Jan 2026
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problems27 Jan 2026
- 2025ARC: Leveraging Compositional Representations for Cross-Problem Learning on VRPs21 Dec 2025
- 2025RoME: Domain-Robust Mixture-of-Experts for MILP Solution Prediction across Domains4 Nov 2025
- 2025A Unified Model for Multi-Task Drone Routing in Post-Disaster Road Assessment24 Oct 2025
- 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDP24 Oct 2025
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLM13 Oct 2025
- 2025Hierarchical Optimization via LLM-Guided Objective Evolution for Mobility-on-Demand Systems12 Oct 2025
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalization27 Sep 2025
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessment2 Sep 2025
- 2025Fine-tuning Large Language Model for Automated Algorithm Design13 Jul 2025
- 2025LRM-1B: Towards Large Routing Model4 Jul 2025
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver3 Jun 2025
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learning3 Jun 2025
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degrees30 May 2025
- 2025USPR: Learning a Unified Solver for Profiled Routing8 May 2025
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimization20 Mar 2025
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problems16 Mar 2025
- 2025FlexiReg: Flexible Urban Region Representation Learning12 Mar 2025
- 2025Learning to Reduce Search Space for Generalizable Neural Routing Solver5 Mar 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2025ARS: Automatic Routing Solver with Large Language Models21 Feb 2025
- 2024RL-SPH: Learning to Achieve Feasible Solutions for Integer Linear Programs29 Nov 2024
- 2024Multi-Agent Environments for Vehicle Routing Problems21 Nov 2024
- 2024Beyond the Heatmap: A Rigorous Evaluation of Component Impact in MCTS-Based TSP Solvers14 Nov 2024
- 2024Collaboration! Towards Robust Neural Methods for Routing Problems7 Oct 2024
- 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimization5 Sep 2024
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimization22 Aug 2024
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problems21 Jun 2024
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Survey20 Jun 2024
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives1 Jun 2024
- 2024Instance-Conditioned Adaptation for Large-scale Generalization of Neural Routing Solver3 May 2024
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts2 May 2024
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 37
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessmentcited by 0
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problemscited by 0
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problems14 May 2026
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessment2 Sep 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 55
- 2024Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectivescited by 23
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2025Learning to Reduce Search Space for Generalizable Neural Routing Solvercited by 14
- 2025ARS: Automatic Routing Solver with Large Language Modelscited by 13
- 2025FlexiReg: Flexible Urban Region Representation Learningcited by 13
- 2025Improving Generalization of Neural Combinatorial Optimization for Vehicle Routing Problems via Test-Time Projection Learningcited by 12
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 11
- 2024Instance-Conditioned Adaptation for Large-scale Generalization of Neural Routing Solvercited by 9
- 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
- 2024Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimizationcited by 8
- 2025Rethinking Neural Combinatorial Optimization for Vehicle Routing Problems with Different Constraint Tightness Degreescited by 8
12 most cited of 43 All 43 (JSON)
- 2026Multi-Task Evolution for Zero-Shot Cross-Problem Generalization using LLMs2 Oct 2026
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026LaT: LLM-as-Trainer for Multi-Task Vehicle Routing Solvers20 Jul 2026
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems9 Jun 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing30 Apr 2026
- 2026Enhancing Cross-Problem Vehicle Routing via Federated Learning12 Apr 2026
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPs2 Mar 2026
12 newest of 43 All 43 (JSON)