RouteFinder: Towards Foundation Models for Vehicle Routing Problems
Not on the map. Why?
Abstract (arXiv)
This paper introduces RouteFinder, a comprehensive foundation model framework to tackle different Vehicle Routing Problem (VRP) variants. Our core idea is that a foundation model for VRPs should be able to represent variants by treating each as a subset of a generalized problem equipped with different attributes. We propose a unified VRP environment capable of efficiently handling any combination of these attributes. The RouteFinder model leverages a modern transformer-based encoder and global attribute embeddings to improve task representation. Additionally, we introduce two reinforcement learning techniques to enhance multi-task performance: mixed batch training, which enables training on different variants at once, and multi-variant reward normalization to balance different reward scales. Finally, we propose efficient adapter layers that enable fine-tuning for new variants with unseen attributes. Extensive experiments on 48 VRP variants show RouteFinder outperforms recent state-of-the-art learning methods. Our code is publicly available at https://github.com/ai4co/routefinder.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 63 of its 103 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
63 of 103 references.
References · 63
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2015Pointer Networkscited by 882
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
38 more
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
- 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
- 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 161
- 2022A Review of Sparse Expert Models in Deep Learningcited by 147
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
- 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 99
- 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
- 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
- 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 89
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
- 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
- 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
- 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
- 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2023PyVRP: a high-performance VRP solver packagecited by 50
- 2018An Analysis of the t-SNE Algorithm for Data Visualizationcited by 49
- 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 49
- 2020Ecole: A Gym-like Library for Machine Learning in Combinatorial Optimization Solverscited by 43
- 2021Independent Prototype Propagation for Zero-Shot Compositionalitycited by 42
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 25; 2026: 25.
54 papers.
Sort:
By area:
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 23
- 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 10
- 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
- 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimizationcited by 7
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 7
- 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDPcited by 7
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representationscited by 7
38 more
- 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problemscited by 6
- 2025An Agentic Framework with LLMs for Solving Complex Vehicle Routing Problemscited by 5
- 2026Survey on Neural Routing Solverscited by 4
- 2025Learning Constraints-Based Adaptive Hypergraph Neural Networks for Solving Vehicle Routing Problemscited by 3
- 2025LMask: Learn to Solve Constrained Routing Problems with Lazy Maskingcited by 3
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLMcited by 3
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problemscited by 2
- 2025FORGE: Foundational Optimization Representations from Graph Embeddingscited by 2
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problemscited by 2
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPscited by 2
- 2025ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimizationcited by 1
- 2025USPR: Learning a Unified Solver for Profiled Routingcited by 1
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimizationcited by 1
- 2026Aligning LLMs with Graph Neural Solvers for Combinatorial Optimizationcited by 1
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTScited by 1
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solvercited by 1
- 2026Learning with Foresight: Enhancing Neural Routing Policy via Multi-Node Lookahead Predictioncited by 1
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solvercited by 1
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problemscited by 1
- 2024Multi-Agent Environments for Vehicle Routing Problemscited by 0
- 2025Synergizing Reinforcement Learning and Genetic Algorithms for Neural Combinatorial Optimizationcited by 0
- 2025LRM-1B: Towards Large Routing Modelcited by 0
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solverscited by 0
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessmentcited by 0
- 2025A Unified Deep Reinforcement Learning Approach for Close Enough Traveling Salesman Problemcited by 0
- 2025A Unified Model for Multi-Task Drone Routing in Post-Disaster Road Assessmentcited by 0
- 2025ARC: Leveraging Compositional Representations for Cross-Problem Learning on VRPscited by 0
- 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problemscited by 0
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problemscited by 0
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?cited by 0
- 2026Learning to Solve Orienteering Problem with Time Windows and Variable Profitscited by 0
- 2026Vehicle-as-Prompt: A Unified Deep Reinforcement Learning Framework for Heterogeneous Fleet Vehicle Routing Problemcited by 0
- 2026Enhancing Cross-Problem Vehicle Routing via Federated Learningcited by 0
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routingcited by 0
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problemscited by 0
- 2026Learning to Solve Compositional Geometry Routing Problemscited by 0
- 2026WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problemscited by 0
- 2026Edge-aware Decoding for Neural Asymmetric Routingcited by 0
50 most cited of 54 All 54 (JSON)
- 2026SimpleEvol: An Agent-Loop Framework for LLM-Driven Automated Heuristic Design with Minimal Human Priors29 Sep 2026
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026LaT: LLM-as-Trainer for Multi-Task Vehicle Routing Solvers20 Jul 2026
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems9 Jun 2026
- 2026Edge-aware Decoding for Neural Asymmetric Routing1 Jun 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problems20 May 2026
- 2026Learning with Foresight: Enhancing Neural Routing Policy via Multi-Node Lookahead Prediction19 May 2026
- 2026Learning to Solve Compositional Geometry Routing Problems18 May 2026
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problems14 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
38 more
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing30 Apr 2026
- 2026Enhancing Cross-Problem Vehicle Routing via Federated Learning12 Apr 2026
- 2026Vehicle-as-Prompt: A Unified Deep Reinforcement Learning Framework for Heterogeneous Fleet Vehicle Routing Problem6 Apr 2026
- 2026Aligning LLMs with Graph Neural Solvers for Combinatorial Optimization28 Mar 2026
- 2026Learning to Solve Orienteering Problem with Time Windows and Variable Profits6 Mar 2026
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representations3 Mar 2026
- 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?2 Mar 2026
- 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPs2 Mar 2026
- 2026Survey on Neural Routing Solvers25 Feb 2026
- 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problems17 Feb 2026
- 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problems27 Jan 2026
- 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problems26 Jan 2026
- 2025ARC: Leveraging Compositional Representations for Cross-Problem Learning on VRPs21 Dec 2025
- 2025A Unified Model for Multi-Task Drone Routing in Post-Disaster Road Assessment24 Oct 2025
- 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDP24 Oct 2025
- 2025An Agentic Framework with LLMs for Solving Complex Vehicle Routing Problems19 Oct 2025
- 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLM13 Oct 2025
- 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems8 Oct 2025
- 2025A Unified Deep Reinforcement Learning Approach for Close Enough Traveling Salesman Problem3 Oct 2025
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalization27 Sep 2025
- 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimization5 Sep 2025
- 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessment2 Sep 2025
- 2025FORGE: Foundational Optimization Representations from Graph Embeddings28 Aug 2025
- 2025On Distributional Dependent Performance of Classical and Neural Routing Solvers4 Aug 2025
- 2025LRM-1B: Towards Large Routing Model4 Jul 2025
- 2025Synergizing Reinforcement Learning and Genetic Algorithms for Neural Combinatorial Optimization11 Jun 2025
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver3 Jun 2025
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimization27 May 2025
- 2025LMask: Learn to Solve Constrained Routing Problems with Lazy Masking23 May 2025
- 2025USPR: Learning a Unified Solver for Profiled Routing8 May 2025
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimization20 Mar 2025
- 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problems16 Mar 2025
- 2025Learning Constraints-Based Adaptive Hypergraph Neural Networks for Solving Vehicle Routing Problems13 Mar 2025
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problems2 Mar 2025
- 2025ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimization29 Jan 2025
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Design15 Jan 2025
- 2025Neural Deconstruction Search for Vehicle Routing Problems7 Jan 2025
50 newest of 54 All 54 (JSON)
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 23
- 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
- 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
- 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 10
- 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
- 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimizationcited by 7
- 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
- 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 7
- 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDPcited by 7
- 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representationscited by 7
- 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problemscited by 6
12 most cited of 51 All 51 (JSON)
- 2026Depot-Closed Multi-Component Construction for Neural Vehicle Routing28 Sep 2026
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement25 Aug 2026
- 2026LaT: LLM-as-Trainer for Multi-Task Vehicle Routing Solvers20 Jul 2026
- 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problems9 Jun 2026
- 2026Edge-aware Decoding for Neural Asymmetric Routing1 Jun 2026
- 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solver23 May 2026
- 2026WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problems20 May 2026
- 2026Learning with Foresight: Enhancing Neural Routing Policy via Multi-Node Lookahead Prediction19 May 2026
- 2026Learning to Solve Compositional Geometry Routing Problems18 May 2026
- 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problems14 May 2026
- 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver11 May 2026
- 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTS5 May 2026
12 newest of 51 All 51 (JSON)