mlsanityData to 7 Oct 2026

RouteFinder: Towards Foundation Models for Vehicle Routing Problems

arXiv 2406.15007 ↗First posted 21 Jun 2024cs.AIcited by 54

Not on the map. Why?

Abstract (arXiv)

This paper introduces RouteFinder, a comprehensive foundation model framework to tackle different Vehicle Routing Problem (VRP) variants. Our core idea is that a foundation model for VRPs should be able to represent variants by treating each as a subset of a generalized problem equipped with different attributes. We propose a unified VRP environment capable of efficiently handling any combination of these attributes. The RouteFinder model leverages a modern transformer-based encoder and global attribute embeddings to improve task representation. Additionally, we introduce two reinforcement learning techniques to enhance multi-task performance: mixed batch training, which enables training on different variants at once, and multi-variant reward normalization to balance different reward scales. Finally, we propose efficient adapter layers that enable fine-tuning for new variants with unseen attributes. Extensive experiments on 48 VRP variants show RouteFinder outperforms recent state-of-the-art learning methods. Our code is publicly available at https://github.com/ai4co/routefinder.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). Builds on 63 of its 103 references that are in the map. First posted on arXiv 21 Jun 2024.

Builds on

63 of 103 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2023Segment Anythingcited by 8,158
  4. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  5. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  6. 2020GLU Variants Improve Transformercited by 1,724
  7. 2019Root Mean Square Layer Normalizationcited by 1,425
  8. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  9. 2015Pointer Networkscited by 882
  10. 2016Language Modeling with Gated Convolutional Networkscited by 688
  11. 2018Attention, Learn to Solve Routing Problems!cited by 646
  12. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
38 more
  1. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
  2. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  3. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
  4. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 313
  5. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  6. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
  7. 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
  8. 2023DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimizationcited by 216
  9. 2020Generalize a Small Pre-trained Model to Arbitrarily Large TSP Instancescited by 161
  10. 2022A Review of Sparse Expert Models in Deep Learningcited by 147
  11. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
  12. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
  13. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
  14. 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
  15. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
  16. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  17. 2021Efficient Active Search for Combinatorial Optimization Problemscited by 99
  18. 2020Learning the Travelling Salesperson Problem Requires Rethinking Generalizationcited by 96
  19. 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
  20. 2021Matrix Encoding Networks for Neural Combinatorial Optimizationcited by 89
  21. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  22. 2022Simulation-guided Beam Search for Neural Combinatorial Optimizationcited by 84
  23. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
  24. 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
  25. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
  26. 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
  27. 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
  28. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
  29. 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
  30. 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
  31. 2023Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policycited by 61
  32. 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
  33. 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
  34. 2023PyVRP: a high-performance VRP solver packagecited by 50
  35. 2018An Analysis of the t-SNE Algorithm for Data Visualizationcited by 49
  36. 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 49
  37. 2020Ecole: A Gym-like Library for Machine Learning in Combinatorial Optimization Solverscited by 43
  38. 2021Independent Prototype Propagation for Zero-Shot Compositionalitycited by 42

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 25; 2026: 25.

54 papers.

Sort:

By area:

  1. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
  2. 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
  3. 2024CaDA: Cross-Problem Routing Solver with Constraint-Aware Dual-Attentioncited by 23
  4. 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
  5. 2025MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solvercited by 13
  6. 2025RRNCO: Towards Real-World Routing with Neural Combinatorial Optimizationcited by 10
  7. 2024Collaboration! Towards Robust Neural Methods for Routing Problemscited by 9
  8. 2024PARCO: Parallel AutoRegressive Models for Multi-Agent Combinatorial Optimizationcited by 7
  9. 2025Generalizable Heuristic Generation Through LLMs with Meta-Optimizationcited by 7
  10. 2025URS: A Unified Neural Routing Solver for Cross-Problem Zero-Shot Generalizationcited by 7
  11. 2025Multi-Task Vehicle Routing Solver via Mixture of Specialized Experts under State-Decomposable MDPcited by 7
  12. 2026RADAR: Learning to Route with Asymmetry-aware DistAnce Representationscited by 7
38 more
  1. 2025VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problemscited by 6
  2. 2025An Agentic Framework with LLMs for Solving Complex Vehicle Routing Problemscited by 5
  3. 2026Survey on Neural Routing Solverscited by 4
  4. 2025Learning Constraints-Based Adaptive Hypergraph Neural Networks for Solving Vehicle Routing Problemscited by 3
  5. 2025LMask: Learn to Solve Constrained Routing Problems with Lazy Maskingcited by 3
  6. 2025Refining Hybrid Genetic Search for CVRP via Reinforcement Learning-Finetuned LLMcited by 3
  7. 2025TuneNSearch: a hybrid transfer learning and local search approach for solving vehicle routing problemscited by 2
  8. 2025FORGE: Foundational Optimization Representations from Graph Embeddingscited by 2
  9. 2026Towards Efficient Constraint Handling in Neural Solvers for Routing Problemscited by 2
  10. 2026Chain-of-Context Learning: Dynamic Constraint Understanding for Multi-Task VRPscited by 2
  11. 2025ASAP: Exploiting the Satisficing Generalization Edge in Neural Combinatorial Optimizationcited by 1
  12. 2025USPR: Learning a Unified Solver for Profiled Routingcited by 1
  13. 2025Recurrent State Encoders for Efficient Neural Combinatorial Optimizationcited by 1
  14. 2026Aligning LLMs with Graph Neural Solvers for Combinatorial Optimizationcited by 1
  15. 2026Automated Large-scale CVRP Solver Design via LLM-assisted Flexible MCTScited by 1
  16. 2026Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solvercited by 1
  17. 2026Learning with Foresight: Enhancing Neural Routing Policy via Multi-Node Lookahead Predictioncited by 1
  18. 2026SPACE: Unifying Symmetric and Asymmetric Routing Problems for Generalist Neural Solvercited by 1
  19. 2026Vision-Assisted Foundation Model for Solving Multi-Task Vehicle Routing Problemscited by 1
  20. 2024Multi-Agent Environments for Vehicle Routing Problemscited by 0
  21. 2025Synergizing Reinforcement Learning and Genetic Algorithms for Neural Combinatorial Optimizationcited by 0
  22. 2025LRM-1B: Towards Large Routing Modelcited by 0
  23. 2025On Distributional Dependent Performance of Classical and Neural Routing Solverscited by 0
  24. 2025Deep Reinforcement Learning for Drone Route Optimization in Post-Disaster Road Assessmentcited by 0
  25. 2025A Unified Deep Reinforcement Learning Approach for Close Enough Traveling Salesman Problemcited by 0
  26. 2025A Unified Model for Multi-Task Drone Routing in Post-Disaster Road Assessmentcited by 0
  27. 2025ARC: Leveraging Compositional Representations for Cross-Problem Learning on VRPscited by 0
  28. 2026HeatACO: A Heatmap-Guided Max--Min Ant System for Large-Scale Travelling Salesman Problemscited by 0
  29. 2026SEAFormer: A Spatial Proximity and Edge-Aware Transformer for Real-World Vehicle Routing Problemscited by 0
  30. 2026Can Computational Reducibility Lead to Transferable Models for Graph Combinatorial Optimization?cited by 0
  31. 2026Learning to Solve Orienteering Problem with Time Windows and Variable Profitscited by 0
  32. 2026Vehicle-as-Prompt: A Unified Deep Reinforcement Learning Framework for Heterogeneous Fleet Vehicle Routing Problemcited by 0
  33. 2026Enhancing Cross-Problem Vehicle Routing via Federated Learningcited by 0
  34. 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routingcited by 0
  35. 2026A Unified Knowledge Embedded Reinforcement Learning-based Framework for Generalized Capacitated Vehicle Routing Problemscited by 0
  36. 2026Learning to Solve Compositional Geometry Routing Problemscited by 0
  37. 2026WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problemscited by 0
  38. 2026Edge-aware Decoding for Neural Asymmetric Routingcited by 0

50 most cited of 54 All 54 (JSON)