mlsanityData to 7 Oct 2026

LRM-1B: Towards Large Routing Model

arXiv 2507.03300 ↗First posted 4 Jul 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Vehicle routing problems (VRPs) are central to combinatorial optimization with significant practical implications. Recent advancements in neural combinatorial optimization (NCO) have demonstrated promising results by leveraging neural networks to solve VRPs, yet the exploration of model scaling within this domain remains underexplored. Inspired by the success of model scaling in large language models (LLMs), this study introduces a Large Routing Model with 1 billion parameters (LRM-1B), designed to address diverse VRP scenarios. We present a comprehensive evaluation of LRM-1B across multiple problem variants, distributions, and sizes, establishing state-of-the-art results. Our findings reveal that LRM-1B not only adapts to different VRP challenges but also showcases superior performance, outperforming existing models. Additionally, we explore the scaling behavior of neural routing models from 1M to 1B parameters. Our analysis confirms power-law between multiple model factors and performance, offering critical insights into the optimal configurations for foundation neural routing solvers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 57 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

47 of 57 references.

References · 47

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2020Scaling Laws for Neural Language Modelscited by 6,411
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  8. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  9. 2020GLU Variants Improve Transformercited by 1,724
  10. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  11. 2019Root Mean Square Layer Normalizationcited by 1,425
  12. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
35 more
  1. 2021Scaling Vision Transformerscited by 993
  2. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  3. 2018Attention, Learn to Solve Routing Problems!cited by 646
  4. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
  5. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  6. 2021Scaling Laws for Transfercited by 265
  7. 2022The case for 4-bit precision: k-bit Inference Scaling Lawscited by 247
  8. 2017Spectral Norm Regularization for Improving the Generalizability of Deep Learningcited by 178
  9. 2023Stabilizing Transformer Training by Preventing Attention Entropy Collapsecited by 154
  10. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
  11. 2024Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Lawscited by 137
  12. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 123
  13. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
  14. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
  15. 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
  16. 2021Deep Policy Dynamic Programming for Vehicle Routing Problemscited by 94
  17. 2024Scaling Laws for Precisioncited by 92
  18. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  19. 2023An Inverse Scaling Law for CLIP Trainingcited by 76
  20. 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Expertscited by 69
  21. 2023Towards Omni-generalizable Neural Methods for Vehicle Routing Problemscited by 68
  22. 2020Combining Reinforcement Learning and Constraint Programming for Combinatorial Optimizationcited by 63
  23. 2022Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillationcited by 61
  24. 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
  25. 2023PyVRP: a high-performance VRP solver packagecited by 50
  26. 2024Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalizationcited by 49
  27. 2021Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustnesscited by 35
  28. 2022Learning to Solve Routing Problems via Distributionally Robust Optimizationcited by 31
  29. 2020A Deep Reinforcement Learning Algorithm Using Dynamic Attention Model for Vehicle Routing Problemscited by 30
  30. 2022Learning to Solve Travelling Salesman Problem with Hardness-adaptive Curriculumcited by 27
  31. 2022Examining Scaling and Transfer of Language Model Architectures for Machine Translationcited by 26
  32. 2020Learn to Design the Heuristics for Vehicle Routing Problemcited by 24
  33. 2024Cross-Problem Learning for Solving Vehicle Routing Problemscited by 24
  34. 2020Why Spectral Normalization Stabilizes GANs: Analysis and Improvementscited by 21
  35. 2021A Game-Theoretic Approach for Improving Generalization Ability of TSP Solverscited by 14

Built on by

Not cited yet.