mlsanityData to 7 Oct 2026

VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems

arXiv 2510.07073 ↗First posted 8 Oct 2025cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Designing high-performing heuristics for vehicle routing problems (VRPs) is a complex task that requires both intuition and deep domain knowledge. Large language model (LLM)-based code generation has recently shown promise across many domains, but it still falls short of producing heuristics that rival those crafted by human experts. In this paper, we propose VRPAgent, a framework that integrates LLM-generated components into a metaheuristic and refines them through a novel genetic search. By using the LLM to generate problem-specific operators, embedded within a generic metaheuristic framework, VRPAgent keeps tasks manageable, guarantees correctness, and still enables the discovery of novel and powerful strategies. Across multiple problems, including the capacitated VRP, the VRP with time windows, and the prize-collecting VRP, our method discovers heuristic operators that outperform handcrafted methods and recent learning-based approaches while requiring only a single CPU core. To our knowledge, VRPAgent is the first LLM-based paradigm to advance the state-of-the-art in VRPs, highlighting a promising future for automated heuristics discovery.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 50 of its 65 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

50 of 65 references.

References · 50

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2025Gemma 3 Technical Reportcited by 1,686
  7. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  8. 2015Pointer Networkscited by 882
  9. 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
  10. 2018Attention, Learn to Solve Routing Problems!cited by 646
  11. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
  12. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
38 more
  1. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
  2. 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
  3. 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
  4. 2019Learning Improvement Heuristics for Solving Routing Problemscited by 162
  5. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
  6. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
  7. 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
  8. 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
  9. 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
  10. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
  11. 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
  12. 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
  13. 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
  14. 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
  15. 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
  16. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
  17. 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
  18. 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
  19. 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
  20. 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
  21. 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
  22. 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
  23. 2023PyVRP: a high-performance VRP solver packagecited by 50
  24. 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 45
  25. 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
  26. 2025Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learningcited by 39
  27. 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
  28. 2024PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimizationcited by 35
  29. 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
  30. 2025EoH-S: Evolution of Heuristic Set using LLMs for Automated Heuristic Designcited by 32
  31. 2025CO-Bench: Benchmarking Language Model Agents in Algorithm Search for Combinatorial Optimizationcited by 28
  32. 2025CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Designcited by 28
  33. 2025HeuriGym: An Agentic Benchmark for LLM-Crafted Heuristics in Combinatorial Optimizationcited by 19
  34. 2025HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challengescited by 19
  35. 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
  36. 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problemscited by 12
  37. 2025FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimizationcited by 10
  38. 2025Learning to Segment for Vehicle Routing Problemscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.