VRPAgent: LLM-Driven Discovery of Heuristic Operators for Vehicle Routing Problems
Not on the map. Why?
Abstract (arXiv)
Designing high-performing heuristics for vehicle routing problems (VRPs) is a complex task that requires both intuition and deep domain knowledge. Large language model (LLM)-based code generation has recently shown promise across many domains, but it still falls short of producing heuristics that rival those crafted by human experts. In this paper, we propose VRPAgent, a framework that integrates LLM-generated components into a metaheuristic and refines them through a novel genetic search. By using the LLM to generate problem-specific operators, embedded within a generic metaheuristic framework, VRPAgent keeps tasks manageable, guarantees correctness, and still enables the discovery of novel and powerful strategies. Across multiple problems, including the capacitated VRP, the VRP with time windows, and the prize-collecting VRP, our method discovers heuristic operators that outperform handcrafted methods and recent learning-based approaches while requiring only a single CPU core. To our knowledge, VRPAgent is the first LLM-based paradigm to advance the state-of-the-art in VRPs, highlighting a promising future for automated heuristics discovery.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 50 of its 65 references that are in the map. First posted on arXiv 8 Oct 2025.
Builds on
50 of 65 references.
References · 50
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2025Gemma 3 Technical Reportcited by 1,686
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2015Pointer Networkscited by 882
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
38 more
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2019Learning Improvement Heuristics for Solving Routing Problemscited by 162
- 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 140
- 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 122
- 2022Sym-NCO: Leveraging Symmetricity for Neural Combinatorial Optimizationcited by 118
- 2019Neural Large Neighborhood Search for the Capacitated Vehicle Routing Problemcited by 117
- 2021Learning to Delegate for Large-scale Vehicle Routingcited by 108
- 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
- 2020Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learningcited by 100
- 2025Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic Designcited by 100
- 2021Learning Collaborative Policies to Solve NP-hard Routing Problemscited by 86
- 2023GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-timecited by 82
- 2023Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Optcited by 81
- 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 80
- 2023DeepACO: Neural-enhanced Ant Systems for Combinatorial Optimizationcited by 77
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 57
- 2024RouteFinder: Towards Foundation Models for Vehicle Routing Problemscited by 54
- 2024Ant Colony Sampling with GFlowNets for Combinatorial Optimizationcited by 53
- 2023PyVRP: a high-performance VRP solver packagecited by 50
- 2024UDC: A Unified Neural Divide-and-Conquer Framework for Large-Scale Combinatorial Optimization Problemscited by 45
- 2025Solver-Informed RL: Grounding Large Language Models for Authentic Optimization Modelingcited by 44
- 2025Algorithm Discovery With LLMs: Evolutionary Search Meets Reinforcement Learningcited by 39
- 2025Rethinking Light Decoder-based Solvers for Vehicle Routing Problemscited by 36
- 2024PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimizationcited by 35
- 2024LLM4AD: A Platform for Algorithm Design with Large Language Modelcited by 33
- 2025EoH-S: Evolution of Heuristic Set using LLMs for Automated Heuristic Designcited by 32
- 2025CO-Bench: Benchmarking Language Model Agents in Algorithm Search for Combinatorial Optimizationcited by 28
- 2025CALM: Co-evolution of Algorithms and Language Model for Automatic Heuristic Designcited by 28
- 2025HeuriGym: An Agentic Benchmark for LLM-Crafted Heuristics in Combinatorial Optimizationcited by 19
- 2025HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challengescited by 19
- 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15
- 2025OPT-BENCH: Evaluating LLM Agent on Large-Scale Search Spaces Optimization Problemscited by 12
- 2025FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimizationcited by 10
- 2025Learning to Segment for Vehicle Routing Problemscited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Meta Context Engineering via Agentic Skill Evolutioncited by 42
- 2026AHD Agent: Agentic Reinforcement Learning for Automatic Heuristic Designcited by 3
- 2026EvoNav: Evolutionary Reward Function Design for Robot Navigation with Large Language Modelscited by 2
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Provingcited by 1
- 2026Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontierscited by 0
- 2026SPO: Discovering Adaptive Large Neighborhood Search Operators via Stackelberg Program Optimizationcited by 0
- 2026SPO: Discovering Adaptive Large Neighborhood Search Operators via Stackelberg Program Optimization25 Sep 2026
- 2026FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving25 Aug 2026
- 2026EvoNav: Evolutionary Reward Function Design for Robot Navigation with Large Language Models12 May 2026
- 2026AHD Agent: Agentic Reinforcement Learning for Automatic Heuristic Design9 May 2026
- 2026Large Language Models as Optimizers: A Survey of Direct vs. Tool-Augmented Approaches and Their Performance Frontiers9 Apr 2026
- 2026Meta Context Engineering via Agentic Skill Evolution29 Jan 2026