mlsanityData to 14 Oct 2026

Rethinking Positional Encoding for Neural Vehicle Routing

arXiv 2605.11910 ↗First posted 12 May 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Transformer-based models have become the dominant paradigm for neural combinatorial optimization (NCO) of vehicle routing problems (VRPs), yet the role of positional encoding (PE) in these architectures remains largely unexplored. Unlike natural language, where tokens are uniformly spaced on a line, routing solutions exhibit several properties that render standard NLP positional encodings inadequate. In this work, we formalize three such structural properties that a routing-aware PE should respect, namely anisometric node distances, cyclic and direction-aware topology, and hierarchical depot-anchored global multi-route structure, combining them with a unifying design principle of geometric grounding. Guided by these criteria, we analyze and compare PE methods spanning NLP, graph-transformer, and routing-specific families, and propose a hierarchical anisometric PE that combines a distance-indexed, circularly consistent in-route encoding with a depot-anchored angular cross-route encoding. Extensive experiments across diverse VRP variants demonstrate that geometry-grounded PE consistently outperforms index-based alternatives, with gains that transfer across problem variants, model architectures, and distribution shifts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

18 of 25 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2018Self-Attention with Relative Position Representationscited by 1,120
  4. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  5. 2020A Generalization of Transformer Networks to Graphscited by 661
  6. 2018Attention, Learn to Solve Routing Problems!cited by 656
  7. 2017Convolutional Sequence to Sequence Learningcited by 552
  8. 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
  9. 2021Graph Neural Networks with Learnable Structural and Positional Representationscited by 333
  10. 2023Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalizationcited by 142
  11. 2020Hybrid Genetic Search for the CVRP: Open-Source Implementation and SWAP* Neighborhoodcited by 125
  12. 2021Learning to Iteratively Solve Routing Problems with Dual-Aspect Collaborative Transformercited by 108
6 more
  1. 2023BQ-NCO: Bisimulation Quotienting for Efficient Neural Combinatorial Optimizationcited by 82
  2. 2022Winner Takes It All: Training Performant RL Populations for Combinatorial Optimizationcited by 58
  3. 2023PyVRP: a high-performance VRP solver packagecited by 52
  4. 2024PolyNet: Learning Diverse Solution Strategies for Neural Combinatorial Optimizationcited by 35
  5. 2022Efficient Neural Neighborhood Search for Pickup and Delivery Problemscited by 29
  6. 2025Neural Deconstruction Search for Vehicle Routing Problemscited by 15

Built on by

Not cited yet.