Two Black Boxes, One Solver: Encoder Probing and Decoder Attribution for Neural Multi-Attribute VRP under Hard-Mask and Recourse Decoders
Not on the map. Why?
Abstract (arXiv)
Neural autoregressive solvers for the Multi-Attribute Vehicle Routing Problem (MAVRP) reach competitive cost but offer no per-step justification, a problem when dispatchers must validate, accept, or compare them. We open two complementary black boxes in one protocol. On the encoder side, linear probes, spontaneous-organization metrics, rank-based richness measures, and discovered-direction analyses with intervention validation characterize how the latent represents constraint families at the graph, node, and edge level. On the decoder side, three attribution methods (gradient, integrated gradients, DeepLIFT) feed three reading angles: abductive, contrastive against the best feasible alternative, and counterfactual (smallest input change that switches the action or restores feasibility). Explanations are scored on fidelity, concentration, stability, sanity, and actionability. Across six variants combining three encoders (Attention baseline, Unimp, UnimpMoe) with two decoders (Hard-Mask, Recourse), we find that graph inductive bias improves both representational predictability and decoder sanity, that the Mixture-of-Experts encoder represents constraints in a distributed rather than axis-aligned way, and that the Recourse training regime, not merely its softer mask, produces policies that represent infeasibility usefully, exposing make-feasible counterfactuals that Hard-Mask policies fail to produce even when fed infeasible alternatives externally.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
12 of 18 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2018Attention, Learn to Solve Routing Problems!cited by 646
- 2020Captum: A unified and generic model interpretability library for PyTorchcited by 542
- 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
- 2023RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmarkcited by 70
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FiLMMeD: Feature-wise Linear Modulation for Cross-Problem Multi-Depot Vehicle Routing
- 2024MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts
- 2026Improving Cross-Problem Vehicle Routing with Locally Augmented Preferences and Representation Disentanglement
- 2026Constraints Matrix Diffusion based Generative Neural Solver for Vehicle Routing Problems
- 2026Beyond Objective Equivalence: Constraint Injection for LLM-Based Optimization Modeling on Vehicle Routing Problems
- 2026Grounding latent algorithm routing in transformer reasoning
- 2026Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts
- 2026A First Guess is Rarely the Final Answer: Learning to Search in the Traveling Salesperson Problem