Learning to Place Guards by Reinforcement: A Geo-Free Neural Policy for the Vertex-Guard Art Gallery Problem
Not on the map. Why?
Abstract (arXiv)
Neural combinatorial optimization (NCO) has shown that policies trained by reinforcement can construct strong solutions to NP-hard problems directly from raw instances. What such a policy actually learns, as opposed to what its decoder expresses, remains much less clear. We study this distinction on the vertex-guard Art Gallery Problem, the NP-hard task of choosing polygon vertices from which to observe an entire region. A pointer-network policy is trained from a coverage-aware reward over its own rollouts under the constraint we call geo-free inference: at test time it sees only vertex coordinates, with no visibility computation and no geometric oracle. The policy places guards economically but leaves a tail of under-covered polygons that widens far beyond the training range. To locate the cause, we freeze the trained encoder and read its embeddings with a small single-shot classifier, still geo-free at inference. The classifier closes most of the feasibility gap, in and out of distribution and at up to roughly five times the training range, cutting under-covered polygons by about an order of magnitude at an explicitly reported cost in guard count. We read this as evidence that the reinforcement-trained representation already encodes the geometry required for feasibility, and that residual failures reflect decoder calibration rather than missing knowledge. Probing a frozen encoder thus offers a practical way to ask what a neural combinatorial solver has internalized.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
12 of 33 references.
References · 12
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2015Pointer Networkscited by 895
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 348
- 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 90
- 2025Preference Optimization for Combinatorial Optimization Problemscited by 11
- 2016A Reinforcement Learning Approach to the View Planning Problemcited by 10
- 2023Optimizing Solution-Samplers for Combinatorial Problems: The Landscape of Policy-Gradient Methodscited by 5
- 2022Pareto Frontier Approximation Network (PA-Net) to Solve Bi-objective TSPcited by 1
Built on by
Not cited yet.