Understanding Human-like Solutions in Combinatorial Optimization via Learning and Search
Not on the map. Why?
Abstract (arXiv)
Humans often find good solutions to combinatorial optimization problems that are computationally hard even for advanced computer algorithms. In the Euclidean traveling salesman problems (TSP), people rapidly produce tours that are near-optimal, despite severe limits on time and computation. What makes a tour human-like, and how might such solutions be learned? Here we address these questions through a large-scale behavioral and computational investigation of human performance in Euclidean TSP. We sampled a broad space of TSP instances, collected human solutions, and compared them with neural policies based on Pointer Networks, which are recurrent neural networks with an attention-based pointing mechanism that define probability distributions over valid tours. We trained these networks under multiple objectives, including reinforcement learning (RL), supervised learning from optimal tours, supervised learning from human tours, and RL fine-tuning after optimal-supervised pretraining. Human tours were not identical to optimal tours, but occupied a near-optimal geometric basin: they shared many structural properties with optimal solutions while preserving systematic human-specific deviations. The best account of human tours was not direct imitation of optimal tours, but a model pretrained on optimal tours, fine-tuned by RL, and decoded through Best-of-N sampling. These findings suggest that human-like solutions may emerge from a combination of structured supervised learning, RL, and test-time search, echoing computational principles underlying many modern artificial intelligence systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 45 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
15 of 45 references.
References · 15
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2015Pointer Networkscited by 895
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2018Understanding the impact of entropy on policy optimizationcited by 176
- 2025Reasoning with Sampling: Your Base Model is Smarter Than You Thinkcited by 89
- 2024Capturing the Complexity of Human Strategic Decision-Making with Machine Learningcited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A First Guess is Rarely the Final Answer: Learning to Search in the Traveling Salesperson Problem
- 2026Offline Decision Transformers for Neural Combinatorial Optimization: Surpassing Heuristics on the Traveling Salesman Problem
- 2022Travel the Same Path: A Novel TSP Solving Strategy
- 2024Self-Improvement for Neural Combinatorial Optimization: Sample without Replacement, but Improvement
- 2025Mechanistic Interpretability for Neural TSP Solvers
- 2026GeoRouteNet: A Geometry-Aware Non-Autoregressive Neural Solver for the Euclidean Traveling Salesman Problem
- 2026Leveraging Structural Constraints for Diffusion-based Neural TSP Solvers
- 2025Preference Optimization for Combinatorial Optimization Problems