mlsanityData to 14 Oct 2026

Towards Learning Foundation Models for Heuristic Functions to Solve Pathfinding Problems

arXiv 2406.02598 ↗First posted 1 Jun 2024cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Pathfinding problems are found throughout robotics, computational science, and natural sciences. Traditional methods to solve these require training deep neural networks (DNNs) for each new problem domain, consuming substantial time and resources. This study introduces a novel foundation model, leveraging deep reinforcement learning to train heuristic functions that seamlessly adapt to new domains without further fine-tuning. Building upon DeepCubeA, we enhance the model by providing the heuristic function with the domain's state transition information, improving its adaptability. Utilizing a puzzle generator for the 15-puzzle action space variation domains, we demonstrate our model's ability to generalize and solve unseen domains. We achieve a strong correlation between learned and ground truth heuristic values across various domains, as evidenced by robust R-squared and Concordance Correlation Coefficient metrics. These results underscore the potential of foundation models to establish new standards in efficiency and adaptability for AI-driven solutions in complex pathfinding problems.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 53 references that are in the map. First posted on arXiv 1 Jun 2024.

Builds on

27 of 53 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2014Going Deeper with Convolutionscited by 4,241
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2017Hindsight Experience Replaycited by 1,136
  7. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  8. 2014Deep Learning in Neural Networks: An Overviewcited by 770
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  10. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
  11. 2019Active Domain Randomizationcited by 170
  12. 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
15 more
  1. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 120
  2. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 108
  3. 2020Retro*: Learning Retrosynthetic Planning with Neural Guided A* Searchcited by 76
  4. 2022Parsel: Algorithmic Reasoning with Language Models by Composing Decompositionscited by 64
  5. 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 52
  6. 2019Learning Domain-Independent Planning Heuristics with Hypergraph Networkscited by 50
  7. 2022Plansformer: Generating Symbolic Plans using Transformerscited by 41
  8. 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
  9. 2023Understanding the Capabilities of Large Language Models for Automated Planningcited by 34
  10. 2017Action Schema Networks: Generalised Policies with Deep Learningcited by 32
  11. 2023Learning Domain-Independent Heuristics for Grounded and Lifted Planningcited by 31
  12. 2020Topological Quantum Compiling with Reinforcement Learningcited by 23
  13. 2022Generating Executable Action Plans with Environmentally-Aware Language Modelscited by 21
  14. 2023Code Models are Zero-shot Precondition Reasonerscited by 3
  15. 2023Human-Centered Planningcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MAPF-GPT: Imitation Learning for Multi-Agent Pathfinding at Scale
  2. 2022Learning Graph Search Heuristics
  3. 2024HiMAP: Learning Heuristics-Informed Policies for Large-Scale Multi-Agent Pathfinding
  4. 2026Learning Empirically Admissible Neural Heuristics for Combinatorial Search
  5. 2026The DeepXube Software Package for Solving Pathfinding Problems with Learned Heuristic Functions and Search
  6. 2025Beyond Single-Step Updates: Reinforcement Learning of Heuristics with Limited-Horizon Search
  7. 2025The Emergence of Deep Reinforcement Learning for Path Planning
  8. 2024Deep Reinforcement Learning with Dynamic Graphs for Adaptive Informative Path Planning