What Planning Problems Can A Relational Neural Network Solve?
Not on the map. Why?
Abstract (arXiv)
Goal-conditioned policies are generally understood to be "feed-forward" circuits, in the form of neural networks that map from the current state and the goal specification to the next action to take. However, under what circumstances such a policy can be learned and how efficient the policy will be are not well understood. In this paper, we present a circuit complexity analysis for relational neural networks (such as graph neural networks and transformers) representing policies for planning problems, by drawing connections with serialized goal regression search (S-GRS). We show that there are three general classes of planning problems, in terms of the growth of circuit width and depth as a function of the number of objects and planning horizon, providing constructive proofs. We also illustrate the utility of this analysis for designing neural networks for policy learning.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 6 Dec 2023.
Builds on
14 of 34 references.
References · 14
- 2017Attention Is All You Needcited by 60,361
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 881
- 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 222
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 195
- 2019What Can Neural Networks Reason About?cited by 159
- 2019Neural Logic Machinescited by 145
- 2020Expressive Power of Invariant and Equivariant Graph Neural Networkscited by 100
- 2019Towards Practical Multi-Object Manipulation using Relational Reinforcement Learningcited by 55
- 2019Neural Logic Reinforcement Learningcited by 53
- 2022SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networkscited by 37
Built on by
Citing papers per year: 2024: 6; 2025: 2.
8 papers.
- 2024Can Graph Learning Improve Planning in LLM-based Agents?cited by 43
- 2024Return to Tradition: Learning Reliable Heuristics with Classical Machine Learningcited by 19
- 2024Structural Generalization in Autonomous Cyber Incident Response with Message-Passing Neural Networks and Reinforcement Learningcited by 7
- 2024Graph Learning for Numeric Planningcited by 5
- 2025SLAP: Shortcut Learning for Abstract Planningcited by 3
- 2024WLPlan: Relational Features for Symbolic Planningcited by 1
- 2024Graph Learning for Planning: The Story Thus Far and Open Challengescited by 0
- 2025Make Planning Research Rigorous Again!cited by 0
- 2025SLAP: Shortcut Learning for Abstract Planning2 Nov 2025
- 2025Make Planning Research Rigorous Again!27 May 2025
- 2024Graph Learning for Planning: The Story Thus Far and Open Challenges3 Dec 2024
- 2024WLPlan: Relational Features for Symbolic Planning1 Nov 2024
- 2024Graph Learning for Numeric Planning31 Oct 2024
- 2024Structural Generalization in Autonomous Cyber Incident Response with Message-Passing Neural Networks and Reinforcement Learning8 Jul 2024
- 2024Can Graph Learning Improve Planning in LLM-based Agents?29 May 2024
- 2024Return to Tradition: Learning Reliable Heuristics with Classical Machine Learning25 Mar 2024