General Policies, Subgoal Structure, and Planning Width
Not on the map. Why?
Abstract (arXiv)
It has been observed that many classical planning domains with atomic goals can be solved by means of a simple polynomial exploration procedure, called IW, that runs in time exponential in the problem width, which in these cases is bounded and small. Yet, while the notion of width has become part of state-of-the-art planning algorithms such as BFWS, there is no good explanation for why so many benchmark domains have bounded width when atomic goals are considered. In this work, we address this question by relating bounded width with the existence of general optimal policies that in each planning instance are represented by tuples of atoms of bounded size. We also define the notions of (explicit) serializations and serialized width that have a broader scope as many domains have a bounded serialized width but no bounded width. Such problems are solved non-optimally in polynomial time by a suitable variant of the Serialized IW algorithm. Finally, the language of general policies and the semantics of serializations are combined to yield a simple, meaningful, and expressive language for specifying serializations in compact form in the form of sketches, which can be used for encoding domain control knowledge by hand or for learning it from small examples. Sketches express general problem decompositions in terms of subgoals, and sketches of bounded width express problem decompositions that can be solved in polynomial time.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 84 references that are in the map. First posted on arXiv 9 Nov 2023.
Builds on
18 of 84 references.
References · 18
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2016#Exploration: A Study of Count-Based Exploration for Deep Reinforcement Learningcited by 307
- 2017Count-Based Exploration with Neural Density Modelscited by 255
- 2020Reward Machines: Exploiting Reward Function Structure in Reinforcement Learningcited by 183
- 2017A Laplacian Framework for Option Discovery in Reinforcement Learningcited by 108
- 2014The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarkscited by 86
- 2017Learning Generalized Reactive Policies using Deep Neural Networkscited by 39
- 2019What Can Learned Intrinsic Rewards Capture?cited by 36
- 2020Generalized Planning With Deep Reinforcement Learningcited by 35
- 2017Action Schema Networks: Generalised Policies with Deep Learningcited by 32
- 2018Features, Projections, and Representation Change for Generalized Planningcited by 25
- 2019Qualitative Numeric Planning: Reductions and Complexitycited by 18
6 more
- 2022Learning Sketches for Decomposing Planning Problems into Subproblems of Bounded Width: Extended Versioncited by 12
- 2019Generalized Planning With Procedural Domain Control Knowledgecited by 11
- 2021Expressing and Exploiting the Common Subgoal Structure of Classical Planning Domains Using Sketches: Extended Versioncited by 9
- 2021Hierarchical Width-Based Planning and Learningcited by 6
- 2021Planning for Novelty: Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learningcited by 2
- 2022Learning Generalized Policy Automata for Relational Stochastic Shortest Path Problemscited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 1; 2026: 2.
6 papers.
- 2024Sketch Decompositions for Classical Planning via Deep Reinforcement Learningcited by 2
- 2024On Policy Reuse: An Expressive Language for Representing and Executing General Policies that Call Other Policiescited by 1
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agentscited by 1
- 2024Graph Learning for Planning: The Story Thus Far and Open Challengescited by 0
- 2025Learning General Policies From Examplescited by 0
- 2026Efficient Lookahead Encoding and Abstracted Width for Learning General Policies in Classical Planningcited by 0
- 2026Efficient Lookahead Encoding and Abstracted Width for Learning General Policies in Classical Planning18 May 2026
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents18 Apr 2026
- 2025Learning General Policies From Examples2 Sep 2025
- 2024Sketch Decompositions for Classical Planning via Deep Reinforcement Learning11 Dec 2024
- 2024Graph Learning for Planning: The Story Thus Far and Open Challenges3 Dec 2024
- 2024On Policy Reuse: An Expressive Language for Representing and Executing General Policies that Call Other Policies25 Mar 2024