mlsanityData to 7 Oct 2026

General Policies, Subgoal Structure, and Planning Width

arXiv 2311.05490 ↗First posted 9 Nov 2023cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

It has been observed that many classical planning domains with atomic goals can be solved by means of a simple polynomial exploration procedure, called IW, that runs in time exponential in the problem width, which in these cases is bounded and small. Yet, while the notion of width has become part of state-of-the-art planning algorithms such as BFWS, there is no good explanation for why so many benchmark domains have bounded width when atomic goals are considered. In this work, we address this question by relating bounded width with the existence of general optimal policies that in each planning instance are represented by tuples of atoms of bounded size. We also define the notions of (explicit) serializations and serialized width that have a broader scope as many domains have a bounded serialized width but no bounded width. Such problems are solved non-optimally in polynomial time by a suitable variant of the Serialized IW algorithm. Finally, the language of general policies and the semantics of serializations are combined to yield a simple, meaningful, and expressive language for specifying serializations in compact form in the form of sketches, which can be used for encoding domain control knowledge by hand or for learning it from small examples. Sketches express general problem decompositions in terms of subgoals, and sketches of bounded width express problem decompositions that can be solved in polynomial time.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 18 of its 84 references that are in the map. First posted on arXiv 9 Nov 2023.

Builds on

18 of 84 references.

References · 18

  1. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  2. 2016#Exploration: A Study of Count-Based Exploration for Deep Reinforcement Learningcited by 307
  3. 2017Count-Based Exploration with Neural Density Modelscited by 255
  4. 2020Reward Machines: Exploiting Reward Function Structure in Reinforcement Learningcited by 183
  5. 2017A Laplacian Framework for Option Discovery in Reinforcement Learningcited by 108
  6. 2014The LAMA Planner: Guiding Cost-Based Anytime Planning with Landmarkscited by 86
  7. 2017Learning Generalized Reactive Policies using Deep Neural Networkscited by 39
  8. 2019What Can Learned Intrinsic Rewards Capture?cited by 36
  9. 2020Generalized Planning With Deep Reinforcement Learningcited by 35
  10. 2017Action Schema Networks: Generalised Policies with Deep Learningcited by 32
  11. 2018Features, Projections, and Representation Change for Generalized Planningcited by 25
  12. 2019Qualitative Numeric Planning: Reductions and Complexitycited by 18
6 more
  1. 2022Learning Sketches for Decomposing Planning Problems into Subproblems of Bounded Width: Extended Versioncited by 12
  2. 2019Generalized Planning With Procedural Domain Control Knowledgecited by 11
  3. 2021Expressing and Exploiting the Common Subgoal Structure of Classical Planning Domains Using Sketches: Extended Versioncited by 9
  4. 2021Hierarchical Width-Based Planning and Learningcited by 6
  5. 2021Planning for Novelty: Width-Based Algorithms for Common Problems in Control, Planning and Reinforcement Learningcited by 2
  6. 2022Learning Generalized Policy Automata for Relational Stochastic Shortest Path Problemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 2.

6 papers.