Exploring the hierarchical structure of human plans via program generation
Not on the map. Why?
Abstract (arXiv)
Human behavior is often assumed to be hierarchically structured, made up of abstract actions that can be decomposed into concrete actions. However, behavior is typically measured as a sequence of actions, which makes it difficult to infer its hierarchical structure. In this paper, we explore how people form hierarchically structured plans, using an experimental paradigm with observable hierarchical representations: participants create programs that produce sequences of actions in a language with explicit hierarchical structure. This task lets us test two well-established principles of human behavior: utility maximization (i.e. using fewer actions) and minimum description length (MDL; i.e. having a shorter program). We find that humans are sensitive to both metrics, but that both accounts fail to predict a qualitative feature of human-created programs, namely that people prefer programs with reuse over and above the predictions of MDL. We formalize this preference for reuse by extending the MDL account into a generative model over programs, modeling hierarchy choice as the induction of a grammar over actions. Our account can explain the preference for reuse and provides better predictions of human behavior, going beyond simple accounts of compressibility to highlight a principle that guides hierarchical planning.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 6 of its 74 references that are in the map. First posted on arXiv 30 Nov 2023.
Builds on
6 of 74 references.
References · 6
- 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 482
- 2019People infer recursive visual concepts from just a few examplescited by 23
- 2022Humans decompose tasks by trading off utility and computational costcited by 18
- 2022Peano: Learning Formal Mathematical Reasoningcited by 15
- 2018Representational efficiency outweighs action efficiency in human program inductioncited by 4
- 2023Habits of Mind: Reusing Action Sequences for Efficient Planningcited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 7.
12 papers.
- 2025Synthesizing world models for bilevel planningcited by 14
- 2026Why Do LLM-based Web Agents Fail? A Hierarchical Planning Perspectivecited by 9
- 2024Harmonizing Program Induction with Rate-Distortion Theorycited by 4
- 2025Cognitive maps are generative programscited by 2
- 2025Agent-centric learning: from external reward maximization to internal knowledge curationcited by 2
- 2026Online library learning in human visual puzzle solvingcited by 1
- 2026From Coarse to Fine: Self-Adaptive Hierarchical Planning for LLM Agentscited by 1
- 2026Path-dependent program induction under resource constraints explains human sequence learningcited by 1
- 2024Learning telic-controllable state representationscited by 0
- 2026Unsupervised Hierarchical Skill Discoverycited by 0
- 2026A Probabilistic Framework for Hierarchical Goal Recognitioncited by 0
- 2026Prospective Compression in Human Abstraction Learningcited by 0
- 2026Path-dependent program induction under resource constraints explains human sequence learning26 May 2026
- 2026Prospective Compression in Human Abstraction Learning11 May 2026
- 2026From Coarse to Fine: Self-Adaptive Hierarchical Planning for LLM Agents25 Apr 2026
- 2026A Probabilistic Framework for Hierarchical Goal Recognition24 Apr 2026
- 2026Online library learning in human visual puzzle solving24 Mar 2026
- 2026Why Do LLM-based Web Agents Fail? A Hierarchical Planning Perspective15 Mar 2026
- 2026Unsupervised Hierarchical Skill Discovery30 Jan 2026
- 2025Agent-centric learning: from external reward maximization to internal knowledge curation29 Jul 2025
- 2025Cognitive maps are generative programs29 Apr 2025
- 2025Synthesizing world models for bilevel planning26 Mar 2025
- 2024Learning telic-controllable state representations20 Jun 2024
- 2024Harmonizing Program Induction with Rate-Distortion Theory8 May 2024