Planning with Learned Object Importance in Large Problem Instances using Graph Neural Networks
Not on the map. Why?
Abstract (arXiv)
Real-world planning problems often involve hundreds or even thousands of objects, straining the limits of modern planners. In this work, we address this challenge by learning to predict a small set of objects that, taken together, would be sufficient for finding a plan. We propose a graph neural network architecture for predicting object importance in a single inference pass, thus incurring little overhead while greatly reducing the number of objects that must be considered by the planner. Our approach treats the planner and transition model as black boxes, and can be used with any off-the-shelf planner. Empirically, across classical planning, probabilistic planning, and robotic task and motion planning, we find that our method results in planning that is significantly faster than several baselines, including other partial grounding strategies and lifted planners. We conclude that learning to predict a sufficient set of objects for a planning problem is a simple, powerful, and general mechanism for planning in large instances. Video: https://youtu.be/FWsVJc2fvCE Code: https://git.io/JIsqX
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 8; 2024: 6; 2025: 5; 2026: 7.
38 papers.
Sort:
By area:
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planningcited by 43
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulationcited by 22
- 2021Efficient and Interpretable Robot Manipulation with Graph Neural Networkscited by 21
- 2022Sequence-Based Plan Feasibility Prediction for Efficient Task and Motion Planningcited by 19
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 19
- 2022STAP: Sequencing Task-Agnostic Policiescited by 17
- 2021Learning to Search in Task and Motion Planning with Streamscited by 9
- 2025MORE: Mobile Manipulation Rearrangement Through Grounded Language Reasoningcited by 9
26 more
- 2022PG3: Policy-Guided Planning for Generalized Policy Generationcited by 8
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structurescited by 7
- 2024Unlocking Large Language Model's Planning Capabilities with Maximum Diversity Fine-tuningcited by 6
- 2022Graph-based Reinforcement Learning meets Mixed Integer Programs: An application to 3D robot assembly discoverycited by 5
- 2023Graph learning in robotics: a surveycited by 5
- 2023MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worldscited by 5
- 2024Graph Learning for Numeric Planningcited by 5
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree searchcited by 4
- 2021Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Searchcited by 3
- 2025SLAP: Shortcut Learning for Abstract Planningcited by 3
- 2023Anticipatory Planning: Improving Long-Lived Planning by Estimating Expected Cost of Future Taskscited by 2
- 2022Solving Disjunctive Temporal Networks with Uncertainty under Restricted Time-Based Controllability using Tree Search and Graph Neural Networkscited by 1
- 2022Policy-Guided Lazy Search with Feedback for Task and Motion Planningcited by 1
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learningcited by 1
- 2024WLPlan: Relational Features for Symbolic Planningcited by 1
- 2026Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teamscited by 1
- 2023A Categorical Representation Language and Computational System for Knowledge-Based Planningcited by 0
- 2024Graph Learning for Planning: The Story Thus Far and Open Challengescited by 0
- 2025Relational GNNs Cannot Learn C2 Features for Planningcited by 0
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristicscited by 0
- 2026Semantic Partial Grounding via LLMscited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraintscited by 0
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environmentscited by 0
- 2026Courteous Anticipation: Improving Long-Lived Task Planning in Persistent Shared Environmentscited by 0
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillationcited by 0
- 2026StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillation17 Sep 2026
- 2026Courteous Anticipation: Improving Long-Lived Task Planning in Persistent Shared Environments22 Jul 2026
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environments25 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2026Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teams9 Mar 2026
- 2026Semantic Partial Grounding via LLMs25 Feb 2026
- 2025SLAP: Shortcut Learning for Abstract Planning2 Nov 2025
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristics18 Aug 2025
- 2025Relational GNNs Cannot Learn C2 Features for Planning13 Jun 2025
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search8 Jun 2025
- 2025MORE: Mobile Manipulation Rearrangement Through Grounded Language Reasoning5 May 2025
26 more
- 2024Graph Learning for Planning: The Story Thus Far and Open Challenges3 Dec 2024
- 2024WLPlan: Relational Features for Symbolic Planning1 Nov 2024
- 2024Graph Learning for Numeric Planning31 Oct 2024
- 2024Learning to Bridge the Gap: Efficient Novelty Recovery with Planning and Reinforcement Learning28 Sep 2024
- 2024Unlocking Large Language Model's Planning Capabilities with Maximum Diversity Fine-tuning15 Jun 2024
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches3 Apr 2024
- 2023MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worlds20 Dec 2023
- 2023Graph learning in robotics: a survey6 Oct 2023
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planning12 Jul 2023
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulation29 Jun 2023
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structures8 Jun 2023
- 2023A Categorical Representation Language and Computational System for Knowledge-Based Planning26 May 2023
- 2023Anticipatory Planning: Improving Long-Lived Planning by Estimating Expected Cost of Future Tasks8 May 2023
- 2023Text2Motion: From Natural Language Instructions to Feasible Plans21 Mar 2023
- 2022Sequence-Based Plan Feasibility Prediction for Efficient Task and Motion Planning3 Nov 2022
- 2022Policy-Guided Lazy Search with Feedback for Task and Motion Planning25 Oct 2022
- 2022STAP: Sequencing Task-Agnostic Policies21 Oct 2022
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphs11 Jul 2022
- 2022PG3: Policy-Guided Planning for Generalized Policy Generation21 Apr 2022
- 2022Solving Disjunctive Temporal Networks with Uncertainty under Restricted Time-Based Controllability using Tree Search and Graph Neural Networks28 Mar 2022
- 2022Graph-based Reinforcement Learning meets Mixed Integer Programs: An application to 3D robot assembly discovery8 Mar 2022
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fields24 Feb 2022
- 2021Learning to Search in Task and Motion Planning with Streams25 Nov 2021
- 2021Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Search2 Aug 2021
- 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning28 May 2021
- 2021Efficient and Interpretable Robot Manipulation with Graph Neural Networks25 Feb 2021
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2022Learning Multi-Object Dynamics with Compositional Neural Radiance Fieldscited by 63
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2021Learning Neuro-Symbolic Relational Transition Models for Bilevel Planningcited by 43
- 2023Dynamic-Resolution Model Learning for Object Pile Manipulationcited by 22
- 2021Efficient and Interpretable Robot Manipulation with Graph Neural Networkscited by 21
- 2022Sequence-Based Plan Feasibility Prediction for Efficient Task and Motion Planningcited by 19
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 19
- 2022STAP: Sequencing Task-Agnostic Policiescited by 17
- 2021Learning to Search in Task and Motion Planning with Streamscited by 9
- 2022PG3: Policy-Guided Planning for Generalized Policy Generationcited by 8
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structurescited by 7
12 most cited of 33 All 33 (JSON)
- 2026Courteous Anticipation: Improving Long-Lived Task Planning in Persistent Shared Environments22 Jul 2026
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environments25 Jun 2026
- 2026Neuro-Symbolic Learning for Long-Horizon Task Planning Under Complex Logical Constraints5 Jun 2026
- 2026Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teams9 Mar 2026
- 2026Semantic Partial Grounding via LLMs25 Feb 2026
- 2025SLAP: Shortcut Learning for Abstract Planning2 Nov 2025
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristics18 Aug 2025
- 2025Relational GNNs Cannot Learn C2 Features for Planning13 Jun 2025
- 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search8 Jun 2025
- 2024Graph Learning for Planning: The Story Thus Far and Open Challenges3 Dec 2024
- 2024WLPlan: Relational Features for Symbolic Planning1 Nov 2024
- 2024Graph Learning for Numeric Planning31 Oct 2024
12 newest of 33 All 33 (JSON)