Sequence-Based Plan Feasibility Prediction for Efficient Task and Motion Planning
Not on the map. Why?
Abstract (arXiv)
We present a learning-enabled Task and Motion Planning (TAMP) algorithm for solving mobile manipulation problems in environments with many articulated and movable obstacles. Our idea is to bias the search procedure of a traditional TAMP planner with a learned plan feasibility predictor. The core of our algorithm is PIGINet, a novel Transformer-based learning method that takes in a task plan, the goal, and the initial state, and predicts the probability of finding motion trajectories associated with the task plan. We integrate PIGINet within a TAMP planner that generates a diverse set of high-level task plans, sorts them by their predicted likelihood of feasibility, and refines them in that order. We evaluate the runtime of our TAMP algorithm on seven families of kitchen rearrangement problems, comparing its performance to that of non-learning baselines. Our experiments show that PIGINet substantially improves planning efficiency, cutting down runtime by 80% on problems with small state spaces and 10%-50% on larger ones, after being trained on only 150-600 problems. Finally, it also achieves zero-shot generalization to problems with unseen object categories thanks to its visual encoding of objects. Project page https://piginet.github.io/.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 3 Nov 2022.
Builds on
13 of 27 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2020Integrated Task and Motion Planningcited by 290
- 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 150
- 2021A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Executioncited by 91
- 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
- 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 59
- 2021SORNet: Spatial Object-Centric Representations for Sequential Manipulationcited by 48
- 2020Planning with Learned Object Importance in Large Problem Instances using Graph Neural Networkscited by 38
- 2021Extended Tree Search for Robot Task and Motion Planningcited by 14
- 2021Learning to Search in Task and Motion Planning with Streamscited by 10
- 2022Accelerating Integrated Task and Motion Planning with Neural Feasibility Checkingcited by 10
1 more
Built on by
Citing papers per year: 2023: 3; 2024: 9; 2025: 3; 2026: 4.
19 papers.
Sort:
By area:
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoningcited by 63
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 61
- 2024Guiding Long-Horizon Task and Motion Planning with Vision Language Modelscited by 47
- 2023Compositional Diffusion-Based Continuous Constraint Solverscited by 40
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 20
- 2024Partially Observable Task and Motion Planning with Uncertainty and Risk Awarenesscited by 17
- 2025Learning Compositional Behaviors from Demonstration and Languagecited by 15
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Taskscited by 6
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Modelscited by 5
- 2024Learning Planning Abstractions from Languagecited by 3
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assemblycited by 2
7 more
- 2024RobKiNet: Robotic Kinematics Informed Neural Network for Optimal Robot Configuration Predictioncited by 1
- 2024LLM-guided Task and Motion Planning using Knowledge-based Reasoningcited by 1
- 2026PRISM: Personalized Robotic Dataset Generation via Image-based Scene and Motion Synthesiscited by 1
- 2025Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skillscited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environmentscited by 0
- 2026Verification-Gated Agentic Mission-State Governance for Intelligent Industrial Multi-Robot Systemscited by 0
- 2026PRISM: Personalized Robotic Dataset Generation via Image-based Scene and Motion Synthesis6 Jul 2026
- 2026Verification-Gated Agentic Mission-State Governance for Intelligent Industrial Multi-Robot Systems30 Jun 2026
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environments25 Jun 2026
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2025Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skills29 Oct 2025
- 2025Learning Compositional Behaviors from Demonstration and Language28 May 2025
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Tasks12 May 2025
- 2024LLM-guided Task and Motion Planning using Knowledge-based Reasoning10 Dec 2024
- 2024Guiding Long-Horizon Task and Motion Planning with Vision Language Models3 Oct 2024
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation3 Sep 2024
- 2024Learning Planning Abstractions from Language6 May 2024
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches3 Apr 2024
7 more
- 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning18 Mar 2024
- 2024Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness15 Mar 2024
- 2024RobKiNet: Robotic Kinematics Informed Neural Network for Optimal Robot Configuration Prediction26 Feb 2024
- 2024Real-World Robot Applications of Foundation Models: A Review8 Feb 2024
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Models26 Sep 2023
- 2023Compositional Diffusion-Based Continuous Constraint Solvers2 Sep 2023
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assembly3 Jul 2023
- 2023Compositional Diffusion-Based Continuous Constraint Solverscited by 40
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 20
- 2024Partially Observable Task and Motion Planning with Uncertainty and Risk Awarenesscited by 17
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Taskscited by 6
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Modelscited by 5
- 2024Learning Planning Abstractions from Languagecited by 3
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assemblycited by 2
- 2024RobKiNet: Robotic Kinematics Informed Neural Network for Optimal Robot Configuration Predictioncited by 1
- 2025Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skillscited by 0
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environmentscited by 0
- 2026Learning Motion Feasibility from Point Clouds in Cluttered Environments25 Jun 2026
- 2025Learning to Plan & Schedule with Reinforcement-Learned Bimanual Robot Skills29 Oct 2025
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Tasks12 May 2025
- 2024Learning Planning Abstractions from Language6 May 2024
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches3 Apr 2024
- 2024Partially Observable Task and Motion Planning with Uncertainty and Risk Awareness15 Mar 2024
- 2024RobKiNet: Robotic Kinematics Informed Neural Network for Optimal Robot Configuration Prediction26 Feb 2024
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Models26 Sep 2023
- 2023Compositional Diffusion-Based Continuous Constraint Solvers2 Sep 2023
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assembly3 Jul 2023