A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches
Not on the map. Why?
Abstract (arXiv)
Task and Motion Planning (TAMP) integrates high-level task planning and low-level motion planning to equip robots with the autonomy to effectively reason over long-horizon, dynamic tasks. Optimization-based TAMP focuses on hybrid optimization approaches that define goal conditions via objective functions and are capable of handling open-ended goals, robotic dynamics, and physical interaction between the robot and the environment. Therefore, optimization-based TAMP is particularly suited to solve highly complex, contact-rich locomotion and manipulation problems. This survey provides a comprehensive review on optimization-based TAMP, covering (i) planning domain representations, including action description languages and temporal logic, (ii) individual solution strategies for components of TAMP, including AI planning and trajectory optimization (TO), and (iii) the dynamic interplay between logic-based task planning and model-based TO. A particular focus of this survey is to highlight the algorithm structures to efficiently solve TAMP, especially hierarchical and distributed approaches. Additionally, the survey emphasizes the synergy between the classical methods and contemporary learning-based innovations such as large language models. Furthermore, the future research directions for TAMP is discussed in this survey, highlighting both algorithmic and application-specific challenges.
Key facts. Cited by 20 papers in the map (data through 13 Oct 2026). Builds on 153 of its 282 references that are in the map. First posted on arXiv 3 Apr 2024.
Builds on
153 of 282 references.
References · 153
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,760
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,321
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,229
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,065
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,035
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 687
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 637
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 613
38 more
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 602
- 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 506
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2016Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimizationcited by 400
- 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 314
- 2023Language to Rewards for Robotic Skill Synthesiscited by 309
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 302
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 292
- 2020Integrated Task and Motion Planningcited by 285
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2023Augmenting Language Models with Long-Term Memorycited by 188
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 173
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2023Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learningcited by 157
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 152
- 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 148
- 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
- 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 135
- 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 133
- 2017A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applicationscited by 127
- 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 121
- 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 112
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 103
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 102
- 2023Compositional Foundation Models for Hierarchical Planningcited by 94
- 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 88
- 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
- 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
- 2017Neural Task Programming: Learning to Generalize Across Hierarchical Taskscited by 75
- 2022Correcting Robot Plans with Natural Language Feedbackcited by 68
- 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 63
- 2018Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstrationcited by 60
- 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
50 most cited of 153 All 153 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 9; 2026: 9.
20 papers.
Sort:
By area:
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 177
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2025Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flowcited by 23
- 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysiscited by 8
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Taskscited by 6
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specificationscited by 4
- 2026Using large language models for embodied planning introduces systematic safety riskscited by 4
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planningcited by 2
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systemscited by 0
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Controlcited by 0
8 more
- 2025LADY: Linear Attention for Autonomous Driving Efficiency without Transformerscited by 0
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Taskscited by 0
- 2026A Hierarchical Error-Corrective Graph Framework for Autonomous Agents with LLM-Based Action Generationcited by 0
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
- 2026Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planningcited by 0
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interactioncited by 0
- 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planningcited by 0
- 2026Safe Task Planning with Long-Term Graph Memory for Embodied Agentscited by 0
- 2026Safe Task Planning with Long-Term Graph Memory for Embodied Agents8 Sep 2026
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planning27 Jun 2026
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction16 Jun 2026
- 2026Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planning11 Jun 2026
- 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planning15 May 2026
- 2026Using large language models for embodied planning introduces systematic safety risks20 Apr 2026
- 2026A Hierarchical Error-Corrective Graph Framework for Autonomous Agents with LLM-Based Action Generation9 Mar 2026
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Tasks18 Feb 2026
- 2025Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flow31 Dec 2025
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning22 Dec 2025
- 2025LADY: Linear Attention for Autonomous Driving Efficiency without Transformers17 Dec 2025
8 more
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Control28 May 2025
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Tasks12 May 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systems23 Apr 2025
- 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysis9 Apr 2025
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specifications14 Sep 2024
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 177
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2025Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flowcited by 23
- 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysiscited by 8
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Taskscited by 6
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specificationscited by 4
- 2026Using large language models for embodied planning introduces systematic safety riskscited by 4
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planningcited by 2
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systemscited by 0
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Controlcited by 0
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Taskscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planning27 Jun 2026
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction16 Jun 2026
- 2026Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planning11 Jun 2026
- 2026Using large language models for embodied planning introduces systematic safety risks20 Apr 2026
- 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Tasks18 Feb 2026
- 2025Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flow31 Dec 2025
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning22 Dec 2025
- 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Control28 May 2025
- 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Tasks12 May 2025
- 2025Multi-agent Embodied AI: Advances and Future Directions8 May 2025
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systems23 Apr 2025
- 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysis9 Apr 2025
12 newest of 15 All 15 (JSON)