mlsanityData to 13 Oct 2026

A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches

arXiv 2404.02817 ↗First posted 3 Apr 2024cs.RO cs.AIcited by 20

Not on the map. Why?

Abstract (arXiv)

Task and Motion Planning (TAMP) integrates high-level task planning and low-level motion planning to equip robots with the autonomy to effectively reason over long-horizon, dynamic tasks. Optimization-based TAMP focuses on hybrid optimization approaches that define goal conditions via objective functions and are capable of handling open-ended goals, robotic dynamics, and physical interaction between the robot and the environment. Therefore, optimization-based TAMP is particularly suited to solve highly complex, contact-rich locomotion and manipulation problems. This survey provides a comprehensive review on optimization-based TAMP, covering (i) planning domain representations, including action description languages and temporal logic, (ii) individual solution strategies for components of TAMP, including AI planning and trajectory optimization (TO), and (iii) the dynamic interplay between logic-based task planning and model-based TO. A particular focus of this survey is to highlight the algorithm structures to efficiently solve TAMP, especially hierarchical and distributed approaches. Additionally, the survey emphasizes the synergy between the classical methods and contemporary learning-based innovations such as large language models. Furthermore, the future research directions for TAMP is discussed in this survey, highlighting both algorithmic and application-specific challenges.

Key facts. Cited by 20 papers in the map (data through 13 Oct 2026). Builds on 153 of its 282 references that are in the map. First posted on arXiv 3 Apr 2024.

Builds on

153 of 282 references.

References · 153

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,072
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,999
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,760
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,321
  5. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,229
  6. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,065
  7. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,035
  8. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
  9. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 739
  10. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 687
  11. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 637
  12. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 613
38 more
  1. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 602
  2. 2022Is Conditional Generative Modeling all you need for Decision-Making?cited by 506
  3. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
  4. 2016Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimizationcited by 400
  5. 2019Exact Combinatorial Optimization with Graph Convolutional Neural Networkscited by 314
  6. 2023Language to Rewards for Robotic Skill Synthesiscited by 309
  7. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 302
  8. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 292
  9. 2020Integrated Task and Motion Planningcited by 285
  10. 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
  11. 2023MathPrompter: Mathematical Reasoning using Large Language Modelscited by 236
  12. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  13. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
  14. 2023Augmenting Language Models with Long-Term Memorycited by 188
  15. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 173
  16. 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
  17. 2023Vision-Language Models are Zero-Shot Reward Models for Reinforcement Learningcited by 157
  18. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Modelscited by 152
  19. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 148
  20. 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
  21. 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
  22. 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 135
  23. 2023Translating Natural Language to Planning Goals with Large-Language Modelscited by 133
  24. 2017A Review on Bilevel Optimization: From Classical to Evolutionary Approaches and Applicationscited by 127
  25. 2023GenSim: Generating Robotic Simulation Tasks via Large Language Modelscited by 121
  26. 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 112
  27. 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 103
  28. 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 102
  29. 2023Compositional Foundation Models for Hierarchical Planningcited by 94
  30. 2023Generative Skill Chaining: Long-Horizon Skill Planning with Diffusion Modelscited by 88
  31. 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
  32. 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 80
  33. 2017Neural Task Programming: Learning to Generalize Across Hierarchical Taskscited by 75
  34. 2022Correcting Robot Plans with Natural Language Feedbackcited by 68
  35. 2023Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memorycited by 64
  36. 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 63
  37. 2018Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstrationcited by 60
  38. 2023Large Language Models are Visual Reasoning Coordinatorscited by 58

50 most cited of 153 All 153 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 2; 2025: 9; 2026: 9.

20 papers.

Sort:

By area:

  1. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 177
  2. 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
  3. 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
  4. 2025Dream2Flow: Bridging Video Generation and Open-World Manipulation with 3D Object Flowcited by 23
  5. 2025ASHiTA: Automatic Scene-grounded HIerarchical Task Analysiscited by 8
  6. 2025CHD: Coupled Hierarchical Diffusion for Long-Horizon Taskscited by 6
  7. 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specificationscited by 4
  8. 2026Using large language models for embodied planning introduces systematic safety riskscited by 4
  9. 2025Vision-Language-Policy Model for Dynamic Robot Task Planningcited by 2
  10. 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
  11. 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systemscited by 0
  12. 2025From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Controlcited by 0
8 more
  1. 2025LADY: Linear Attention for Autonomous Driving Efficiency without Transformerscited by 0
  2. 2026SIT-LMPC: Safe Information-Theoretic Learning Model Predictive Control for Iterative Taskscited by 0
  3. 2026A Hierarchical Error-Corrective Graph Framework for Autonomous Agents with LLM-Based Action Generationcited by 0
  4. 2026Learning Bilevel Policies over Symbolic World Models for Long-Horizon Planningcited by 0
  5. 2026Bounding Boxes as Goals: Language-Conditioned Grasping via Neuro-Symbolic Planningcited by 0
  6. 2026MagicSim: A Unified Infrastructure for Executable Embodied Interactioncited by 0
  7. 2026Human2Any: Human-to-Robot Transfer via Constraint-Aware Compositional Planningcited by 0
  8. 2026Safe Task Planning with Long-Term Graph Memory for Embodied Agentscited by 0