mlsanityData to 7 Oct 2026

Coding Agents for Generalized Task and Motion Planning Problems

arXiv 2609.30233 ↗First posted 24 Sep 2026cs.RO cs.AIcited by 1

On the map: LLM agents and tool use → Reinforcement learning for LLM agents also fits: Multimodal and embodied agents

Abstract (arXiv)

Task and motion planning (TAMP) problems remain difficult even with full observability and object-centric states because discrete decisions are tightly coupled to geometric, kinematic, and dynamic constraints. Generalized TAMP addresses this difficulty by exploiting regularities across problem instances to reduce planning effort on new instances. However, existing methods require substantial TAMP-specific engineering. We investigate whether coding agents can automate this process by synthesizing programs that generalize across instances. Given a task description and simulator access, each agent chooses how to interact with the environment while developing a program within a fixed synthesis budget. The program is then frozen and evaluated on unseen instances. We evaluate Claude Code (Opus 5) and Codex (GPT-5.6 Sol and GPT-6 Astra) on 28 simulated environments from KinDER and PDDLStream, with object counts beyond those evaluated in the original benchmark. Across all program synthesis methods, we evaluate 980 generated programs on 100 held-out instances each, 98,000 evaluation episodes in total. Overall, we find that coding agents are surprisingly effective at generalized TAMP: all three agent configurations outperform hand-engineered planners, one-shot generation, and an LLM-based generalized planning baseline in mean success (56% to 95% versus 47% for the planners, on the 16 environments where a planner is available). As object counts grow, the agents' programs maintain higher success than the planner, using an order of magnitude less computation per instance on average. Logs show agents using interaction to calibrate physical models, test edge cases, and refine strategies. We release all code, including the full prompts given to the agents. These findings suggest that coding agents are a strong baseline for generalized TAMP.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reinforcement learning for LLM agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 36 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

25 of 36 references.

References · 25

  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  4. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  5. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
  6. 2020Integrated Task and Motion Planningcited by 281
  7. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
  8. 2018PDDLStream: Integrating Symbolic Planners and Blackbox Samplers via Optimistic Adaptive Planningcited by 147
  9. 2023Generalized Planning in PDDL Domains with Pretrained Large Language Modelscited by 139
  10. 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulationcited by 72
  11. 2024LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoningcited by 63
  12. 2020Learning compositional models of robot skills for task and motion planningcited by 47
13 more
  1. 2026ASPIRE: Agentic /Skills Discovery for Roboticscited by 44
  2. 2024Trust the PRoC3S: Solving Long-Horizon Robotics Problems with LLMs and Constraint Satisfactioncited by 19
  3. 2025Classical Planning with LLM-Generated Heuristics: Challenging the State of the Art with Python Codecited by 18
  4. 2026RHO: Your Coding Agent is Secretly a Roboticistcited by 18
  5. 2021Discovering State and Action Abstractions for Generalized Task and Motion Planningcited by 17
  6. 2024GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Taskscited by 9
  7. 2024Open-World Task and Motion Planning via Vision-Language Model Generated Constraintscited by 9
  8. 2025Frontier Large Language Models Rival State-of-the-Art Plannerscited by 6
  9. 2026Demonstration-Free Robotic Control via LLM Agentscited by 6
  10. 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStreamcited by 4
  11. 2025Meta-Optimization and Program Search using Language Models for Task and Motion Planningcited by 3
  12. 2026MEMENTO: Memory-Guided Memetic Code-as-Policy Evolutioncited by 3
  13. 2026KinDER: A Physical Reasoning Benchmark for Robot Learning and Planningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Code-as-Symbolic-Planner: Foundation Model-Based Robot Planning via Symbolic Code Generation
  2. 2025Prime the search: Using large language models for guiding geometric task and motion planning by warm-starting tree search
  3. 2023Unified Task and Motion Planning using Object-centric Abstractions of Motion Constraints
  4. 2025Kinodynamic Task and Motion Planning using VLM-guided and Interleaved Sampling ↗
  5. 2026Atomic Task Graph: A Unified Framework for Agentic Planning and Execution
  6. 2026RAPID: Robot Agentic Programming from Demonstrations
  7. 2026OTAP: Structure-Aware Optimal Transport for Evaluating Planning and Execution in Agent Trajectories
  8. 2026EmbodiedSWE: Coding Agents for Long Horizon Dexterous Robotics