PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
LLMs remain unreliable for long-horizon planning, often generating logically inconsistent or non-applicable plans. Recent hybrid methods instead translate natural language into the Planning Domain Definition Language (PDDL), allowing symbolic planners to produce verifiable plans. However, existing methods frequently rely on rigid generation pipelines, a partial PDDL definition, or human feedback. Furthermore, their evaluation is hindered by the lack of standardized benchmarks with automated verification. To address these limitations, we present PDDLCoder, an agentic framework for PDDL generation from natural language that iteratively generates, analyzes, and refines planning specifications. We further introduce NL-pddlgym, a benchmark dataset comprising 711 planning problems across 23 domains with executable gym environments for the automated verification of plan applicability. Experiments on the NL-pddlgym test set containing 106 problems across 4 held-out domains show that PDDLCoder generates applicable plans for 89.6% of tested planning problems. This improves upon our adaptations of previous PDDL generation methods, which achieved up to 45.3%, and outperforms direct LLM planning approaches, which reached up to 74.5% on the same test set. Our work demonstrates the effectiveness of agentic PDDL generation for planning and establishes a reproducible benchmark for future research on LLM-assisted symbolic planning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 24 of its 34 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
24 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 372
11 more
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 298
- 2023Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planningcited by 204
- 2023ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planningcited by 77
- 2020PDDLGym: Gym Environments from PDDL Problemscited by 45
- 2024Planetarium: A Rigorous Benchmark for Translating Text to Structured Planning Languagescited by 32
- 2025Text2World: Benchmarking Large Language Models for Symbolic World Model Generationcited by 25
- 2024NL2Plan: Robust LLM-Driven Planning from Minimal Text Descriptionscited by 22
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Expertscited by 15
- 2025Generating Symbolic World Models via Test-time Scaling of Large Language Modelscited by 12
- 2025Unifying Inference-Time Planning Language Generationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025An Extensive Evaluation of PDDL Capabilities in off-the-shelf LLMs
- 2025End-to-end PDDL Planning with Hardcoded and Dynamic Agents
- 2026Model Space Reasoning as Search in Feedback Space for Planning Domain Generation
- 2026Language Models as Higher-Order Planning Formalizers
- 2026Training the Orchestrator: A Supervised Approach to End-to-End PDDL Planning with LLM Agents
- 2026Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisation
- 2024Leveraging Environment Interaction for Automated PDDL Translation and Planning with Large Language Models
- 2025One Demo Is All It Takes: Planning Domain Derivation with LLMs from A Single Demonstration