PDDLGym: Gym Environments from PDDL Problems
Not on the map. Why?
Abstract (arXiv)
We present PDDLGym, a framework that automatically constructs OpenAI Gym environments from PDDL domains and problems. Observations and actions in PDDLGym are relational, making the framework particularly well-suited for research in relational reinforcement learning and relational sequential decision-making. PDDLGym is also useful as a generic framework for rapidly building numerous, diverse benchmarks from a concise and familiar specification language. We discuss design decisions and implementation details, and also illustrate empirical variations between the 20 built-in environments in terms of planning and model-learning difficulty. We hope that PDDLGym will facilitate bridge-building between the reinforcement learning community (from which Gym emerged) and the AI planning community (which produced PDDL). We look forward to gathering feedback from all those interested and expanding the set of available environments and features accordingly. Code: https://github.com/tomsilver/pddlgym
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 3; 2024: 6; 2025: 15; 2026: 10.
45 papers.
Sort:
By area:
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Modelscited by 33
- 2023Vision-Language Interpreter for Robot Task Planningcited by 29
- 2021Classical Planning in Deep Latent Spacecited by 21
- 2021Reinforcement Learning for Classical Planning: Viewing Heuristics as Dense Reward Generatorscited by 21
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Expertscited by 15
- 2025NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domainscited by 15
- 2022Explainable Reinforcement Learning via Model Transformscited by 11
- 2022Goal Recognition as Reinforcement Learningcited by 9
- 2022PG3: Policy-Guided Planning for Generalized Policy Generationcited by 8
- 2022pyRDDLGym: From RDDL to Gym Environmentscited by 8
33 more
- 2023MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worldscited by 5
- 2025NeSyPr: Neurosymbolic Proceduralization For Efficient Embodied Reasoningcited by 5
- 2024NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worldscited by 4
- 2025Simulation to Rules: A Dual-VLM Framework for Formal Visual Planningcited by 4
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaborationcited by 3
- 2022Learning First-Order Symbolic Planning Representations That Are Groundedcited by 2
- 2025An Extensive Evaluation of PDDL Capabilities in off-the-shelf LLMscited by 2
- 2025Context Matters! Relaxing Goals with LLMs for Feasible 3D Scene Planningcited by 2
- 2026Under the Influence: Quantifying Persuasion and Vigilance in Large Language Modelscited by 2
- 2026Learning Lifted Action Models from Unsupervised Visual Tracescited by 2
- 2021Learning Causal Models of Autonomous Agents using Interventionscited by 1
- 2025Learning Hierarchical Domain Models Through Environment-Grounded Interactioncited by 1
- 2025HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gymcited by 1
- 2025Diverse Planning with Simulators via Linear Temporal Logiccited by 1
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systemscited by 1
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competitioncited by 1
- 2022Neural NID Rulescited by 0
- 2022The Sandbox Environment for Generalizable Agent Research (SEGAR)cited by 0
- 2023Human in the Loop Novelty Generationcited by 0
- 2024Meta-operators for Enabling Parallel Planning Using Deep Reinforcement Learningcited by 0
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learningcited by 0
- 2025Guided Exploration for Efficient Relational Model Learningcited by 0
- 2025OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflectionscited by 0
- 2025Integrating Symbolic RL Planning into a BDI-based Autonomous UAV Framework: System Integration and SIL Validationcited by 0
- 2025Revisiting Landmarks: Learning from Previous Plans to Generalize over Problem Instancescited by 0
- 2025Neuro-Logic Lifelong Learningcited by 0
- 2025Autonomous Assessment of Generalizability of AI Agent Capabilitiescited by 0
- 2026RAMP: Hybrid DRL for Online Learning of Numeric Action Modelscited by 0
- 2026SVoT: State-aware Visualization-of-Thought for Spatial Reasoning via Reinforcement Learningcited by 0
- 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Gamescited by 0
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combatcited by 0
- 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planningcited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanismscited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms23 Sep 2026
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competition31 Aug 2026
- 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning17 Aug 2026
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat31 Jul 2026
- 2026Mind-Studio: Executable World Models with Lookahead Evaluation for Partially Observable Games14 Jun 2026
- 2026SVoT: State-aware Visualization-of-Thought for Spatial Reasoning via Reinforcement Learning10 Jun 2026
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems7 Jun 2026
- 2026Learning Lifted Action Models from Unsupervised Visual Traces21 Apr 2026
- 2026RAMP: Hybrid DRL for Online Learning of Numeric Action Models9 Apr 2026
- 2026Under the Influence: Quantifying Persuasion and Vigilance in Large Language Models24 Feb 2026
- 2025Autonomous Assessment of Generalizability of AI Agent Capabilities18 Dec 2025
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaboration4 Dec 2025
33 more
- 2025Neuro-Logic Lifelong Learning16 Nov 2025
- 2025NeSyPr: Neurosymbolic Proceduralization For Efficient Embodied Reasoning22 Oct 2025
- 2025Diverse Planning with Simulators via Linear Temporal Logic20 Oct 2025
- 2025Simulation to Rules: A Dual-VLM Framework for Formal Visual Planning3 Oct 2025
- 2025Revisiting Landmarks: Learning from Previous Plans to Generalize over Problem Instances29 Aug 2025
- 2025Integrating Symbolic RL Planning into a BDI-based Autonomous UAV Framework: System Integration and SIL Validation16 Aug 2025
- 2025OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflections20 Jun 2025
- 2025Context Matters! Relaxing Goals with LLMs for Feasible 3D Scene Planning18 Jun 2025
- 2025HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gym28 May 2025
- 2025Learning Hierarchical Domain Models Through Environment-Grounded Interaction15 May 2025
- 2025NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domains2 Mar 2025
- 2025An Extensive Evaluation of PDDL Capabilities in off-the-shelf LLMs27 Feb 2025
- 2025Guided Exploration for Efficient Relational Model Learning10 Feb 2025
- 2024A Research Agenda for Usability and Generalisation in Reinforcement Learning22 Dec 2024
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Experts24 Sep 2024
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models4 Apr 2024
- 2024Meta-operators for Enabling Parallel Planning Using Deep Reinforcement Learning13 Mar 2024
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan 2024
- 2024NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds7 Jan 2024
- 2023MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worlds20 Dec 2023
- 2023Vision-Language Interpreter for Robot Task Planning2 Nov 2023
- 2023Human in the Loop Novelty Generation7 Jun 2023
- 2022pyRDDLGym: From RDDL to Gym Environments11 Nov 2022
- 2022Explainable Reinforcement Learning via Model Transforms24 Sep 2022
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphs11 Jul 2022
- 2022Learning First-Order Symbolic Planning Representations That Are Grounded25 Apr 2022
- 2022PG3: Policy-Guided Planning for Generalized Policy Generation21 Apr 2022
- 2022The Sandbox Environment for Generalizable Agent Research (SEGAR)19 Mar 2022
- 2022Goal Recognition as Reinforcement Learning13 Feb 2022
- 2022Neural NID Rules12 Feb 2022
- 2021Reinforcement Learning for Classical Planning: Viewing Heuristics as Dense Reward Generators30 Sep 2021
- 2021Learning Causal Models of Autonomous Agents using Interventions21 Aug 2021
- 2021Classical Planning in Deep Latent Space30 Jun 2021
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 319
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systemscited by 1
- 2025OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflectionscited by 0
- 2025Autonomous Assessment of Generalizability of AI Agent Capabilitiescited by 0
- 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planningcited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanismscited by 0
- 2026Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms23 Sep 2026
- 2026PDDLCoder: Agentic PDDL Generation for LLM-Assisted Symbolic Planning17 Aug 2026
- 2026ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems7 Jun 2026
- 2025Autonomous Assessment of Generalizability of AI Agent Capabilities18 Dec 2025
- 2025OmniReflect: Discovering Transferable Constitutions for LLM agents via Neuro-Symbolic Reflections20 Jun 2025
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan 2024
- 2022TASKOGRAPHY: Evaluating robot task planning over large 3D scene graphscited by 59
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Modelscited by 33
- 2023Vision-Language Interpreter for Robot Task Planningcited by 29
- 2021Classical Planning in Deep Latent Spacecited by 21
- 2021Reinforcement Learning for Classical Planning: Viewing Heuristics as Dense Reward Generatorscited by 21
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Expertscited by 15
- 2025NeSyC: A Neuro-symbolic Continual Learner For Complex Embodied Tasks In Open Domainscited by 15
- 2022Explainable Reinforcement Learning via Model Transformscited by 11
- 2022Goal Recognition as Reinforcement Learningcited by 9
- 2022PG3: Policy-Guided Planning for Generalized Policy Generationcited by 8
- 2022pyRDDLGym: From RDDL to Gym Environmentscited by 8
- 2023MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worldscited by 5
12 most cited of 34 All 34 (JSON)
- 2026Robots Influencing Humans to Reveal their Goals during Collaboration and Competition31 Aug 2026
- 2026DungeonBench: A Benchmark for Rules-Rich Tactical Reasoning in Dungeons & Dragons Combat31 Jul 2026
- 2026Learning Lifted Action Models from Unsupervised Visual Traces21 Apr 2026
- 2026RAMP: Hybrid DRL for Online Learning of Numeric Action Models9 Apr 2026
- 2026Under the Influence: Quantifying Persuasion and Vigilance in Large Language Models24 Feb 2026
- 2025Open-Ended Goal Inference through Actions and Language for Human-Robot Collaboration4 Dec 2025
- 2025Neuro-Logic Lifelong Learning16 Nov 2025
- 2025Diverse Planning with Simulators via Linear Temporal Logic20 Oct 2025
- 2025Revisiting Landmarks: Learning from Previous Plans to Generalize over Problem Instances29 Aug 2025
- 2025Integrating Symbolic RL Planning into a BDI-based Autonomous UAV Framework: System Integration and SIL Validation16 Aug 2025
- 2025Context Matters! Relaxing Goals with LLMs for Feasible 3D Scene Planning18 Jun 2025
- 2025HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gym28 May 2025
12 newest of 34 All 34 (JSON)