NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds
Not on the map. Why?
Abstract (arXiv)
As AI agents leave the lab and venture into the real world as autonomous vehicles, delivery robots, and cooking robots, it is increasingly necessary to design and comprehensively evaluate algorithms that tackle the ``open-world''. To this end, we introduce NovelGym, a flexible and adaptable ecosystem designed to simulate gridworld environments, serving as a robust platform for benchmarking reinforcement learning (RL) and hybrid planning and learning agents in open-world contexts. The modular architecture of NovelGym facilitates rapid creation and modification of task environments, including multi-agent scenarios, with multiple environment transformations, thus providing a dynamic testbed for researchers to develop open-world AI agents.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 7 Jan 2024.
Builds on
12 of 29 references.
References · 12
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
- 2020PettingZoo: Gym for Multi-Agent Reinforcement Learningcited by 209
- 2021Tianshou: a Highly Modularized Deep Reinforcement Learning Librarycited by 139
- 2020PDDLGym: Gym Environments from PDDL Problemscited by 45
- 2020SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learningcited by 23
- 2020Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and Benchmarkingcited by 18
- 2022NovGrid: A Flexible Grid World for Evaluating Agent Response to Noveltycited by 14
- 2022RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environmentscited by 13
- 2022Robot Task Planning and Situation Handling in Open Worldscited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2026KGLAMP: Knowledge Graph-guided Language model for Adaptive Multi-robot Planning and Replanningcited by 2
- 2025HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gymcited by 1
- 2026MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraftcited by 1
- 2025Requirements for Recognition and Rapid Response to Unfamiliar Events Outside of Agent Design Scopecited by 0
- 2026MirrorCraft: Paired Evaluation under Hidden Rule Changes in Minecraft31 Jul 2026
- 2026KGLAMP: Knowledge Graph-guided Language model for Adaptive Multi-robot Planning and Replanning4 Feb 2026
- 2025HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gym28 May 2025
- 2025Requirements for Recognition and Rapid Response to Unfamiliar Events Outside of Agent Design Scope16 Apr 2025