mlsanityData to 7 Oct 2026

NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds

arXiv 2401.03546 ↗First posted 7 Jan 2024cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

As AI agents leave the lab and venture into the real world as autonomous vehicles, delivery robots, and cooking robots, it is increasingly necessary to design and comprehensively evaluate algorithms that tackle the ``open-world''. To this end, we introduce NovelGym, a flexible and adaptable ecosystem designed to simulate gridworld environments, serving as a robust platform for benchmarking reinforcement learning (RL) and hybrid planning and learning agents in open-world contexts. The modular architecture of NovelGym facilitates rapid creation and modification of task environments, including multi-agent scenarios, with multiple environment transformations, thus providing a dynamic testbed for researchers to develop open-world AI agents.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 29 references that are in the map. First posted on arXiv 7 Jan 2024.

Builds on

12 of 29 references.

References · 12

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  3. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  4. 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 282
  5. 2020PettingZoo: Gym for Multi-Agent Reinforcement Learningcited by 209
  6. 2021Tianshou: a Highly Modularized Deep Reinforcement Learning Librarycited by 139
  7. 2020PDDLGym: Gym Environments from PDDL Problemscited by 45
  8. 2020SPOTTER: Extending Symbolic Planning Operators through Targeted Reinforcement Learningcited by 23
  9. 2020Tonic: A Deep Reinforcement Learning Library for Fast Prototyping and Benchmarkingcited by 18
  10. 2022NovGrid: A Flexible Grid World for Evaluating Agent Response to Noveltycited by 14
  11. 2022RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environmentscited by 13
  12. 2022Robot Task Planning and Situation Handling in Open Worldscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.