# Novelty Accommodating Multi-Agent Planning in High Fidelity Simulated Open World

arXiv: https://arxiv.org/abs/2306.12654 · HTML: https://mlsanity.com/paper/2306.12654/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 48 references that are in the map.
- First posted on arXiv 22 Jun 2023.

## Builds on (most cited first, 10 of 10)

- [OpenAI Gym](https://mlsanity.com/paper/1606.01540/) (2016)
- [Towards Discovery and Attribution of Open-world GAN Generated Images](https://mlsanity.com/paper/2105.04580/) (2021)
- [Measuring and Characterizing Generalization in Deep Reinforcement Learning](https://mlsanity.com/paper/1812.02868/) (2018)
- [Neuro-Symbolic World Models for Adapting to Open World Novelty](https://mlsanity.com/paper/2301.06294/) (2023)
- [Representation Edit Distance as a Measure of Novelty](https://mlsanity.com/paper/2111.02770/) (2021)
- [Toward Defining a Domain Complexity Measure Across Domains](https://mlsanity.com/paper/2303.04141/) (2023)
- [Heuristic Search For Physics-Based Problems: Angry Birds in PDDL+](https://mlsanity.com/paper/2303.16967/) (2023)
- [A Domain-Independent Agent Architecture for Adaptive Operation in Evolving Open Worlds](https://mlsanity.com/paper/2306.06272/) (2023)
- [Characterizing Novelty in the Military Domain](https://mlsanity.com/paper/2302.12314/) (2023)
- [Learning to Operate in Open Worlds by Adapting Planning Models](https://mlsanity.com/paper/2303.14272/) (2023)

## Abstract (arXiv)

Autonomous agents operating within real-world environments often rely on automated planners to ascertain optimal actions towards desired goals or the optimization of a specified objective function. Integral to these agents are common architectural components such as schedulers, tasked with determining the timing for executing planned actions, and execution engines, responsible for carrying out these scheduled actions while monitoring their outcomes. We address the significant challenge that arises when unexpected phenomena, termed textitnovelties, emerge within the environment, altering its fundamental characteristics, composition, and dynamics. This challenge is inherent in all deployed real-world applications and may manifest suddenly and without prior notice or explanation. The introduction of novelties into the environment can lead to inaccuracies within the planner's internal model, rendering previously generated plans obsolete. Recent research introduced agent design aimed at detecting and adapting to such novelties. However, these designs lack consideration for action scheduling in continuous time-space, coordination of concurrent actions by multiple agents, or memory-based novelty accommodation. Additionally, the application has been primarily demonstrated in lower fidelity environments. In our study, we propose a general purpose AI agent framework designed to detect, characterize, and adapt to novelties in highly noisy, complex, and stochastic environments that support concurrent actions and external scheduling. We showcase the efficacy of our agent through experimentation within a high-fidelity simulator for realistic military scenarios.
