# Situational Grounding within Multimodal Simulations

arXiv: https://arxiv.org/abs/1902.01886 · HTML: https://mlsanity.com/paper/1902.01886/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Feb 2019.

## Built on by (most cited first, 1 of 1)

- [Computational Thought Experiments for a More Rigorous Philosophy and Science of the Mind](https://mlsanity.com/paper/2405.08304/) (2024)

## Abstract (arXiv)

In this paper, we argue that simulation platforms enable a novel type of embodied spatial reasoning, one facilitated by a formal model of object and event semantics that renders the continuous quantitative search space of an open-world, real-time environment tractable. We provide examples for how a semantically-informed AI system can exploit the precise, numerical information provided by a game engine to perform qualitative reasoning about objects and events, facilitate learning novel concepts from data, and communicate with a human to improve its models and demonstrate its understanding. We argue that simulation environments, and game engines in particular, bring together many different notions of "simulation" and many different technologies to provide a highly-effective platform for developing both AI systems and tools to experiment in both machine and human intelligence.