FOGMACHINE -- Leveraging Discrete-Event Simulation and Scene Graphs for Modeling Hierarchical, Interconnected Environments under Partial Observations from Mobile Agents
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Dynamic Scene Graphs (DSGs) provide a structured representation of hierarchical, interconnected environments, but current approaches struggle to capture stochastic dynamics, partial observability, and multi-agent activity. These aspects are critical for embodied AI, where agents must act under uncertainty and delayed perception. We introduce FOGMACHINE , an open-source framework that fuses DSGs with discrete-event simulation to model object dynamics, agent observations, and interactions at scale. This setup enables the study of uncertainty propagation, planning under limited perception, and emergent multi-agent behavior. Experiments in urban scenarios illustrate realistic temporal and spatial patterns while revealing the challenges of belief estimation under sparse observations. By combining structured representations with efficient simulation, FOGMACHINE establishes an effective tool for benchmarking, model training, and advancing embodied AI in complex, uncertain environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 10 of its 20 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
10 of 20 references.
References · 10
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
- 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 144
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 52
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2022Reasoning with Scene Graphs for Robot Planning under Partial Observabilitycited by 25
- 2023Modeling Dynamic Environments with Scene Graph Memorycited by 18
- 2025Controllable 3D Outdoor Scene Generation via Scene Graphscited by 9
- 2024Belief Scene Graphs: Expanding Partial Scenes with Objects through Computation of Expectationcited by 4
- 2025Hi-Dyna Graph: Hierarchical Dynamic Scene Graph for Robotic Autonomy in Human-Centric Environmentscited by 2
- 2025SGN-CIRL: Scene Graph-based Navigation with Curriculum, Imitation, and Reinforcement Learningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Lingjing: A Simulation Testbed for Multi-Agent Embodied Tasks in Open-Ended Cities
- 2025A Comprehensive Survey on World Models for Embodied AI
- 2026AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models
- 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulation
- 2026VehicleArena: A Realistic Urban Environment for Multi-Agent Driving
- 2025World-in-World: World Models in a Closed-Loop World
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2026OrbiSim: World Models as Differentiable Physics Engines for Embodied Intelligence