mlsanityData to 14 Oct 2026

DSG: Dynamic 3D Scene Graph Construction for Embodied Agents in Changing Indoor Environments

arXiv 2609.00619 ↗First posted 1 Sep 2026cs.ROcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene graphs to become inconsistent with the current scene. To address this issue, we propose DSG, a dynamic 3D scene graph construction framework that detects object changes and performs spatial relationship reasoning. First, we construct a semantic-aware 3D Gaussian scene representation and develop a dual-view rendering-based object change detection method to enable reliable scene graph node updates. Second, we propose a spatial relationship reasoning method that incorporates multi-granularity visual context, enabling a large language model to identify a richer set of interobject spatial relationships. Furthermore, we introduce DynTHOR, a dynamic indoor scene graph benchmark built on the AI2-THOR simulation platform for evaluating scene graph construction in dynamic environments. Extensive experiments on Dyn-THOR, 3RScan, and real-world scenes demonstrate that DSG consistently outperforms existing methods in both object node construction and spatial relationship reasoning, significantly improving the accuracy of dynamic scene graph construction.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 35 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

28 of 35 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  5. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  6. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  7. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  8. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 365
  9. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
  10. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
  11. 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 178
  12. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
16 more
  1. 20203D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humanscited by 144
  2. 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
  3. 2025Describe Anything: Detailed Localized Image and Video Captioningcited by 84
  4. 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 80
  5. 20193-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agentscited by 74
  6. 2024CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Fieldcited by 61
  7. 2025WildGS-SLAM: Monocular Gaussian Splatting SLAM in Dynamic Environmentscited by 50
  8. 2024Khronos: A Unified Approach for Spatio-Temporal Metric-Semantic SLAM in Dynamic Environmentscited by 36
  9. 2022S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representationscited by 28
  10. 2024Hier-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian Splattingcited by 15
  11. 2024PG-SLAM: Photo-realistic and Geometry-aware RGB-D SLAM in Dynamic Environmentscited by 11
  12. 2025KeySG: Hierarchical Keyframe-Based 3D Scene Graphscited by 10
  13. 2025DynamicGSG: Dynamic 3D Gaussian Scene Graphs for Environment Adaptationcited by 7
  14. 2026RAG-3DSG: Enhancing 3D Scene Graphs with Re-Shot Guided Retrieval-Augmented Generationcited by 5
  15. 2023Instance-incremental Scene Graph Generation from Real-world Point Clouds via Normalizing Flowscited by 2
  16. 2026EmbodiedSplat: Online Feed-Forward Semantic 3DGS for Open-Vocabulary 3D Scene Understandingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding
  2. 2026SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes
  3. 2025EmbodiedVSR: Dynamic Scene Graph-Guided Chain-of-Thought Reasoning for Visual Spatial Tasks
  4. 2026RieMind: Geometry-Grounded Spatial Agent for Scene Understanding
  5. 2026Relationship-Aware Hierarchical 3D Scene Graph for Task Reasoning
  6. 2026From Pixels to Concepts: Growing Rich 3D Semantic Scene Graph Forests utilizing Foundation Models ↗
  7. 2026Generation of High-Level Concepts in 3D Scene Graphs via Autoregressive Diffusion
  8. 2025GeoSceneGraph: Geometric Scene Graph Diffusion Model for Text-guided 3D Indoor Scene Synthesis