HiGS: Hierarchical Generative Scene Framework for Multi-Step Associative Semantic Spatial Composition
Not on the map. Why?
Abstract (arXiv)
Three-dimensional scene generation holds significant potential in gaming, film, and virtual reality. However, most existing methods adopt a single-step generation process, making it difficult to balance scene complexity with minimal user input. Inspired by the human cognitive process in scene modeling, which progresses from global to local, focuses on key elements, and completes the scene through semantic association, we propose HiGS, a hierarchical generative framework for multi-step associative semantic spatial composition. HiGS enables users to iteratively expand scenes by selecting key semantic objects, offering fine-grained control over regions of interest while the model completes peripheral areas automatically. To support structured and coherent generation, we introduce the Progressive Hierarchical Spatial-Semantic Graph (PHiSSG), which dynamically organizes spatial relationships and semantic dependencies across the evolving scene structure. PHiSSG ensures spatial and geometric consistency throughout the generation process by maintaining a one-to-one mapping between graph nodes and generated objects and supporting recursive layout optimization. Experiments demonstrate that HiGS outperforms single-stage methods in layout plausibility, style consistency, and user preference, offering a controllable and extensible paradigm for efficient 3D scene construction.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 30 references that are in the map. First posted on arXiv 31 Oct 2025.
Builds on
30 of 30 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Qwen Technical Reportcited by 3,273
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 257
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
18 more
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023WonderJourney: Going from Anywhere to Everywherecited by 157
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2024GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splattingcited by 104
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 94
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2024SceneCraft: Layout-Guided 3D Scene Generationcited by 40
- 2025Detect Anything 3D in the Wildcited by 32
- 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertaintycited by 30
- 2022COFS: Controllable Furniture layout Synthesiscited by 14
- 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
- 2025HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets and CLIP Modelscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.