mlsanityData to 14 Oct 2026

Human-centric Indoor Scene Synthesis Using Stochastic Grammar

arXiv 1808.08473 ↗First posted 25 Aug 2018cs.CVcited by 74

Not on the map. Why?

Abstract (arXiv)

We present a human-centric method to sample and synthesize 3D room layouts and 2D images thereof, to obtain large-scale 2D/3D image data with perfect per-pixel ground truth. An attributed spatial And-Or graph (S-AOG) is proposed to represent indoor scenes. The S-AOG is a probabilistic grammar model, in which the terminal nodes are object entities. Human contexts as contextual relations are encoded by Markov Random Fields (MRF) on the terminal nodes. We learn the distributions from an indoor scene dataset and sample new layouts using Monte Carlo Markov Chain. Experiments demonstrate that our method can robustly sample a large variety of realistic room layouts based on three criteria: (i) visual realism comparing to a state-of-the-art room arrangement method, (ii) accuracy of the affordance maps with respect to groundtruth, and (ii) the functionality and naturalness of synthesized rooms evaluated by human subjects. The code is available at https://github.com/SiyuanQi/human-centric-scene-synthesis.

Key facts. Cited by 74 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 16; 2022: 10; 2023: 15; 2024: 14; 2025: 11; 2026: 8.

74 papers.

Sort:

By area:

  1. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  2. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
  3. 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
  4. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  5. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
  6. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  7. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  8. 2024I-Design: Personalized LLM Interior Designercited by 87
  9. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
  10. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 76
  11. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  12. 2022MIME: Human-Aware 3D Scene Generationcited by 57
38 more
  1. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 56
  2. 2024Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databasescited by 45
  3. 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
  4. 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splattingcited by 42
  5. 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 39
  6. 2024AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agentscited by 32
  7. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 32
  8. 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
  9. 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
  10. 2025HSM: Hierarchical Scene Motifs for Multi-Scale Indoor Scene Generationcited by 24
  11. 20253D Scene Generation: A Surveycited by 24
  12. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
  13. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
  14. 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
  15. 2022Sequential Manipulation Planning on Scene Graphcited by 17
  16. 2023CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embeddingcited by 16
  17. 2021Reconstructing Interactive 3D Scenes by Panoptic Mapping and CAD Model Alignmentscited by 15
  18. 2021SimJEB: Simulated Jet Engine Bracket Datasetcited by 14
  19. 2025CasaGPT: Cuboid Arrangement and Scene Assembly for Interior Designcited by 14
  20. 2022TarGF: Learning Target Gradient Field to Rearrange Objects without Explicit Goal Specificationcited by 13
  21. 2021LUMINOUS: Indoor Scene Generation for Embodied AI Challengescited by 12
  22. 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
  23. 2023STRAP: Structured Object Affordance Segmentation with Point Supervisioncited by 10
  24. 2023Language-driven Scene Synthesis using Multi-conditional Diffusion Modelcited by 10
  25. 2024FurniScene: A Large-scale 3D Room Dataset with Intricate Furnishing Scenescited by 10
  26. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
  27. 2021RelTransformer: A Transformer-Based Long-Tail Visual Relationship Recognitioncited by 9
  28. 2021SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialoguescited by 9
  29. 2025Steerable Scene Generation with Post Training and Inference-Time Searchcited by 9
  30. 2023LVDiffusor: Distilling Functional Rearrangement Priors from Large Models into Diffusorcited by 7
  31. 2021A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semanticscited by 6
  32. 2022GraphMapper: Efficient Visual Navigation by Scene Graph Generationcited by 6
  33. 2024InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Priorcited by 6
  34. 2025ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editingcited by 6
  35. 2021Multi-Agent Reinforcement Learning of 3D Furniture Layout Simulation in Indoor Graphics Scenescited by 5
  36. 2023Rearrange Indoor Scenes for Human-Robot Co-Activitycited by 5
  37. 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Modelscited by 5
  38. 2021Walk2Map: Extracting Floor Plans from Indoor Walk Trajectoriescited by 4

50 most cited of 74 All 74 (JSON)