mlsanityData to 14 Oct 2026

HierRelTriple: Guiding Indoor Layout Generation with Hierarchical Relationship Triplet Losses

arXiv 2503.20289 ↗First posted 26 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a hierarchical triplet-based indoor relationship learning method, coined HierRelTriple, with a focus on spatial relationship learning. Existing approaches often depend on manually defined spatial rules or simplified pairwise representations, which fail to capture complex, multi-object relationships found in real scenarios and lead to overcrowded or physically implausible arrangements. We introduce HierRelTriple, a hierarchical relational triplets modeling framework that first partitions functional regions and then automatically extracts three levels of spatial relationships: object-to-region (O2R), object-to-object (O2O), and corner-to-corner (C2C). By representing these relationships as geometric triplets and employing approaches based on Delaunay Triangulation to establish spatial priors, we derive IoU loss between denoised and ground truth triplets and integrate them seamlessly into the diffusion denoising process. The introduction of the joint formulation of inter-object distances, angular orientations, and spatial relationships enhances the physical realism of the generated scenes. Extensive experiments on unconditional layout synthesis, floorplan-conditioned layout generation, and scene rearrangement demonstrate that HierRelTriple improves spatial-relation metrics by over 15% and substantially reduces collisions and boundary violations compared to state-of-the-art methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 74 references that are in the map. First posted on arXiv 26 Mar 2025.

Builds on

43 of 74 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  7. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  8. 2018Demystifying MMD GANscited by 1,293
  9. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  10. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  11. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  12. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
31 more
  1. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  2. 2020SceneFormer: Indoor Scene Generation with Transformerscited by 158
  3. 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 141
  4. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  5. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  6. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  7. 2018Fast and Flexible Indoor Scene Synthesis via Deep Convolutional Generative Modelscited by 106
  8. 2024I-Design: Personalized LLM Interior Designercited by 87
  9. 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
  10. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
  11. 2023LEGO-Net: Learning Regular Rearrangements of Objects in Roomscited by 76
  12. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 67
  13. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  14. 2023CC3D: Layout-Conditioned Generation of Compositional 3D Scenescited by 58
  15. 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
  16. 2020End-to-End Optimization of Scene Layoutcited by 52
  17. 2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48
  18. 2020Generative Layout Modeling using Constraint Graphscited by 46
  19. 2023SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation with Fine-Grained Geometrycited by 39
  20. 2024LLplace: The 3D Indoor Scene Layout Generation and Editing via Large Language Modelcited by 34
  21. 2022Simple and Effective Synthesis of Indoor 3D Scenescited by 33
  22. 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
  23. 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
  24. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 21
  25. 2022LayoutEnhancer: Generating Good Indoor Layouts from Imperfect Datacited by 20
  26. 2024DeBaRA: Denoising-Based 3D Room Arrangement Generationcited by 20
  27. 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 19
  28. 2024SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangementscited by 17
  29. 2018Fast and Scalable Position-Based Layout Synthesiscited by 16
  30. 2024Forest2Seq: Revitalizing Order Prior for Sequential Indoor Scene Synthesiscited by 12
  31. 2024Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Modelscited by 5

Built on by

Not cited yet.