mlsanityData to 14 Oct 2026

PARSE: Part-Aware Relational Spatial Modeling

arXiv 2603.07704 ↗First posted 8 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Inter-object relations underpin spatial intelligence, yet existing representations -- linguistic prepositions or object-level scene graphs -- are too coarse to specify which regions actually support, contain, or contact one another, leading to ambiguous and physically inconsistent layouts. To address these ambiguities, a part-level formulation is needed; therefore, we introduce PARSE, a framework that explicitly models how object parts interact to determine feasible and spatially grounded scene configurations. PARSE centers on the Part-centric Assembly Graph (PAG), which encodes geometric relations between specific object parts, and a Part-Aware Spatial Configuration Solver that converts these relations into geometric constraints to assemble collision-free, physically valid scenes. Using PARSE, we build PARSE-10K, a dataset of 10,000 3D indoor scenes constructed from real-image layout priors and a curated part-annotated shape database, each with dense contact structures and a part-level contact graph. With this structured, spatially grounded supervision, fine-tuning Qwen3-VL on PARSE-10K yields stronger object-level layout reasoning and more accurate part-level relation understanding; furthermore, leveraging PAGs as structural priors in 3D generation models leads to scenes with substantially improved physical realism and structural complexity. Together, these results show that PARSE significantly advances geometry-grounded spatial reasoning and supports the generation of physically consistent 3D scenes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 61 of its 73 references that are in the map. First posted on arXiv 8 Mar 2026.

Builds on

61 of 73 references.

References · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  8. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  9. 2015VQA: Visual Question Answeringcited by 2,506
  10. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  12. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
38 more
  1. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  2. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  3. 2020A Generalization of Transformer Networks to Graphscited by 661
  4. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  5. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  7. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  8. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  9. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  10. 2018Image Generation from Scene Graphscited by 324
  11. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 281
  12. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  13. 2018Auto-Encoding Scene Graphs for Image Captioningcited by 255
  14. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  15. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  16. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
  17. 2024Hierarchical Open-Vocabulary 3D Scene Graphs for Language-Grounded Robot Navigationcited by 196
  18. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  19. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
  20. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
  21. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
  22. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
  23. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  24. 2016Graph-Structured Representations for Visual Question Answeringcited by 123
  25. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  26. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  27. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  28. 2018Explainable and Explicit Visual Reasoning over Scene Graphscited by 103
  29. 2019Scene Graph Generation with External Knowledge and Image Reconstructioncited by 102
  30. 2023GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphscited by 97
  31. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
  32. 2025RoboBrain 2.0 Technical Reportcited by 89
  33. 2019Unpaired Image Captioning via Scene Graph Alignmentscited by 82
  34. 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 82
  35. 20193-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agentscited by 74
  36. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 74
  37. 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 71
  38. 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Searchcited by 67

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thinking in Structures: Evaluating Spatial Intelligence in Constraint-Governed Spaces
  2. 2026IDEAL-Bench: Indoor Dataset and Evaluation suite for Analyzing 3D Layout reasoning
  3. 2026Pair2Scene: Learning Local Object Relations for Procedural Scene Generation
  4. 2026CasLayout: Cascaded 3D Layout Diffusion for Indoor Scene Synthesis with Implicit Relation Modeling
  5. 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis
  6. 2026R3L: Reasoning 3D Layouts from Relative Spatial Relations
  7. 2026Orchestrating Spatial Semantics via a Zone-Graph Paradigm for Intricate Indoor Scene Generation
  8. 2025SURPRISE3D: A Dataset for Spatial Understanding and Reasoning in Complex 3D Scenes