PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
Not on the map. Why?
Abstract (arXiv)
Generating physically consistent 3D tabletop scenes is a fundamental yet underexplored problem for interactive and generalist robotic learning. The challenge stems from dense object hierarchies and irregular affordances. Here, an interactive scene denotes a physically valid, collision-free environment directly loadable into physics simulators. Existing methods, ranging from decoupled symbolic solvers to end-to-end regression models, often suffer from error propagation or overfitting to noisy supervision containing widespread physical violations. To address these limitations, we introduce PhyScene3D, a framework that reformulates generation as a Human-Mimetic Constructive Process. The proposed Cognitive Topological Reasoning Chain (CTRC) factorizes scene synthesis into a sequential, anchor-conditioned process. It employs a 3D AABB-based placement scheme that imposes a strong structural inductive bias. To address imperfect supervision and physical infeasibility, we introduce Physics-Aware Denoising Alignment (PADA). It integrates a differentiable Signed Distance Field (SDF) with Test-Time Optimization (TTO) to project generated scenes onto a physics-feasible manifold while preserving semantic intent. Experiments demonstrate that PhyScene3D outperforms state-of-the-art approaches in both semantic accuracy and physical validity, achieving a 40% reduction in scene-wise collision rate relative to the human-annotated training data.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
21 of 26 references.
References · 21
- 2024GPT-4o System Cardcited by 4,588
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2022Visual Language Maps for Robot Navigationcited by 365
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
9 more
- 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
- 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
- 2025MetaScenes: Towards Automated Replica Creation for Real-world 3D Scanscited by 31
- 2025Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answeringcited by 30
- 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 16
- 2024ClutterGen: A Cluttered Scene Generator for Robot Learningcited by 8
- 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
- 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
- 2026PhysGraph: A Physics-aware 3D Scene Graph for Perception and Reasoning
- 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement