mlsanityData to 14 Oct 2026

PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation

arXiv 2606.01649 ↗First posted 1 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Generating physically consistent 3D tabletop scenes is a fundamental yet underexplored problem for interactive and generalist robotic learning. The challenge stems from dense object hierarchies and irregular affordances. Here, an interactive scene denotes a physically valid, collision-free environment directly loadable into physics simulators. Existing methods, ranging from decoupled symbolic solvers to end-to-end regression models, often suffer from error propagation or overfitting to noisy supervision containing widespread physical violations. To address these limitations, we introduce PhyScene3D, a framework that reformulates generation as a Human-Mimetic Constructive Process. The proposed Cognitive Topological Reasoning Chain (CTRC) factorizes scene synthesis into a sequential, anchor-conditioned process. It employs a 3D AABB-based placement scheme that imposes a strong structural inductive bias. To address imperfect supervision and physical infeasibility, we introduce Physics-Aware Denoising Alignment (PADA). It integrates a differentiable Signed Distance Field (SDF) with Test-Time Optimization (TTO) to project generated scenes onto a physics-feasible manifold while preserving semantic intent. Experiments demonstrate that PhyScene3D outperforms state-of-the-art approaches in both semantic accuracy and physical validity, achieving a 40% reduction in scene-wise collision rate relative to the human-annotated training data.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

21 of 26 references.

References · 21

  1. 2024GPT-4o System Cardcited by 4,588
  2. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  3. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  4. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  5. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  6. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  7. 2022Visual Language Maps for Robot Navigationcited by 365
  8. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  9. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  10. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
  11. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  12. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesiscited by 166
9 more
  1. 2024Reconciling Reality through Simulation: A Real-to-Sim-to-Real Approach for Robust Manipulationcited by 144
  2. 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
  3. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Modelscited by 96
  4. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
  5. 2025MetaScenes: Towards Automated Replica Creation for Real-world 3D Scanscited by 31
  6. 2025Beyond the Destination: A Novel Benchmark for Exploration-Aware Embodied Question Answeringcited by 30
  7. 2025MesaTask: Towards Task-Driven Tabletop Scene Generation via 3D Spatial Reasoningcited by 16
  8. 2024ClutterGen: A Cluttered Scene Generator for Robot Learningcited by 8
  9. 2025ScanEdit: Hierarchically-Guided Functional 3D Scan Editingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026STABLE: Simulation-Ready Tabletop Layout Generation via a Semantics-Physics Dual System
  2. 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization
  3. 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
  4. 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets
  5. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
  6. 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
  7. 2026PhysGraph: A Physics-aware 3D Scene Graph for Perception and Reasoning
  8. 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement