PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization
Not on the map. Why?
Abstract (arXiv)
Existing methods for single-image 3D indoor scene generation often produce visually plausible results that violate real-world physical constraints, limiting their reliability in robotics, embodied AI, and virtual environment design. To bridge this gap, we introduce a Physics Evaluator that assesses four aspects (geometric priors, contact, stability, and deployability) through nine sub-constraints, establishing a benchmark for evaluating physical consistency. Our analysis reveals that even state-of-the-art methods produce scenes with substantial physical inconsistencies despite their visual plausibility. To address these limitations, we propose a framework that incorporates feedback from the Physics Evaluator into both training and inference to improve the physical plausibility of generated scenes. Specifically, PhyMix comprises two components: (i) implicit alignment via Scene-GRPO, a critic-free group-relative preference optimization strategy that uses physical evaluations to guide the generator toward physically plausible layouts, and (ii) explicit refinement via verifier-guided agentic repair, which translates evaluator diagnostics into executable scene-editing skills to correct residual violations at inference time. PhyMix unifies physical evaluation, preference-based alignment, and agentic inference-time correction to improve physical plausibility while retaining the observed scene content. Experiments show improvements in reconstruction quality and physical plausibility, while qualitative examples on stylized and real-world images illustrate the applicability of the framework beyond synthetic inputs.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 46 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
40 of 46 references.
References · 40
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2024Flow Matching Guide and Codecited by 301
28 more
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 65
- 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
- 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
- 2018FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterizationcited by 43
- 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
- 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
- 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
- 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
- 2025A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AIcited by 16
- 2025LAYOUTDREAMER: Physics-guided Layout for Text-to-3D Compositional Scene Generationcited by 11
- 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
- 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
- 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
- 2025I-Scene: 3D Instance Models are Implicit Generalizable Spatial Learnerscited by 6
- 2024DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Modelcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets
- 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
- 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects