mlsanityData to 14 Oct 2026

PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization

arXiv 2604.10125 ↗First posted 11 Apr 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Existing methods for single-image 3D indoor scene generation often produce visually plausible results that violate real-world physical constraints, limiting their reliability in robotics, embodied AI, and virtual environment design. To bridge this gap, we introduce a Physics Evaluator that assesses four aspects (geometric priors, contact, stability, and deployability) through nine sub-constraints, establishing a benchmark for evaluating physical consistency. Our analysis reveals that even state-of-the-art methods produce scenes with substantial physical inconsistencies despite their visual plausibility. To address these limitations, we propose a framework that incorporates feedback from the Physics Evaluator into both training and inference to improve the physical plausibility of generated scenes. Specifically, PhyMix comprises two components: (i) implicit alignment via Scene-GRPO, a critic-free group-relative preference optimization strategy that uses physical evaluations to guide the generator toward physically plausible layouts, and (ii) explicit refinement via verifier-guided agentic repair, which translates evaluator diagnostics into executable scene-editing skills to correct residual violations at inference time. PhyMix unifies physical evaluation, preference-based alignment, and agentic inference-time correction to improve physical plausibility while retaining the observed scene content. Experiments show improvements in reconstruction quality and physical plausibility, while qualitative examples on stylized and real-world images illustrate the applicability of the framework beyond synthetic inputs.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 46 references that are in the map. First posted on arXiv 11 Apr 2026.

Builds on

40 of 46 references.

References · 40

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  7. 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 782
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  9. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
  10. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  11. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  12. 2024Flow Matching Guide and Codecited by 301
28 more
  1. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  2. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  3. 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 200
  4. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
  5. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  6. 2024InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Priorcited by 117
  7. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  8. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  9. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 99
  10. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  11. 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 65
  12. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  13. 2025SceneGen: Single-Image 3D Scene Generation in One Feedforward Passcited by 54
  14. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
  15. 2024REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignmentcited by 45
  16. 2018FilterReg: Robust and Efficient Probabilistic Point-Set Registration using Gaussian Filter and Twist Parameterizationcited by 43
  17. 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
  18. 2025SceneEval: Evaluating Semantic Coherence in Text-Conditioned 3D Indoor Scene Synthesiscited by 26
  19. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
  20. 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
  21. 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
  22. 2025A Survey of Robotic Navigation and Manipulation with Physics Simulators in the Era of Embodied AIcited by 16
  23. 2025LAYOUTDREAMER: Physics-guided Layout for Text-to-3D Compositional Scene Generationcited by 11
  24. 2025CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layoutscited by 10
  25. 2025RoomCraft: Controllable and Complete 3D Indoor Scene Generationcited by 9
  26. 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
  27. 2025I-Scene: 3D Instance Models are Implicit Generalizable Spatial Learnerscited by 6
  28. 2024DiffGen: Robot Demonstration Generation via Differentiable Physics Simulation, Differentiable Rendering, and Vision-Language Modelcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
  2. 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets
  3. 2026SceneSmith: Agentic Generation of Simulation-Ready Indoor Scenes
  4. 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
  5. 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects
  6. 2026FuncRoom-Agent: Sequential Feed-Forward 3D Functional Indoor Scene Generation
  7. 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM
  8. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects