mlsanityData to 14 Oct 2026

PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World

arXiv 2605.05163 ↗First posted 6 May 2026cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Synthesizing physics-grounded 3D assets is a critical bottleneck for interactive virtual worlds and embodied AI. Existing methods predominantly focus on static geometry, overlooking the functional properties essential for interaction. We propose that interactive asset generation must be rooted in functional logic and hierarchical physics. To bridge this gap, we introduce PhysForge, a decoupled two-stage framework supported by PhysDB, a large-scale dataset of 150,000 assets with four-tier physical annotations. First, a VLM acts as a "physical architect" to plan a "Hierarchical Physical Blueprint" defining material, functional, and kinematic constraints. Second, a physics-grounded diffusion model realizes this blueprint by synthesizing high-fidelity geometry alongside precise kinematic parameters via a novel KineVoxel Injection (KVI) mechanism. Experiments demonstrate that PhysForge produces functionally plausible, simulation-ready assets, providing a robust data engine for interactive 3D content and embodied agents.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 65 of its 70 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

65 of 70 references.

References · 65

  1. 2023Segment Anythingcited by 8,234
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  5. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  9. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
38 more
  1. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
  2. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  3. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  4. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  5. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  6. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  7. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  8. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  9. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  10. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  11. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  12. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  13. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  14. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
  15. 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
  16. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
  17. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
  18. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
  19. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  20. 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 82
  21. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  22. 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 69
  23. 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
  24. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
  25. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  26. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
  27. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
  28. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  29. 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 55
  30. 2023CAGE: Controllable Articulation GEnerationcited by 52
  31. 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 48
  32. 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
  33. 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
  34. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
  35. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
  36. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
  37. 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 36
  38. 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition
  2. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation
  3. 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark
  4. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image
  5. 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement
  6. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
  7. 20263D Generation for Embodied AI and Robotic Simulation: A Survey
  8. 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation