PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World
Not on the map. Why?
Abstract (arXiv)
Synthesizing physics-grounded 3D assets is a critical bottleneck for interactive virtual worlds and embodied AI. Existing methods predominantly focus on static geometry, overlooking the functional properties essential for interaction. We propose that interactive asset generation must be rooted in functional logic and hierarchical physics. To bridge this gap, we introduce PhysForge, a decoupled two-stage framework supported by PhysDB, a large-scale dataset of 150,000 assets with four-tier physical annotations. First, a VLM acts as a "physical architect" to plan a "Hierarchical Physical Blueprint" defining material, functional, and kinematic constraints. Second, a physics-grounded diffusion model realizes this blueprint by synthesizing high-fidelity geometry alongside precise kinematic parameters via a novel KineVoxel Injection (KVI) mechanism. Experiments demonstrate that PhysForge produces functionally plausible, simulation-ready assets, providing a robust data engine for interactive 3D content and embodied agents.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 65 of its 70 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
65 of 70 references.
References · 65
- 2023Segment Anythingcited by 8,234
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
38 more
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 118
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 95
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 82
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 69
- 2024Real2Code: Reconstruct Articulated Objects via Code Generationcited by 69
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 55
- 2023CAGE: Controllable Articulation GEnerationcited by 52
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 48
- 2024REACTO: Reconstructing Articulated Objects from a Single Videocited by 45
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformerscited by 41
- 2025EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligencecited by 36
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 6
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 3
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 2
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generationcited by 1
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 1
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 1
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulationcited by 0
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulation6 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulation19 Sep 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image
- 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey
- 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation