PhysX-3D: Physical-Grounded 3D Asset Generation
Not on the map. Why?
Abstract (arXiv)
3D modeling is moving from virtual to physical. Existing 3D generation primarily emphasizes geometries and textures while neglecting physical-grounded modeling. Consequently, despite the rapid development of 3D generative models, the synthesized 3D assets often overlook rich and important physical properties, hampering their real-world application in physical domains like simulation and embodied AI. As an initial attempt to address this challenge, we propose PhysX-3D, an end-to-end paradigm for physical-grounded 3D asset generation. 1) To bridge the critical gap in physics-annotated 3D datasets, we present PhysXNet - the first physics-grounded 3D dataset systematically annotated across five foundational dimensions: absolute scale, material, affordance, kinematics, and function description. In particular, we devise a scalable human-in-the-loop annotation pipeline based on vision-language models, which enables efficient creation of physics-first assets from raw 3D assets.2) Furthermore, we propose PhysXGen, a feed-forward framework for physics-grounded image-to-3D asset generation, injecting physical knowledge into the pre-trained 3D structural space. Specifically, PhysXGen employs a dual-branch architecture to explicitly model the latent correlations between 3D structures and physical properties, thereby producing 3D assets with plausible physical predictions while preserving the native geometry quality. Extensive experiments validate the superior performance and promising generalization capability of our framework. All the code, data, and models will be released to facilitate future research in generative physical AI.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
31 of 38 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
19 more
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
- 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 40
- 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
- 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
- 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
- 2020Visual Identification of Articulated Object Partscited by 36
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9
Built on by
Citing papers per year: 2025: 8; 2026: 32.
40 papers.
Sort:
By area:
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 7
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
- 2026ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100Kcited by 5
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 5
28 more
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 3
- 2025Perceptual Taxonomy: Evaluating and Guiding Hierarchical Scene Reasoning in Vision-Language Modelscited by 2
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimationcited by 1
- 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matchingcited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2025XDen-1K: A Density Field Dataset of Real-World Objectscited by 0
- 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Modelscited by 0
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
- 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 0
- 2026SiPhy: Single-Image Physical Property Reasoningcited by 0
- 2026Vision Meets WiFi: Physics-Grounded Estimation of Volumetric Mechanical Propertiescited by 0
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 0
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decompositioncited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2026Vision Meets WiFi: Physics-Grounded Estimation of Volumetric Mechanical Properties7 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026SiPhy: Single-Image Physical Property Reasoning24 Jul 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
28 more
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching3 Jun 2026
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation25 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
- 2026Functionalization via Structure Completion and Motion Rectification18 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations29 Apr 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templates13 Apr 2026
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite10 Apr 2026
- 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videos26 Mar 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Models17 Mar 2026
- 2026ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100K17 Mar 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2025XDen-1K: A Density Field Dataset of Real-World Objects11 Dec 2025
- 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulation26 Nov 2025
- 2025Perceptual Taxonomy: Evaluating and Guiding Hierarchical Scene Reasoning in Vision-Language Models24 Nov 2025
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image17 Nov 2025
- 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes17 Nov 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generation27 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025Perceptual Taxonomy: Evaluating and Guiding Hierarchical Scene Reasoning in Vision-Language Modelscited by 2
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2025Perceptual Taxonomy: Evaluating and Guiding Hierarchical Scene Reasoning in Vision-Language Models24 Nov 2025
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 7
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
- 2026ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100Kcited by 5
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
12 most cited of 30 All 30 (JSON)
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
- 2026Vision Meets WiFi: Physics-Grounded Estimation of Volumetric Mechanical Properties7 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026SiPhy: Single-Image Physical Property Reasoning24 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimation25 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
12 newest of 30 All 30 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
- 2025PhysID: Physics-based Interactive Dynamics from a Single-view Image
- 2024Precise-Physics Driven Text-to-3D Generation
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation
- 2025PhysGen: Physically Grounded 3D Shape Generation for Industrial Design
- 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion