mlsanityData to 7 Oct 2026

PhysX-3D: Physical-Grounded 3D Asset Generation

arXiv 2507.12465 ↗First posted 16 Jul 2025cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

3D modeling is moving from virtual to physical. Existing 3D generation primarily emphasizes geometries and textures while neglecting physical-grounded modeling. Consequently, despite the rapid development of 3D generative models, the synthesized 3D assets often overlook rich and important physical properties, hampering their real-world application in physical domains like simulation and embodied AI. As an initial attempt to address this challenge, we propose PhysX-3D, an end-to-end paradigm for physical-grounded 3D asset generation. 1) To bridge the critical gap in physics-annotated 3D datasets, we present PhysXNet - the first physics-grounded 3D dataset systematically annotated across five foundational dimensions: absolute scale, material, affordance, kinematics, and function description. In particular, we devise a scalable human-in-the-loop annotation pipeline based on vision-language models, which enables efficient creation of physics-first assets from raw 3D assets.2) Furthermore, we propose PhysXGen, a feed-forward framework for physics-grounded image-to-3D asset generation, injecting physical knowledge into the pre-trained 3D structural space. Specifically, PhysXGen employs a dual-branch architecture to explicitly model the latent correlations between 3D structures and physical properties, thereby producing 3D assets with plausible physical predictions while preserving the native geometry quality. Extensive experiments validate the superior performance and promising generalization capability of our framework. All the code, data, and models will be released to facilitate future research in generative physical AI.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 16 Jul 2025.

Builds on

31 of 38 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  5. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  7. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  8. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  9. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  10. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  11. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  12. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
19 more
  1. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  2. 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
  3. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  4. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  5. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
  6. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  7. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
  8. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
  9. 2024Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objectscited by 67
  10. 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
  11. 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 45
  12. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
  13. 2023Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perceptioncited by 40
  14. 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
  15. 2023OPDMulti: Openable Part Detection for Multiple Objectscited by 38
  16. 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
  17. 2020Visual Identification of Articulated Object Partscited by 36
  18. 2023NAP: Neural 3D Articulation Priorcited by 25
  19. 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 32.

40 papers.

Sort:

By area:

  1. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 32
  2. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
  3. 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
  4. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  5. 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
  6. 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
  7. 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 8
  8. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 7
  9. 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 5
  10. 2026ManiTwin: Scaling Data-Generation-Ready Digital Object Dataset to 100Kcited by 5
  11. 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
  12. 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 5
28 more
  1. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  2. 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
  3. 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 4
  4. 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
  5. 2025ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenescited by 3
  6. 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 3
  7. 2025Perceptual Taxonomy: Evaluating and Guiding Hierarchical Scene Reasoning in Vision-Language Modelscited by 2
  8. 2025UniArt: Unified 3D Representation for Generating 3D Articulated Objects with Open-Set Articulationcited by 2
  9. 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
  10. 2026PAWS: Perception of Articulation in the Wild at Scale from Egocentric Videoscited by 1
  11. 2026EgoFun3D: Modeling Interactive Objects from Egocentric Videos using Function Templatescited by 1
  12. 2026Perceive-then-Plan: Layout-as-Policy for Monocular 3D Scene Layout Estimationcited by 1
  13. 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matchingcited by 1
  14. 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
  15. 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
  16. 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
  17. 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
  18. 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
  19. 2025XDen-1K: A Density Field Dataset of Real-World Objectscited by 0
  20. 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Modelscited by 0
  21. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 0
  22. 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
  23. 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 0
  24. 2026SiPhy: Single-Image Physical Property Reasoningcited by 0
  25. 2026Vision Meets WiFi: Physics-Grounded Estimation of Volumetric Mechanical Propertiescited by 0
  26. 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 0
  27. 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decompositioncited by 0
  28. 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
  2. 2025PhysID: Physics-based Interactive Dynamics from a Single-view Image
  3. 2024Precise-Physics Driven Text-to-3D Generation
  4. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
  5. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation
  6. 2025PhysGen: Physically Grounded 3D Shape Generation for Industrial Design
  7. 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
  8. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion