mlsanityData to 14 Oct 2026

PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects

arXiv 2605.21572 ↗First posted 20 May 2026cs.CV cs.ROcited by 11

Not on the map. Why?

Abstract (arXiv)

Simulation-ready physical 3D assets have emerged as a promising direction owing to their broad applicability in downstream tasks. However, most existing 3D generation methods either neglect physical properties or are limited to a single asset category, e.g., rigid, deformable, or articulated objects. To address these limitations, we introduce PhysX-Omni, a unified framework for simulation-ready physical 3D generation across diverse asset types. Specifically, we develop a novel and efficient geometry representation tailored for Vision-Language Models, which directly encodes high-resolution 3D structures without compression, significantly improving generation performance. In addition, we construct the first general simulation-ready 3D dataset, PhysXVerse, covering diverse indoor and outdoor categories. Furthermore, to comprehensively and flexibly evaluate both generative and understanding capabilities in the wild, we propose PhysX-Bench, which encompasses six key attributes: geometry, absolute scale, material, affordance, kinematics, and function description. Extensive experiments with conventional metrics and PhysX-Bench show that PhysX-Omni performs strongly in both generation and understanding. Moreover, additional studies further validate the potential of PhysX-Omni for applications in simulation-ready scene generation and robotic policy learning. We believe PhysX-Omni can significantly advance a wide range of downstream applications, particularly in embodied AI and physics-based simulation.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 48 of its 51 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

48 of 51 references.

References · 48

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  4. 2024Depth Anything V2cited by 1,422
  5. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  7. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  8. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  9. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  10. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
  11. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  12. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
36 more
  1. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  2. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
  3. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
  4. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
  5. 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
  6. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 91
  7. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  8. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  9. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
  10. 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
  11. 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
  12. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
  13. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 60
  14. 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
  15. 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
  16. 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
  17. 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
  18. 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 39
  19. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
  20. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
  21. 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
  22. 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
  23. 2023NAP: Neural 3D Articulation Priorcited by 25
  24. 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
  25. 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
  26. 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 22
  27. 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
  28. 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 21
  29. 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
  30. 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
  31. 2025Procedural Generation of Articulated Simulation-Ready Assetscited by 11
  32. 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
  33. 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9
  34. 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Groundingcited by 5
  35. 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
  36. 2025Collaborative Multi-Modal Coding for High-Quality 3D Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization
  2. 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generation
  3. 2025PhysID: Physics-based Interactive Dynamics from a Single-view Image
  4. 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
  5. 20263D Generation for Embodied AI and Robotic Simulation: A Survey
  6. 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World
  7. 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
  8. 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation