PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects
Not on the map. Why?
Abstract (arXiv)
Simulation-ready physical 3D assets have emerged as a promising direction owing to their broad applicability in downstream tasks. However, most existing 3D generation methods either neglect physical properties or are limited to a single asset category, e.g., rigid, deformable, or articulated objects. To address these limitations, we introduce PhysX-Omni, a unified framework for simulation-ready physical 3D generation across diverse asset types. Specifically, we develop a novel and efficient geometry representation tailored for Vision-Language Models, which directly encodes high-resolution 3D structures without compression, significantly improving generation performance. In addition, we construct the first general simulation-ready 3D dataset, PhysXVerse, covering diverse indoor and outdoor categories. Furthermore, to comprehensively and flexibly evaluate both generative and understanding capabilities in the wild, we propose PhysX-Bench, which encompasses six key attributes: geometry, absolute scale, material, affordance, kinematics, and function description. Extensive experiments with conventional metrics and PhysX-Bench show that PhysX-Omni performs strongly in both generation and understanding. Moreover, additional studies further validate the potential of PhysX-Omni for applications in simulation-ready scene generation and robotic policy learning. We believe PhysX-Omni can significantly advance a wide range of downstream applications, particularly in embodied AI and physics-based simulation.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 48 of its 51 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
48 of 51 references.
References · 48
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024Depth Anything V2cited by 1,422
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
36 more
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 91
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 60
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 43
- 2025MagicArticulate: Make Your 3D Models Articulation-Readycited by 43
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 39
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
- 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 22
- 2025FreeArt3D: Training-Free Articulated Object Generation using 3D Diffusioncited by 22
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 21
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
- 2025Procedural Generation of Articulated Simulation-Ready Assetscited by 11
- 2025ArtiLatent: Realistic Articulated 3D Object Generation via Structured Latentscited by 11
- 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9
- 2026AnchoredDream: Zero-Shot 360deg Indoor Scene Generation from a Single View via Geometric Groundingcited by 5
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2025Collaborative Multi-Modal Coding for High-Quality 3D Generationcited by 3
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agentscited by 8
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
- 2026A Definition and Roadmap for World Modelscited by 5
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 1
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 1
- 2026WorldAgent: Verification-Guided Agentic Physical World Constructioncited by 0
- 2026AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Imagescited by 0
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulationcited by 0
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmarkcited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inferencecited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulation6 Oct 2026
- 2026AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Images5 Oct 2026
- 2026WorldAgent: Verification-Guided Agentic Physical World Construction27 Sep 2026
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulation19 Sep 2026
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents21 Jul 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026A Definition and Roadmap for World Models7 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026PhyMix: Towards Physically Consistent Single-Image 3D Indoor Scene Generation with Implicit--Explicit Optimization
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generation
- 2025PhysID: Physics-based Interactive Dynamics from a Single-view Image
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation