PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image
Not on the map. Why?
Abstract (arXiv)
3D modeling is shifting from static visual representations toward physical, articulated assets that can be directly used in simulation and interaction. However, most existing 3D generation methods overlook key physical and articulation properties, thereby limiting their utility in embodied AI. To bridge this gap, we introduce PhysX-Anything, the first simulation-ready physical 3D generative framework that, given a single in-the-wild image, produces high-quality sim-ready 3D assets with explicit geometry, articulation, and physical attributes. Specifically, we propose the first VLM-based physical 3D generative model, along with a new 3D representation that efficiently tokenizes geometry. It reduces the number of tokens by 193x, enabling explicit geometry learning within standard VLM token budgets without introducing any special tokens during fine-tuning and significantly improving generative quality. In addition, to overcome the limited diversity of existing physical 3D datasets, we construct a new dataset, PhysX-Mobility, which expands the object categories in prior physical 3D datasets by over 2x and includes more than 2K common real-world objects with rich physical annotations. Extensive experiments on PhysX-Mobility and in-the-wild images demonstrate that PhysX-Anything delivers strong generative performance and robust generalization. Furthermore, simulation-based experiments in a MuJoCo-style environment validate that our sim-ready assets can be directly used for contact-rich robotic policy learning. We believe PhysX-Anything can substantially empower a broad range of downstream applications, especially in embodied AI and physics-based simulation.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). Builds on 32 of its 34 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
32 of 34 references.
References · 32
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
20 more
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 96
- 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 91
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 74
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 61
- 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
- 2025PhysX-3D: Physical-Grounded 3D Asset Generationcited by 42
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2025BANG: Dividing 3D Assets via Generative Exploded Dynamicscited by 35
- 2023NAP: Neural 3D Articulation Priorcited by 25
- 2025DreamArt: Generating Interactable Articulated Objects from a Single Imagecited by 25
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 21
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
- 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9
- 2025Collaborative Multi-Modal Coding for High-Quality 3D Generationcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 36.
37 papers.
Sort:
By area:
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 30
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generationcited by 8
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 6
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 5
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 4
25 more
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 1
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decompositioncited by 1
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulationcited by 1
- 2025XDen-1K: A Density Field Dataset of Real-World Objectscited by 0
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenescited by 0
- 2026RealSkin: Spatio-Spectral Partial Neural Adjoint Maps for Image-to-3D Attribute Transfercited by 0
- 2026Quo Vadis, World Modeling?cited by 0
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modelingcited by 0
- 2026SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenescited by 0
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoningcited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
- 2026FACT: Fidelity-Aware Construction of Articulated Twinscited by 0
- 2026AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Imagescited by 0
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulationcited by 0
- 2026PhysForge: Material-Controllable 3D Reconstruction with Separable Componentscited by 0
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmarkcited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inferencecited by 0
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026PhysForge: Material-Controllable 3D Reconstruction with Separable Components9 Oct 2026
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulation6 Oct 2026
- 2026AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Images5 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes17 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
25 more
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026RealSkin: Spatio-Spectral Partial Neural Adjoint Maps for Image-to-3D Attribute Transfer14 Jul 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
- 2026Functionalization via Structure Completion and Motion Rectification18 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation13 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLM24 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2025XDen-1K: A Density Field Dataset of Real-World Objects11 Dec 2025
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligence17 Jul 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 6
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstructioncited by 5
- 2026SIMART: Decomposing Monolithic Meshes into Sim-ready Articulated Assets via MLLMcited by 5
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assetscited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
12 most cited of 26 All 26 (JSON)
- 2026ViewStruct: View-Grounded Articulation and Connectivity Inference12 Oct 2026
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026PhysForge: Material-Controllable 3D Reconstruction with Separable Components9 Oct 2026
- 2026AffordCraft: Scalable Construction of Task-Ready Simulation Assets from Single Images5 Oct 2026
- 2026FACT: Fidelity-Aware Construction of Articulated Twins29 Sep 2026
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 2026SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes17 Sep 2026
- 2026NeoWorld-Pro: Programming Interactive Scenes from Monocular Images for Embodied Simulation25 Aug 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World
- 2025PhysID: Physics-based Interactive Dynamics from a Single-view Image
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation
- 2026ArtLLM: Generating Articulated Assets via 3D LLM
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation