EmbodiedGen: Towards a Generative 3D World Engine for Embodied Intelligence
Not on the map. Why?
Abstract (arXiv)
Constructing a physically realistic and accurately scaled simulated 3D world is crucial for the training and evaluation of embodied intelligence tasks. The diversity, realism, low cost accessibility and affordability of 3D data assets are critical for achieving generalization and scalability in embodied AI. However, most current embodied intelligence tasks still rely heavily on traditional 3D computer graphics assets manually created and annotated, which suffer from high production costs and limited realism. These limitations significantly hinder the scalability of data driven approaches. We present EmbodiedGen, a foundational platform for interactive 3D world generation. It enables the scalable generation of high-quality, controllable and photorealistic 3D assets with accurate physical properties and real-world scale in the Unified Robotics Description Format (URDF) at low cost. These assets can be directly imported into various physics simulation engines for fine-grained physical control, supporting downstream tasks in training and evaluation. EmbodiedGen is an easy-to-use, full-featured toolkit composed of six key modules: Image-to-3D, Text-to-3D, Texture Generation, Articulated Object Generation, Scene Generation and Layout Generation. EmbodiedGen generates diverse and interactive 3D worlds composed of generative 3D assets, leveraging generative AI to address the challenges of generalization and evaluation to the needs of embodied intelligence related research. Code is available at https://horizonrobotics.github.io/robot_lab/embodied_gen/index.html.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). Builds on 40 of its 52 references that are in the map. First posted on arXiv 12 Jun 2025.
Builds on
40 of 52 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2023Qwen Technical Reportcited by 3,344
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
28 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 684
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 111
- 2024Automated Creation of Digital Cousins for Robust Policy Learningcited by 91
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 82
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 69
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 64
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
- 2023Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Modelscited by 49
- 2021Act the Part: Learning Interaction Strategies for Articulated Object Part Discoverycited by 45
- 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
- 2023Understanding 3D Object Interaction from a Single Imagecited by 33
- 2025DIPO: Dual-State Images Controlled Articulated Object Generation Powered by Diverse Datacited by 21
- 2024Pano2Room: Novel View Synthesis from a Single Indoor Panoramacited by 16
- 2025MatchMaker: Automated Asset Generation for Robotic Assemblycited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 31.
36 papers.
Sort:
By area:
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 62
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Modelcited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 40
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 26
- 2026SimRecon: SimReady Compositional Scene Reconstruction from Real Videoscited by 12
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 9
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligencecited by 6
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 6
- 2025ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editingcited by 5
24 more
- 2025MUGSQA: Novel Multi-Uncertainty-Based Gaussian Splatting Quality Assessment Method, Dataset, and Benchmarkscited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillationcited by 3
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Modelscited by 3
- 2026Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worldscited by 2
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoningcited by 2
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesiscited by 2
- 2026RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Rankingcited by 2
- 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusioncited by 2
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Constructioncited by 2
- 2026InstructMove: A Text-Indispensable Benchmark for Instruction-Following Manipulationcited by 2
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modelingcited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assetscited by 1
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Videocited by 0
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenescited by 0
- 2026RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulationcited by 0
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animalscited by 0
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflectionscited by 0
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulationcited by 0
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?cited by 0
- 2026From Failures to Learnable Worlds: Policy-Conditioned Environment Generation for Navigation Agentscited by 0
- 2026From Failures to Learnable Worlds: Policy-Conditioned Environment Generation for Navigation Agents14 Oct 2026
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?6 Oct 2026
- 2026EmbodiedSmith: Scaling Embodied Data through Recursive Self-Improvement Flywheel in Simulation6 Oct 2026
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections5 Oct 2026
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation8 Sep 2026
- 2026InstructMove: A Text-Indispensable Benchmark for Instruction-Following Manipulation24 Aug 2026
- 2026PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets8 Aug 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory22 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
24 more
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction14 May 2026
- 2026GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion13 May 2026
- 2026RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Ranking11 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modeling3 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026SceneCritic: A Symbolic Evaluator for 3D Indoor Scene Synthesis14 Apr 2026
- 2026Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models12 Apr 2026
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar 2026
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning25 Mar 2026
- 2026Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worlds19 Mar 2026
- 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence8 Mar 2026
- 2026SimRecon: SimReady Compositional Scene Reconstruction from Real Videos2 Mar 2026
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb 2026
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Video24 Jan 2026
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov 2025
- 2025MUGSQA: Novel Multi-Uncertainty-Based Gaussian Splatting Quality Assessment Method, Dataset, and Benchmarks10 Nov 2025
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct 2025
- 2025ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing28 Sep 2025
- 2025Few-step Flow for 3D Generation via Marginal-Data Transport Distillation4 Sep 2025
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AIcited by 62
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Modelcited by 44
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memorycited by 40
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Modelscited by 26
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Constructioncited by 2
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modelingcited by 1
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Videocited by 0
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026ChronoAgentic: A Code-based Multi-Agent World Simulator for Physically Grounded Simulation Construction14 May 2026
- 2026Embody4D: A Generalist Data Engine for Embodied 4D World Modeling3 May 2026
- 2026Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models26 Mar 2026
- 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb 2026
- 2026Mirage2Matter: A Physically Grounded Gaussian World Model from Video24 Jan 2026
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov 2025
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct 2025
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AIcited by 6
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memorycited by 1
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?cited by 0
- 2026From Failures to Learnable Worlds: Policy-Conditioned Environment Generation for Navigation Agentscited by 0
- 2026From Failures to Learnable Worlds: Policy-Conditioned Environment Generation for Navigation Agents14 Oct 2026
- 2026WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?6 Oct 2026
- 2026EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI8 Jul 2026
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory22 Jun 2026
- 2026SimRecon: SimReady Compositional Scene Reconstruction from Real Videoscited by 12
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual Worldcited by 9
- 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligencecited by 6
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenescited by 6
- 2025ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editingcited by 5
- 2025MUGSQA: Novel Multi-Uncertainty-Based Gaussian Splatting Quality Assessment Method, Dataset, and Benchmarkscited by 4
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objectscited by 4
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenescited by 0
- 2026RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulationcited by 0
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animalscited by 0
12 most cited of 13 All 13 (JSON)
- 2026ChronoWorld: Camera-Controlled Consistent 4D World Generation via Spatiotemporal Cues and Geometric Reflections5 Oct 2026
- 2026ORMA: Optimization-based Monocular 4D Reconstruction of Articulated Animals29 Sep 2026
- 2026RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation8 Sep 2026
- 2026One Video, One World: Turning Monocular Video into Physical 4D Scenes30 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026HomeWorld: A Unified Floorplan-to-Furnished Framework for Generating Controllable, Densely Interactive Whole-Home Scenes4 Jun 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence8 Mar 2026
- 2026SimRecon: SimReady Compositional Scene Reconstruction from Real Videos2 Mar 2026
- 2025MUGSQA: Novel Multi-Uncertainty-Based Gaussian Splatting Quality Assessment Method, Dataset, and Benchmarks10 Nov 2025
12 newest of 13 All 13 (JSON)