MorphoSim: An Interactive, Controllable, and Editable Language-guided 4D World Simulator
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World models that support controllable and editable spatiotemporal environments are valuable for robotics, enabling scalable training data, repro ducible evaluation, and flexible task design. While recent text-to-video models generate realistic dynam ics, they are constrained to 2D views and offer limited interaction. We introduce MorphoSim, a language guided framework that generates 4D scenes with multi-view consistency and object-level controls. From natural language instructions, MorphoSim produces dynamic environments where objects can be directed, recolored, or removed, and scenes can be observed from arbitrary viewpoints. The framework integrates trajectory-guided generation with feature field dis tillation, allowing edits to be applied interactively without full re-generation. Experiments show that Mor phoSim maintains high scene fidelity while enabling controllability and editability. The code is available at https://github.com/eric-ai-lab/Morph4D.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 72 of its 77 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
72 of 77 references.
References · 72
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
38 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2023Text-To-4D Dynamic Scene Generationcited by 205
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
- 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
- 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 86
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
- 20264DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation
- 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation
- 2026D-World: An Explicit World-Language-Action Model with Recursive Self-Improvement under Dual Control
- 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination
- 2025Dreamland: Controllable World Creation with Simulator and Generative Models