mlsanityData to 14 Oct 2026

MorphoSim: An Interactive, Controllable, and Editable Language-guided 4D World Simulator

arXiv 2510.04390 ↗First posted 5 Oct 2025cs.CV cs.AI cs.CLcited by 1

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World models that support controllable and editable spatiotemporal environments are valuable for robotics, enabling scalable training data, repro ducible evaluation, and flexible task design. While recent text-to-video models generate realistic dynam ics, they are constrained to 2D views and offer limited interaction. We introduce MorphoSim, a language guided framework that generates 4D scenes with multi-view consistency and object-level controls. From natural language instructions, MorphoSim produces dynamic environments where objects can be directed, recolored, or removed, and scenes can be observed from arbitrary viewpoints. The framework integrates trajectory-guided generation with feature field dis tillation, allowing edits to be applied interactively without full re-generation. Experiments show that Mor phoSim maintains high scene fidelity while enabling controllability and editability. The code is available at https://github.com/eric-ai-lab/Morph4D.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 72 of its 77 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

72 of 77 references.

References · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  10. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  12. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
38 more
  1. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  2. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  4. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  5. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  6. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  7. 2023CoTracker: It is Better to Track Togethercited by 522
  8. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  9. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  10. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  11. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  12. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  13. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  14. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  15. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  16. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  17. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  18. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
  19. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
  20. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
  21. 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 212
  22. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  23. 2023Text-To-4D Dynamic Scene Generationcited by 205
  24. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  25. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  26. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  27. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  28. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  29. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  30. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  31. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  32. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  33. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  34. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  35. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 101
  36. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
  37. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
  38. 2024Pandora: Towards General World Model with Natural Language Actions and Video Statescited by 86

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation
  2. 20264DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation
  3. 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
  4. 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation
  5. 2026D-World: An Explicit World-Language-Action Model with Recursive Self-Improvement under Dual Control
  6. 2026SceneFoundry: Generating Interactive Infinite 3D Worlds
  7. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination
  8. 2025Dreamland: Controllable World Creation with Simulator and Generative Models