mlsanityData to 7 Oct 2026

Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer

arXiv 2512.00677 ↗First posted 30 Nov 2025cs.CV cs.AIcited by 2

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent progress in 4D representations, such as Dynamic NeRF and 4D Gaussian Splatting (4DGS), has enabled dynamic 4D scene reconstruction. However, text-driven 4D scene editing remains under-explored due to the challenge of ensuring both multi-view and temporal consistency across space and time during editing. Existing studies rely on 2D diffusion models that edit frames independently, often causing motion distortion, geometric drift, and incomplete editing. We introduce Dynamic-eDiTor, a training-free text-driven 4D editing framework leveraging Multimodal Diffusion Transformer (MM-DiT) and 4DGS. This mechanism consists of Spatio-Temporal Sub-Grid Attention (STGA) for locally consistent cross-view and temporal fusion, and Context Token Propagation (CTP) for global propagation via token inheritance and optical-flow-guided token replacement. Together, these components allow Dynamic-eDiTor to perform seamless, globally consistent multi-view video without additional training and directly optimize pre-trained source 4DGS. Extensive experiments on multi-view video dataset DyNeRF demonstrate that our method achieves superior editing fidelity and both multi-view and temporal consistency prior approaches. Project page for results and code: https://di-lee.github.io/dynamic-eDiTor/

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 47 of its 63 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

47 of 63 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization20 Aug
  2. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
  3. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion13 Jun
  4. 2023Free-Editor: Zero-shot Text-driven 3D Scene Editing21 Dec
  5. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov
  6. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 41

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
29 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  8. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  9. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  10. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  11. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
  12. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  13. 2018Learning Blind Video Temporal Consistencycited by 247
  14. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  15. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
  16. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 111
  17. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
  18. 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
  19. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
  20. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  21. 2025Avat3r: Large Animatable Gaussian Reconstruction Model for High-fidelity 3D Head Avatarscited by 52
  22. 2023Control4D: Efficient 4D Portrait Editing with Textcited by 32
  23. 2025Personalize Anything for Free with Diffusion Transformercited by 22
  24. 2025FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editingcited by 21
  25. 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
  26. 2025CoreEditor: Correspondence-constrained Diffusion for Consistent 3D Editingcited by 5
  27. 2025DiTVR: Zero-Shot Diffusion Transformer for Video Restorationcited by 4
  28. 2025TV-LiVE: Training-Free, Text-Guided Video Editing via Layer Informed Vitality Exploitationcited by 3
  29. 2025Occlusion-Aware Temporally Consistent Amodal Completion for 3D Human-Object Interaction Reconstructioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mono4DEditor: Text-Driven 4D Scene Editing from Monocular Video via Point-Level Localization of Language-Embedded Gaussians
  2. 2026Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagation
  3. 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency
  4. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
  5. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models
  6. 2024Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
  7. 20264DGS-Fixer: Generative Sparse-View 4D Gaussian Splatting with Iterative Refinement Guided by Video Diffusion Priors
  8. 20254DGS-Craft: Consistent and Interactive 4D Gaussian Splatting Editing