mlsanityData to 14 Oct 2026

Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagation

arXiv 2603.12766 ↗First posted 13 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in 3D scene editing using NeRF and 3DGS enable high-quality static scene editing. In contrast, dynamic scene editing remains challenging, as methods that directly extend 2D diffusion models to 4D often produce motion artifacts, temporal flickering, and inconsistent style propagation. We introduce Catalyst4D, a framework that transfers high-quality 3D edits to dynamic 4D Gaussian scenes while maintaining spatial and temporal coherence. At its core, Anchor-based Motion Guidance (AMG) builds a set of structurally stable and spatially representative anchors from both original and edited Gaussians. These anchors serve as robust region-level references, and their correspondences are established via optimal transport to enable consistent deformation propagation without cross-region interference or motion drift. Complementarily, Color Uncertainty-guided Appearance Refinement (CUAR) preserves temporal appearance consistency by estimating per-Gaussian color uncertainty and selectively refining regions prone to occlusion-induced artifacts. Extensive experiments demonstrate that Catalyst4D achieves temporally stable, high-fidelity dynamic scene editing and outperforms existing methods in both visual quality and motion coherence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 61 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

51 of 61 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  10. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  11. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  12. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
38 more
  1. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  2. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  3. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  4. 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
  5. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  6. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
  7. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  8. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  9. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
  10. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  11. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
  12. 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
  13. 2025Swift4D:Adaptive divide-and-conquer Gaussian Splatting for compact and efficient reconstruction of dynamic scenecited by 42
  14. 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
  15. 2023Control4D: Efficient 4D Portrait Editing with Textcited by 32
  16. 2024Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splattingcited by 30
  17. 2025MoDec-GS: Global-to-Local Motion Decomposition and Temporal Interval Adjustment for Compact Dynamic 3D Gaussian Splattingcited by 30
  18. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
  19. 2024DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Renderingcited by 28
  20. 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
  21. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
  22. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
  23. 2024SGSST: Scaling Gaussian Splatting StyleTransfercited by 20
  24. 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
  25. 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
  26. 2024DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservationcited by 14
  27. 2026TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstructioncited by 14
  28. 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusioncited by 11
  29. 2025Micro-macro Wavelet-based Gaussian Splatting for 3D Reconstruction from Unconstrained Imagescited by 10
  30. 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Modelcited by 10
  31. 2021A Robust Loss for Point Cloud Registrationcited by 8
  32. 2025Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylizationcited by 8
  33. 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splattingcited by 8
  34. 2025DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Renderingcited by 8
  35. 2025Time of the Flight of the Gaussians: Optimizing Depth Indirectly in Dynamic Radiance Fieldscited by 2
  36. 2025Micro-macro Gaussian Splatting with Enhanced Scalability for Unconstrained Scene Reconstructioncited by 2
  37. 20254DGS-Craft: Consistent and Interactive 4D Gaussian Splatting Editingcited by 2
  38. 2026Tune-Your-Style: Intensity-tunable 3D Style Transfer with Gaussian Splattingcited by 2

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer
  2. 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency
  3. 20234D-Editor: Interactive Object-level Editing in Dynamic Neural Radiance Fields via Semantic Distillation
  4. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
  5. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking
  6. 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing
  7. 2024SealD-NeRF: Interactive Pixel-Level Editing for Dynamic Scenes by Neural Radiance Fields
  8. 2026PD-4DGS:Progressive Decomposition of 4D Gaussian Splatting for Bandwidth-Adaptive Dynamic Scene Streaming