mlsanityData to 14 Oct 2026

4D-Editor: Interactive Object-level Editing in Dynamic Neural Radiance Fields via Semantic Distillation

arXiv 2310.16858 ↗First posted 25 Oct 2023cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper targets interactive object-level editing (e.g., deletion, recoloring, transformation, composition) in dynamic scenes. Recently, some methods aiming for flexible editing static scenes represented by neural radiance field (NeRF) have shown impressive synthesis quality, while similar capabilities in time-variant dynamic scenes remain limited. To solve this problem, we propose 4D-Editor, an interactive semantic-driven editing framework, allowing editing multiple objects in a dynamic NeRF with user strokes on a single frame. We propose an extension to the original dynamic NeRF by incorporating a hybrid semantic feature distillation to maintain spatial-temporal consistency after editing. In addition, we design Recursive Selection Refinement that significantly boosts object segmentation accuracy within a dynamic NeRF to aid the editing process. Moreover, we develop Multi-view Reprojection Inpainting to fill holes caused by incomplete scene capture after editing. Extensive experiments and editing examples on real-world demonstrate that 4D-Editor achieves photo-realistic editing on dynamic NeRFs. Project page: https://patrickddj.github.io/4D-Editor

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 25 Oct 2023.

Builds on

42 of 52 references.

References · 42

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  5. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  6. 2022Language-driven Semantic Segmentationcited by 717
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  8. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  9. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  10. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  11. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  12. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
30 more
  1. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
  2. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  3. 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
  4. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  5. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  6. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
  7. 2023Robust Dynamic Radiance Fieldscited by 194
  8. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  9. 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
  10. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  11. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  12. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
  13. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  14. 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
  15. 2022DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenescited by 103
  16. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  17. 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
  18. 2022Interactive Segmentation of Radiance Fieldscited by 60
  19. 2022NeuPhysics: Editable Neural Geometry and Physics from Monocular Videoscited by 50
  20. 2022V4d: voxel for 4d novel view synthesiscited by 43
  21. 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
  22. 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
  23. 2023OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fieldscited by 34
  24. 2022Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fieldscited by 29
  25. 2023Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fieldscited by 23
  26. 2022D-TensoRF: Tensorial Radiance Fields for Dynamic Scenescited by 19
  27. 2023InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fieldscited by 16
  28. 2023Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulationcited by 11
  29. 2023Dynamic NeRFs for Soccer Scenescited by 4
  30. 2023Learning Effective NeRFs and SDFs Representations with 3D Generative Adversarial Networks for 3D Object Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.

  1. 2024Segment Any 4D Gaussianscited by 20
  2. 2025Split4D: Decomposed 4D Scene Reconstruction Without Video Segmentationcited by 4
  3. 2025PSF-4D: A Progressive Sampling Framework for View Consistent 4D Editingcited by 1
  4. 2025Bridging the Gap Between Multimodal Foundation Models and World Modelscited by 1
  5. 2026Lift, Associate, and Fuse: A Decision-Centric Framework for 2D-to-3D Foundation Model Transfercited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024SealD-NeRF: Interactive Pixel-Level Editing for Dynamic Scenes by Neural Radiance Fields
  2. 2024DATENeRF: Depth-Aware Text-based Editing of NeRFs
  3. 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context
  4. 2023RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models
  5. 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields
  6. 2023Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model
  7. 2026Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagation
  8. 2023Inpaint4DNeRF: Promptable Spatio-Temporal NeRF Inpainting with Generative Diffusion Models