mlsanityData to 7 Oct 2026

Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition

arXiv 2404.02514 ↗First posted 3 Apr 2024cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper enables high-fidelity, transferable NeRF editing by frequency decomposition. Recent NeRF editing pipelines lift 2D stylization results to 3D scenes while suffering from blurry results, and fail to capture detailed structures caused by the inconsistency between 2D editings. Our critical insight is that low-frequency components of images are more multiview-consistent after editing compared with their high-frequency parts. Moreover, the appearance style is mainly exhibited on the low-frequency components, and the content details especially reside in high-frequency parts. This motivates us to perform editing on low-frequency components, which results in high-fidelity edited scenes. In addition, the editing is performed in the low-frequency feature space, enabling stable intensity control and novel scene transfer. Comprehensive experiments conducted on photorealistic datasets demonstrate the superior performance of high-fidelity and transferable NeRF editing. The project page is at urlhttps://aigc3d.github.io/freditor.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 3 Apr 2024.

Builds on

51 of 58 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2023Segment Anythingcited by 8,158
  7. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  11. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  12. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
38 more
  1. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  2. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  3. 2022Language-driven Semantic Segmentationcited by 711
  4. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  5. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  6. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  7. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  8. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  9. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  10. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  11. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  12. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  13. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  14. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  15. 2020Softmax Splatting for Video Frame Interpolationcited by 276
  16. 2021Editing Conditional Radiance Fieldscited by 222
  17. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  18. 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
  19. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 195
  20. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  21. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  22. 2022ARF: Artistic Radiance Fieldscited by 147
  23. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  24. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  25. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  26. 2021Unsupervised Discovery of Object Radiance Fieldscited by 100
  27. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  28. 2021Learning to Stylize Novel Viewscited by 76
  29. 2023SKED: Sketch-guided Text-based 3D Editingcited by 72
  30. 2022Unified Implicit Neural Stylizationcited by 67
  31. 2021High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Networkcited by 61
  32. 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
  33. 20213D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Imagecited by 45
  34. 2023Posterior Distillation Samplingcited by 45
  35. 2022PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fieldscited by 43
  36. 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
  37. 2023Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fieldscited by 27
  38. 2023FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fieldscited by 12

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.