PaletteNeRF: Palette-based Color Editing for NeRFs
Not on the map. Why?
Abstract (arXiv)
Neural Radiance Field (NeRF) is a powerful tool to faithfully generate novel views for scenes with only sparse captured images. Despite its strong capability for representing 3D scenes and their appearance, its editing ability is very limited. In this paper, we propose a simple but effective extension of vanilla NeRF, named PaletteNeRF, to enable efficient color editing on NeRF-represented scenes. Motivated by recent palette-based image decomposition works, we approximate each pixel color as a sum of palette colors modulated by additive weights. Instead of predicting pixel colors as in vanilla NeRFs, our method predicts additive weights. The underlying NeRF backbone could also be replaced with more recent NeRF models such as KiloNeRF to achieve real-time editing. Experimental results demonstrate that our method achieves efficient, view-consistent, and artifact-free color editing on a wide range of NeRF-represented scenes.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 25 of its 49 references that are in the map. First posted on arXiv 25 Dec 2022.
Builds on
25 of 49 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
13 more
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021Advances in Neural Renderingcited by 365
- 2020Neural Scene Graphs for Dynamic Scenescited by 298
- 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
- 2021Editing Conditional Radiance Fieldscited by 222
- 2021Unsupervised Discovery of Object Radiance Fieldscited by 101
- 2020Object-Centric Neural Scene Renderingcited by 90
- 2020Neural Volume Rendering: NeRF And Beyondcited by 44
- 2017LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editingcited by 7
- 2017Pigmento: Pigment-Based Image Analysis and Editingcited by 4
- 2018Palette-based image decomposition, harmonization, and color transfercited by 2
- 2019RGB Point Cloud Manipulation with Triangular Structures for Artistic Image Recoloringcited by 1
Built on by
Citing papers per year: 2023: 10; 2024: 7; 2025: 0; 2026: 1.
18 papers.
Sort:
By area:
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Supportcited by 25
- 2023Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fieldscited by 23
- 2024GenN2N: Generative NeRF2NeRF Translationcited by 11
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editingcited by 10
- 20243DEgo: 3D Editing on the Go!cited by 10
- 2023VQ-NeRF: Neural Reflectance Decomposition and Editing with Vector Quantizationcited by 8
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRFcited by 7
- 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editingcited by 7
6 more
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023LAENeRF: Local Appearance Editing for Neural Radiance Fieldscited by 5
- 2024DATENeRF: Depth-Aware Text-based Editing of NeRFscited by 5
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editingcited by 4
- 2023Text-guided Image-and-Shape Editing and Generation: A Short Surveycited by 3
- 2024Neural Poisson Solver: A Universal and Continuous Framework for Natural Signal Blendingcited by 1
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing12 Jan 2026
- 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing10 Dec 2024
- 20243DEgo: 3D Editing on the Go!14 Jul 2024
- 2024Neural Poisson Solver: A Universal and Continuous Framework for Natural Signal Blending11 Jul 2024
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing23 May 2024
- 2024DATENeRF: Depth-Aware Text-based Editing of NeRFs6 Apr 2024
- 2024GenN2N: Generative NeRF2NeRF Translation3 Apr 2024
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields1 Feb 2024
- 2023LAENeRF: Local Appearance Editing for Neural Radiance Fields15 Dec 2023
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov 2023
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF22 Nov 2023
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRF7 Nov 2023
6 more
- 2023VQ-NeRF: Neural Reflectance Decomposition and Editing with Vector Quantization18 Oct 2023
- 2023NeuBTF: Neural fields for BTF encoding and transfer3 Jul 2023
- 2023Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields22 Jun 2023
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Support26 May 2023
- 2023Text-guided Image-and-Shape Editing and Generation: A Short Survey18 Apr 2023
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions22 Mar 2023
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editingcited by 10
- 20243DEgo: 3D Editing on the Go!cited by 10
- 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editingcited by 7
- 2024DATENeRF: Depth-Aware Text-based Editing of NeRFscited by 5
- 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing10 Dec 2024
- 20243DEgo: 3D Editing on the Go!14 Jul 2024
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing23 May 2024
- 2024DATENeRF: Depth-Aware Text-based Editing of NeRFs6 Apr 2024
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov 2023
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Supportcited by 25
- 2023Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fieldscited by 23
- 2024GenN2N: Generative NeRF2NeRF Translationcited by 11
- 2023VQ-NeRF: Neural Reflectance Decomposition and Editing with Vector Quantizationcited by 8
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRFcited by 7
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023LAENeRF: Local Appearance Editing for Neural Radiance Fieldscited by 5
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editingcited by 4
- 2023Text-guided Image-and-Shape Editing and Generation: A Short Surveycited by 3
12 most cited of 13 All 13 (JSON)
- 20263DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing12 Jan 2026
- 2024Neural Poisson Solver: A Universal and Continuous Framework for Natural Signal Blending11 Jul 2024
- 2024GenN2N: Generative NeRF2NeRF Translation3 Apr 2024
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields1 Feb 2024
- 2023LAENeRF: Local Appearance Editing for Neural Radiance Fields15 Dec 2023
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF22 Nov 2023
- 2023Fast Sun-aligned Outdoor Scene Relighting based on TensoRF7 Nov 2023
- 2023VQ-NeRF: Neural Reflectance Decomposition and Editing with Vector Quantization18 Oct 2023
- 2023NeuBTF: Neural fields for BTF encoding and transfer3 Jul 2023
- 2023Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields22 Jun 2023
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Support26 May 2023
- 2023Text-guided Image-and-Shape Editing and Generation: A Short Survey18 Apr 2023
12 newest of 13 All 13 (JSON)