ARF: Artistic Radiance Fields
Not on the map. Why?
Abstract (arXiv)
We present a method for transferring the artistic features of an arbitrary style image to a 3D scene. Previous methods that perform 3D stylization on point clouds or meshes are sensitive to geometric reconstruction errors for complex real-world scenes. Instead, we propose to stylize the more robust radiance field representation. We find that the commonly used Gram matrix-based loss tends to produce blurry results without faithful brushstrokes, and introduce a nearest neighbor-based loss that is highly effective at capturing style details while maintaining multi-view consistency. We also propose a novel deferred back-propagation method to enable optimization of memory-intensive radiance fields using style losses defined on full-resolution rendered images. Our extensive evaluation demonstrates that our method outperforms baselines by generating artistic appearance that more closely resembles the style image. Please check our project page for video results and open-source implementations: https://www.cs.cornell.edu/projects/arf/ .
Key facts. Cited by 147 papers in the map (data through 7 Oct 2026). Builds on 42 of its 49 references that are in the map. First posted on arXiv 13 Jun 2022.
Builds on
42 of 49 references.
References · 42
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2017Universal Style Transfer via Feature Transformscited by 352
30 more
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2017Neural Style Transfer: A Reviewcited by 199
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2017Deep Photo Style Transfercited by 168
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
- 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
- 2017Visual Attribute Transfer through Deep Image Analogycited by 123
- 2017Deep Image Harmonizationcited by 120
- 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
- 2017Coherent Online Video Style Transfercited by 96
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2020Arbitrary Video Style Transfer via Multi-Channel Correlationcited by 84
- 2021Learning to Stylize Novel Viewscited by 76
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
- 2019Deep Image Blendingcited by 62
- 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
- 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
- 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
- 2019Attention-aware Multi-stroke Style Transfercited by 47
- 2017Artistic style transfer for videos and spherical imagescited by 45
- 20213D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Imagecited by 45
- 2020Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfercited by 31
- 2020Real-time Localized Photorealistic Video Style Transfercited by 24
- 2022Neural Neighbor Style Transfercited by 23
- 2018Deep Painterly Harmonizationcited by 19
Built on by
Citing papers per year: 2022: 11; 2023: 55; 2024: 41; 2025: 24; 2026: 16.
147 papers.
Sort:
By area:
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 93
38 more
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
- 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 89
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 78
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
- 2024Advances in 3D Generation: A Surveycited by 62
- 2022Interactive Segmentation of Radiance Fieldscited by 60
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2022UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scenecited by 47
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 47
- 2022PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fieldscited by 43
- 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
- 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
- 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
- 2023Real-World Image Variation by Aligning Diffusion Inversion Chaincited by 37
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
- 2022Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylizationcited by 35
- 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
- 2023AnimatableDreamer: Text-Guided Non-rigid 3D Model Generation and Reconstruction with Canonical Score Distillationcited by 28
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Supportcited by 25
- 2023DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagationcited by 25
- 2024WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrightscited by 25
- 2023RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenescited by 24
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
- 2024PanSplat: 4K Panorama Synthesis with Feed-Forward Gaussian Splattingcited by 23
- 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
- 2023Locally Stylized Neural Radiance Fieldscited by 20
- 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRFcited by 20
- 2024GGRt: Towards Pose-free Generalizable 3D Gaussian Splatting in Real-timecited by 20
- 2024SGSST: Scaling Gaussian Splatting StyleTransfercited by 20
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
- 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
- 2023LatentEditor: Text Driven Local Editing of 3D Scenescited by 17
- 2024Deformable Radial Kernel Splattingcited by 17
- 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fieldscited by 16
50 most cited of 147 All 147 (JSON)
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models29 Aug 2026
- 2026DReSG: Diffusion Residuals for Stylized Gaussian Splatting29 Aug 2026
- 2026Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering22 Aug 2026
- 2026Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization14 Aug 2026
- 2026OmniStyle-INR: Universal and Multimodal Style Transfer for INRs17 Jul 2026
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting25 Jun 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field17 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Fast Spatial Memory with Elastic Test-Time Training8 Apr 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
38 more
- 2026M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting4 Apr 2026
- 2026SpectralSplat: Appearance-Disentangled Feed-Forward Gaussian Splatting for Driving Scenes3 Apr 2026
- 2026tttLRM: Test-Time Training for Long Context and Autoregressive 3D Reconstruction23 Feb 2026
- 2026Tune-Your-Style: Intensity-tunable 3D Style Transfer with Gaussian Splatting31 Jan 2026
- 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec 2025
- 2025Opacity-Gradient Driven Density Control for Compact and Efficient Few-Shot 3D Gaussian Splatting11 Oct 2025
- 2025Multi-level Dynamic Style Transfer for NeRFs1 Oct 2025
- 2025Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splatting30 Sep 2025
- 2025MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild19 Sep 2025
- 2025Improved 3D Scene Stylization via Text-Guided Generative Image Editing with Region-Based Control4 Sep 2025
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer4 Sep 2025
- 2025Style4D-Bench: A Benchmark Suite for 4D Stylization26 Aug 2025
- 2025Optimization-Free Style Transfer for 3D Gaussian Splats7 Aug 2025
- 2025TexGS-VolVis: Expressive Scene Editing for Volume Visualization via Textured Gaussian Splatting18 Jul 2025
- 20253D PixBrush: Image-Guided Local Texture Synthesis4 Jul 2025
- 2025RoboPearls: Editable Video Simulation for Robot Manipulation28 Jun 2025
- 20254D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time23 Jun 2025
- 2025DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos11 Jun 2025
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Styles27 May 2025
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields28 Apr 2025
- 2025StyleMe3D: Stylization with Disentangled Priors by Multiple Encoders on 3D Gaussians21 Apr 2025
- 2025MultiNeRF: Multiple Watermark Embedding for Neural Radiance Fields3 Apr 2025
- 2025ABC-GS: Alignment-Based Controllable Style Transfer for 3D Gaussian Splatting28 Mar 2025
- 2025FPGS: Feed-Forward Semantic-aware Photorealistic Style Transfer of Large-Scale Gaussian Splatting11 Mar 2025
- 2025GAS-NeRF: Geometry-Aware Stylization of Dynamic Radiance Fields11 Mar 2025
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Models6 Mar 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2025DualNeRF: Text-Driven 3D Scene Editing via Dual-Field Representation22 Feb 2025
- 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylization25 Dec 2024
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 2024PanSplat: 4K Panorama Synthesis with Feed-Forward Gaussian Splatting16 Dec 2024
- 2024Deformable Radial Kernel Splatting16 Dec 2024
- 2024NeRF-Texture: Synthesizing Neural Radiance Field Textures13 Dec 2024
- 2024SGSST: Scaling Gaussian Splatting StyleTransfer4 Dec 2024
- 2024TRASE: Tracking-free 4D Segmentation and Editing28 Nov 2024
- 2024Buffer Anytime: Zero-Shot Video Depth and Normal from Image Priors26 Nov 2024
- 2024ArCSEM: Artistic Colorization of SEM Images via Gaussian Splatting25 Oct 2024
- 2024ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Model12 Oct 2024
50 newest of 147 All 147 (JSON)
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Priorcited by 55
- 2023Real-World Image Variation by Aligning Diffusion Inversion Chaincited by 37
- 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRFcited by 20
- 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editingcited by 17
- 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Modelscited by 16
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
- 2024InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splattingcited by 11
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editingcited by 10
- 20243DEgo: 3D Editing on the Go!cited by 10
12 most cited of 19 All 19 (JSON)
- 2026DReSG: Diffusion Residuals for Stylized Gaussian Splatting29 Aug 2026
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer4 Sep 2025
- 2025DualNeRF: Text-Driven 3D Scene Editing via Dual-Field Representation22 Feb 2025
- 2024InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splatting8 Aug 2024
- 20243DEgo: 3D Editing on the Go!14 Jul 2024
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images19 Jun 2024
- 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing23 May 2024
- 2024InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior17 Apr 2024
- 2024DATENeRF: Depth-Aware Text-based Editing of NeRFs6 Apr 2024
- 2023Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models13 Dec 2023
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions27 Nov 2023
- 2023DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing16 Oct 2023
12 newest of 19 All 19 (JSON)
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 93
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 78
12 most cited of 125 All 125 (JSON)
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering22 Aug 2026
- 2026Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization14 Aug 2026
- 2026OmniStyle-INR: Universal and Multimodal Style Transfer for INRs17 Jul 2026
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting25 Jun 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026NeuMesh++: Towards Versatile and Efficient Volumetric Editing with Disentangled Neural Mesh-based Implicit Field17 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Fast Spatial Memory with Elastic Test-Time Training8 Apr 2026
- 2026LSRM: High-Fidelity Object-Centric Reconstruction via Scaled Context Windows6 Apr 2026
- 2026M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting4 Apr 2026
- 2026SpectralSplat: Appearance-Disentangled Feed-Forward Gaussian Splatting for Driving Scenes3 Apr 2026
12 newest of 125 All 125 (JSON)