mlsanityData to 13 Oct 2026

CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields

arXiv 2404.14967 ↗First posted 23 Apr 2024cs.CV cs.AI cs.GRcited by 14

Not on the map. Why?

Abstract (arXiv)

Creating artistic 3D scenes can be time-consuming and requires specialized knowledge. To address this, recent works such as ARF, use a radiance field-based approach with style constraints to generate 3D scenes that resemble a style image provided by the user. However, these methods lack fine-grained control over the resulting scenes. In this paper, we introduce Controllable Artistic Radiance Fields (CoARF), a novel algorithm for controllable 3D scene stylization. CoARF enables style transfer for specified objects, compositional 3D style transfer and semantic-aware style transfer. We achieve controllability using segmentation masks with different label-dependent loss functions. We also propose a semantic-aware nearest neighbor matching algorithm to improve the style transfer quality. Our extensive experiments demonstrate that CoARF provides user-specified controllability of style transfer and superior style transfer quality with more precise feature matching.

Key facts. Cited by 14 papers in the map (data through 13 Oct 2026). Builds on 48 of its 59 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

48 of 59 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,321
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
  5. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,005
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,958
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,610
  8. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,462
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,277
  10. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,231
  11. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,195
  12. 2022Language-driven Semantic Segmentationcited by 715
36 more
  1. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 570
  2. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  3. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
  4. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  5. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  6. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  7. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  9. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
  10. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 216
  11. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
  12. 2017Demystifying Neural Style Transfercited by 152
  13. 2022ARF: Artistic Radiance Fieldscited by 147
  14. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  15. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  16. 2017Visual Attribute Transfer through Deep Image Analogycited by 123
  17. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  18. 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
  19. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 93
  20. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  21. 2022Deforming Radiance Fields with Cagescited by 78
  22. 2022NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenescited by 71
  23. 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
  24. 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
  25. 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
  26. 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
  27. 2022UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scenecited by 47
  28. 2022VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representationscited by 36
  29. 2018Stroke Controllable Fast Style Transfer with Adaptive Receptive Fieldscited by 33
  30. 2022Neural Neighbor Style Transfercited by 23
  31. 2023Volumetric Semantically Consistent 3D Panoptic Mappingcited by 10
  32. 2019Style Mixer: Semantic-aware Multi-Style Transfer Networkcited by 8
  33. 2022Controllable Style Transfer via Test-time Training of Implicit Neural Representationcited by 8
  34. 2017Automatic Semantic Style Transfer using Deep Convolutional Neural Networks and Soft Maskscited by 7
  35. 2022CLIP-based Neural Neighbor Style Transfer for 3D Assetscited by 5
  36. 2023Instant Photorealistic Neural Radiance Fields Stylizationcited by 3

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 6; 2025: 5; 2026: 3.

14 papers.

Sort:

By area: