mlsanityData to 7 Oct 2026

Advances in 3D Neural Stylization: A Survey

arXiv 2311.18328 ↗First posted 30 Nov 2023cs.CV cs.AI cs.GRcited by 8

Not on the map. Why?

Abstract (arXiv)

Modern artificial intelligence offers a novel and transformative approach to creating digital art across diverse styles and modalities like images, videos and 3D data, unleashing the power of creativity and revolutionizing the way that we perceive and interact with visual content. This paper reports on recent advances in stylized 3D asset creation and manipulation with the expressive power of neural networks. We establish a taxonomy for neural stylization, considering crucial design choices such as scene representation, guidance data, optimization strategies, and output styles. Building on such taxonomy, our survey first revisits the background of neural stylization on 2D images, and then presents in-depth discussions on recent neural stylization methods for 3D data, accompanied by a benchmark evaluating selected mesh and neural field stylization methods. Based on the insights gained from the survey, we highlight the practical significance, open challenges, future research, and potential impacts of neural stylization, which facilitates researchers and practitioners to navigate the rapidly evolving landscape of 3D content creation using modern artificial intelligence.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 153 of its 274 references that are in the map. First posted on arXiv 30 Nov 2023.

Builds on

153 of 274 references.

References · 153

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2023Segment Anythingcited by 8,158
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  11. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
  1. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2016Improved Techniques for Training GANscited by 2,938
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  13. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  14. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  15. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  16. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  17. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  18. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  19. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  20. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  21. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  22. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  23. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  24. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  25. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  26. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  27. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  28. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  29. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  30. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  31. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  32. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  33. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  34. 2020Convolutional Occupancy Networkscited by 760
  35. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  36. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  37. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  38. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684

50 most cited of 153 All 153 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 1.

8 papers.

  1. 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
  2. 2024StyleRF-VolVis: Style Transfer of Neural Radiance Fields for Expressive Volume Visualizationcited by 9
  3. 2025CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splattingcited by 8
  4. 2024Dream-in-Style: Text-to-3D Generation Using Stylized Score Distillationcited by 4
  5. 2025Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splattingcited by 3
  6. 2024StyleCity: Large-Scale 3D Urban Scenes Stylizationcited by 2
  7. 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
  8. 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0