mlsanityData to 7 Oct 2026

Gaussian Splatting in Style

arXiv 2403.08498 ↗First posted 13 Mar 2024cs.CVcited by 16

Not on the map. Why?

Abstract (arXiv)

3D scene stylization extends the work of neural style transfer to 3D. A vital challenge in this problem is to maintain the uniformity of the stylized appearance across multiple views. A vast majority of the previous works achieve this by training a 3D model for every stylized image and a set of multi-view images. In contrast, we propose a novel architecture trained on a collection of style images that, at test time, produces real time high-quality stylized novel views. We choose the underlying 3D scene representation for our model as 3D Gaussian splatting. We take the 3D Gaussians and process them using a multi-resolution hash grid and a tiny MLP to obtain stylized views. The MLP is conditioned on different style codes for generalization to different styles during test time. The explicit nature of 3D Gaussians gives us inherent advantages over NeRF-based methods, including geometric consistency and a fast training and rendering regime. This enables our method to be useful for various practical use cases, such as augmented or virtual reality. We demonstrate that our method achieves state-of-the-art performance with superior visual quality on various indoor and outdoor real-world data.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 64 of its 90 references that are in the map. First posted on arXiv 13 Mar 2024.

Builds on

64 of 90 references.

References · 64

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  10. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  11. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  12. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
38 more
  1. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  2. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  3. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  4. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  5. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  6. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  7. 2020Convolutional Occupancy Networkscited by 760
  8. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  9. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  10. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  11. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  12. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  13. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  14. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  15. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  16. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  17. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  18. 2020Softmax Splatting for Video Frame Interpolationcited by 276
  19. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  20. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  21. 2020Free View Synthesiscited by 231
  22. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  23. 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
  24. 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
  25. 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
  26. 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
  27. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  28. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  29. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  30. 20193D Ken Burns Effect from a Single Imagecited by 128
  31. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  32. 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
  33. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  34. 2017Coherent Online Video Style Transfercited by 96
  35. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  36. 2021Learning to Stylize Novel Viewscited by 76
  37. 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
  38. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 5; 2026: 2.

16 papers.

Sort: