Gaussian Splatting in Style
Not on the map. Why?
Abstract (arXiv)
3D scene stylization extends the work of neural style transfer to 3D. A vital challenge in this problem is to maintain the uniformity of the stylized appearance across multiple views. A vast majority of the previous works achieve this by training a 3D model for every stylized image and a set of multi-view images. In contrast, we propose a novel architecture trained on a collection of style images that, at test time, produces real time high-quality stylized novel views. We choose the underlying 3D scene representation for our model as 3D Gaussian splatting. We take the 3D Gaussians and process them using a multi-resolution hash grid and a tiny MLP to obtain stylized views. The MLP is conditioned on different style codes for generalization to different styles during test time. The explicit nature of 3D Gaussians gives us inherent advantages over NeRF-based methods, including geometric consistency and a fast training and rendering regime. This enables our method to be useful for various practical use cases, such as augmented or virtual reality. We demonstrate that our method achieves state-of-the-art performance with superior visual quality on various indoor and outdoor real-world data.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 64 of its 90 references that are in the map. First posted on arXiv 13 Mar 2024.
Builds on
64 of 90 references.
References · 64
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
38 more
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 760
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2020Softmax Splatting for Video Frame Interpolationcited by 276
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2020Free View Synthesiscited by 231
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
- 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023Human Gaussian Splatting: Real-time Rendering of Animatable Avatarscited by 105
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2017Coherent Online Video Style Transfercited by 96
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2021Learning to Stylize Novel Viewscited by 76
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2024: 9; 2025: 5; 2026: 2.
16 papers.
Sort:
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024StyleSplat: 3D Object Style Transfer with Gaussian Splattingcited by 18
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
- 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
- 2024G-Style: Stylized Gaussian Splattingcited by 5
- 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylizationcited by 4
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Stylescited by 4
- 2026Variation-aware Flexible 3D Gaussian Editingcited by 2
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
4 more
- 2026M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting4 Apr 2026
- 2026Variation-aware Flexible 3D Gaussian Editing12 Feb 2026
- 2025Style4D-Bench: A Benchmark Suite for 4D Stylization26 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Optimization-Free Style Transfer for 3D Gaussian Splats7 Aug 2025
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Styles27 May 2025
- 2025GAS-NeRF: Geometry-Aware Stylization of Dynamic Radiance Fields11 Mar 2025
- 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylization25 Dec 2024
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospects9 Dec 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
4 more
- 2024StyleSplat: 3D Object Style Transfer with Gaussian Splatting12 Jul 2024
- 2024Reference-based Controllable Scene Stylization with Gaussian Splatting9 Jul 2024
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splatting8 Apr 2024
- 2024Recent Advances in 3D Gaussian Splatting17 Mar 2024
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2024StyleSplat: 3D Object Style Transfer with Gaussian Splattingcited by 18
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
- 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
- 2024G-Style: Stylized Gaussian Splattingcited by 5
- 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylizationcited by 4
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Stylescited by 4
- 2026Variation-aware Flexible 3D Gaussian Editingcited by 2
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Surveycited by 1
12 most cited of 16 All 16 (JSON)
- 2026M2StyleGS: Multi-Modality 3D Style Transfer with Gaussian Splatting4 Apr 2026
- 2026Variation-aware Flexible 3D Gaussian Editing12 Feb 2026
- 2025Style4D-Bench: A Benchmark Suite for 4D Stylization26 Aug 2025
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025
- 2025Optimization-Free Style Transfer for 3D Gaussian Splats7 Aug 2025
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Styles27 May 2025
- 2025GAS-NeRF: Geometry-Aware Stylization of Dynamic Radiance Fields11 Mar 2025
- 2024ArtNVG: Content-Style Separated Artistic Neighboring-View Gaussian Stylization25 Dec 2024
- 2024Editing Implicit and Explicit Representations of Radiance Fields: A Survey23 Dec 2024
- 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospects9 Dec 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
- 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities24 Jul 2024
12 newest of 16 All 16 (JSON)