CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Gaussian Splatting (GS) has recently emerged as an efficient representation for rendering 3D scenes from 2D images and has been extended to images, videos, and dynamic 4D content. However, applying style transfer to GS-based representations, especially beyond simple color changes, remains challenging. In this work, we introduce CLIPGaussian, the first unified style transfer framework that supports text- and image-guided stylization across multiple modalities: 2D images, videos, 3D objects, and 4D scenes. Our method operates directly on Gaussian primitives and integrates into existing GS pipelines as a plug-in module, without requiring large generative models or retraining from scratch. The CLIPGaussian approach enables joint optimization of color and geometry in 3D and 4D settings, and achieves temporal coherence in videos, while preserving the model size. We demonstrate superior style fidelity and consistency across all tasks, validating CLIPGaussian as a universal and efficient solution for multimodal style transfer.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
55 of 66 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024GPT-4o System Cardcited by 4,588
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
38 more
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
- 2021StyTr2: Image Style Transfer with Transformerscited by 187
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
- 2022Disentangling visual and written concepts in CLIPcited by 58
- 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2023Small Models are Valuable Plug-ins for Large Language Modelscited by 42
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 41
- 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
- 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
- 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Modelscited by 20
- 2024SGSST: Scaling Gaussian Splatting StyleTransfercited by 20
- 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soupcited by 18
- 2024StyleSplat: 3D Object Style Transfer with Gaussian Splattingcited by 18
- 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
- 2023Style-A-Video: Agile Diffusion for Arbitrary Text-based Video Style Transfercited by 14
- 2023Two Birds, One Stone: A Unified Framework for Joint Learning of Image and Video Style Transferscited by 12
- 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
- 2024MiraGe: Editable 2D Images using Gaussian Splattingcited by 12
- 2024InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splattingcited by 11
- 2024VeGaS: Video Gaussian Splattingcited by 9
- 2023Advances in 3D Neural Stylization: A Surveycited by 8
- 2024Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generationcited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimizationcited by 0
- 2026AnyStyle: Single-Pass Multimodal Stylization for 3D Gaussian Splattingcited by 0
- 2026Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagationcited by 0
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splattingcited by 0
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splattingcited by 0
- 2026OmniStyle-INR: Universal and Multimodal Style Transfer for INRscited by 0
- 2026DReSG: Diffusion Residuals for Stylized Gaussian Splattingcited by 0
- 2026DReSG: Diffusion Residuals for Stylized Gaussian Splatting29 Aug 2026
- 2026OmniStyle-INR: Universal and Multimodal Style Transfer for INRs17 Jul 2026
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting25 Jun 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026Catalyst4D: High-Fidelity 3D-to-4D Scene Editing via Dynamic Propagation13 Mar 2026
- 2026AnyStyle: Single-Pass Multimodal Stylization for 3D Gaussian Splatting3 Feb 2026
- 2026DiffStyle3D: Consistent 3D Gaussian Stylization via Attention Optimization27 Jan 2026
- 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generation13 Aug 2025