mlsanityData to 14 Oct 2026

CLIPGaussian: Universal and Multimodal Style Transfer Based on Gaussian Splatting

arXiv 2505.22854 ↗First posted 28 May 2025cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Gaussian Splatting (GS) has recently emerged as an efficient representation for rendering 3D scenes from 2D images and has been extended to images, videos, and dynamic 4D content. However, applying style transfer to GS-based representations, especially beyond simple color changes, remains challenging. In this work, we introduce CLIPGaussian, the first unified style transfer framework that supports text- and image-guided stylization across multiple modalities: 2D images, videos, 3D objects, and 4D scenes. Our method operates directly on Gaussian primitives and integrates into existing GS pipelines as a plug-in module, without requiring large generative models or retraining from scratch. The CLIPGaussian approach enables joint optimization of color and geometry in 3D and 4D settings, and achieves temporal coherence in videos, while preserving the model size. We demonstrate superior style fidelity and consistency across all tasks, validating CLIPGaussian as a universal and efficient solution for multimodal style transfer.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

55 of 66 references.

References · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  10. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  11. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
38 more
  1. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  2. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  3. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  4. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  5. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  6. 2017Universal Style Transfer via Feature Transformscited by 354
  7. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  8. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  9. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  10. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  11. 2021StyTr2: Image Style Transfer with Transformerscited by 187
  12. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  13. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
  14. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  15. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
  16. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
  17. 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
  18. 2024StyleGaussian: Instant 3D Style Transfer with Gaussian Splattingcited by 79
  19. 2022Disentangling visual and written concepts in CLIPcited by 58
  20. 2024StyleMaster: Stylize Your Video with Artistic Generation and Translationcited by 47
  21. 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
  22. 2023Small Models are Valuable Plug-ins for Large Language Modelscited by 42
  23. 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splattingcited by 41
  24. 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
  25. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
  26. 2023BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Modelscited by 20
  27. 2024SGSST: Scaling Gaussian Splatting StyleTransfercited by 20
  28. 2024D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soupcited by 18
  29. 2024StyleSplat: 3D Object Style Transfer with Gaussian Splattingcited by 18
  30. 2024UniVST: A Unified Framework for Training-free Localized Video Style Transfercited by 16
  31. 2023Style-A-Video: Agile Diffusion for Arbitrary Text-based Video Style Transfercited by 14
  32. 2023Two Birds, One Stone: A Unified Framework for Joint Learning of Image and Video Style Transferscited by 12
  33. 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
  34. 2024MiraGe: Editable 2D Images using Gaussian Splattingcited by 12
  35. 2024InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splattingcited by 11
  36. 2024VeGaS: Video Gaussian Splattingcited by 9
  37. 2023Advances in 3D Neural Stylization: A Surveycited by 8
  38. 2024Style3D: Attention-guided Multi-view Style Transfer for 3D Object Generationcited by 8

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.