mlsanityData to 14 Oct 2026

CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics

arXiv 2212.02122 ↗First posted 5 Dec 2022cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

Considerable progress has recently been made in leveraging CLIP (Contrastive Language-Image Pre-Training) models for text-guided image manipulation. However, all existing works rely on additional generative models to ensure the quality of results, because CLIP alone cannot provide enough guidance information for fine-scale pixel-level changes. In this paper, we introduce CLIPVG, a text-guided image manipulation framework using differentiable vector graphics, which is also the first CLIP-based general image manipulation framework that does not require any additional generative models. We demonstrate that CLIPVG can not only achieve state-of-art performance in both semantic correctness and synthesis quality, but also is flexible enough to support various applications far beyond the capability of all existing methods.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 29 of its 36 references that are in the map. First posted on arXiv 5 Dec 2022.

Builds on

29 of 36 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  8. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  12. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
17 more
  1. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  2. 2022CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformerscited by 307
  3. 2016Unrolled Generative Adversarial Networkscited by 208
  4. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  5. 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 187
  6. 2020DeepSVG: A Hierarchical Generative Network for Vector Graphics Animationcited by 159
  7. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  8. 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 116
  9. 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
  10. 2019A Learned Representation for Scalable Vector Graphicscited by 91
  11. 2022Towards Layer-wise Image Vectorizationcited by 79
  12. 2019Learning to Paint With Model-based Deep Reinforcement Learningcited by 71
  13. 2018ArcFace: Additive Angular Margin Loss for Deep Face Recognitioncited by 56
  14. 2020Stylized Neural Paintingcited by 50
  15. 2021Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Conceptscited by 40
  16. 2022AnyFace: Free-style Text-to-Face Synthesis and Manipulationcited by 33
  17. 2022StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translationcited by 28

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 7; 2025: 15; 2026: 9.

34 papers.

Sort:

By area:

  1. 2025Controllable Video Generation: A Surveycited by 98
  2. 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 76
  3. 2025OmniSVG: A Unified Scalable Vector Graphics Generation Modelcited by 74
  4. 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 66
  5. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  6. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
  7. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  8. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 38
  9. 2024Text-to-Vector Generation with Neural Path Representationcited by 33
  10. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  11. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 26
  12. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
22 more
  1. 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 21
  2. 2025NeuralSVG: An Implicit Representation for Text-to-Vector Generationcited by 17
  3. 2025SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generationcited by 16
  4. 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
  5. 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidancecited by 8
  6. 2026VISTA: Triplet-Supervised Video Style Transfer with Diffusion Transformerscited by 8
  7. 2025UniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifyingcited by 7
  8. 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animationcited by 6
  9. 2023Text-Guided Vector Graphics Customizationcited by 5
  10. 2024Creative Text-to-Audio Generation via Synthesizer Programmingcited by 4
  11. 2024SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generationcited by 3
  12. 2026OmniLottie: Generating Vector Animations via Parameterized Lottie Tokenscited by 3
  13. 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Designcited by 2
  14. 2025Style Customization of Text-to-Vector Generation with Image Diffusion Priorscited by 2
  15. 2026Unlocking the Latent Canvas: Eliciting and Benchmarking Symbolic Visual Expression in LLMscited by 2
  16. 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
  17. 2026Copy-Trasform-Paste: Zero-Shot Object-Object Alignment Guided by Vision-Language and Geometric Constraintscited by 1
  18. 2023Optimize and Reduce: A Top-Down Approach for Image Vectorizationcited by 0
  19. 2024On mitigating stability-plasticity dilemma in CLIP-guided image morphing via geodesic distillation losscited by 0
  20. 2026DiffBMP: Differentiable Rendering with Bitmap Primitivescited by 0
  21. 2026VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphicscited by 0
  22. 2026Back2Struct: Making Structured Images Editable Againcited by 0