mlsanityData to 7 Oct 2026

Language-Driven Image Style Transfer

arXiv 2106.00178 ↗First posted 1 Jun 2021cs.CVcited by 36

Not on the map. Why?

Abstract (arXiv)

Despite having promising results, style transfer, which requires preparing style images in advance, may result in lack of creativity and accessibility. Following human instruction, on the other hand, is the most natural way to perform artistic style transfer that can significantly improve controllability for visual effect applications. We introduce a new task, language-driven artistic style transfer (LDAST), to manipulate the style of a content image, guided by a text. We propose contrastive language visual artist (CLVA) that learns to extract visual semantics from style instructions and accomplish LDAST by the patch-wise style discriminator. The discriminator considers the correlation between language and patches of style images or transferred results to jointly embed style instructions. CLVA further compares contrastive pairs of content images and style instructions to improve the mutual relativeness. The results from the same content image can preserve consistent content structures. Besides, they should present analogous style patterns from style instructions that contain similar visual semantics. The experiments show that our CLVA is effective and achieves superb transferred results on LDAST.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 1 Jun 2021.

Builds on

53 of 69 references.

References · 53

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  9. 2013Describing Textures in the Wildcited by 2,110
  10. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  11. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  12. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
38 more
  1. 2018Self-Attention Generative Adversarial Networkscited by 809
  2. 2016Generative Adversarial Text to Image Synthesiscited by 735
  3. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  4. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
  5. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
  6. 2015A Neural Algorithm of Artistic Stylecited by 480
  7. 2017Universal Style Transfer via Feature Transformscited by 352
  8. 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
  9. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
  10. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  11. 2017Neural Style Transfer: A Reviewcited by 199
  12. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  13. 2019MirrorGAN: Learning Text-to-image Generation by Redescriptioncited by 176
  14. 2017Deep Photo Style Transfercited by 168
  15. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  16. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  17. 2018Fighting Fake News: Image Splice Detection via Learned Self-Consistencycited by 136
  18. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  19. 2019Image Super-Resolution by Neural Texture Transfercited by 119
  20. 2021ArtEmis: Affective Language for Visual Artcited by 103
  21. 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
  22. 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
  23. 2018Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instructioncited by 61
  24. 2018A Style-Aware Content Loss for Real-time HD Style Transfercited by 58
  25. 2017Language-Based Image Editing with Recurrent Attentive Modelscited by 53
  26. 2020Deep Learning Models for Multilingual Hate Speech Detectioncited by 49
  27. 2018Learning Linear Transformations for Fast Arbitrary Style Transfercited by 48
  28. 2021Rethinking and Improving the Robustness of Image Style Transfercited by 48
  29. 2017TextureGAN: Controlling Deep Image Synthesis with Texture Patchescited by 47
  30. 2020Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognitioncited by 43
  31. 2020Frustratingly Simple Domain Generalization via Image Stylizationcited by 43
  32. 2020SSCR: Iterative Language-Based Image Editing via Self-Supervised Counterfactual Reasoningcited by 32
  33. 2018ReCoNet: Real-time Coherent Video Style Transfer Networkcited by 26
  34. 2020Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructionscited by 25
  35. 2020Contrastive Visual-Linguistic Pretrainingcited by 14
  36. 2018Cycle-Consistent Deep Generative Hashing for Cross-Modal Retrievalcited by 11
  37. 2020Generative Adversarial Networks (GANs): An Overview of Theoretical Model, Evaluation Metrics, and Recent Developmentscited by 11
  38. 2019Improved Sentiment Detection via Label Transfer from Monolingual to Synthetic Code-Switched Textcited by 8

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 11; 2024: 9; 2025: 9; 2026: 2.

36 papers.

Sort:

By area:

  1. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
  2. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  3. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
  4. 2022DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylizationcited by 45
  5. 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 39
  6. 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
  7. 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 27
  8. 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Modelscited by 21
  9. 2023Style-A-Video: Agile Diffusion for Arbitrary Text-based Video Style Transfercited by 14
  10. 2023Learning Dynamic Style Kernels for Artistic Style Transfercited by 12
  11. 2023ReDi: Efficient Learning-Free Diffusion Inference via Trajectory Retrievalcited by 11
  12. 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
24 more
  1. 2022Arbitrary Style Guidance for Enhanced Diffusion-Based Text-to-Image Generationcited by 9
  2. 2023Vision + Language Applications: A Surveycited by 8
  3. 2022FastCLIPstyler: Optimisation-free Text-based Image Style Transfer Using Style Representationscited by 6
  4. 2025Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative Priorscited by 6
  5. 2024ConRF: Zero-shot Stylization of 3D Scenes with Conditioned Radiation Fieldscited by 5
  6. 2024StyleMamba : State Space Model for Efficient Text-driven Image Style Transfercited by 5
  7. 2025EmoFeedback2: Reinforcement of Continuous Emotional Image Generation via LVLM-based Reward and Textual Feedbackcited by 5
  8. 2023Text-guided 3D Human Generation from 2D Collectionscited by 4
  9. 2025EmoCtrl: Controllable Emotional Image Content Generationcited by 4
  10. 2023ITstyler: Image-optimized Text-based Style Transfercited by 3
  11. 2024DDR: Exploiting Deep Degradation Response as Flexible Image Descriptorcited by 3
  12. 2024CLIP-SR: Collaborative Linguistic and Image Processing for Super-Resolutioncited by 3
  13. 2025EmoAgent: A Multi-Agent Framework for Diverse Affective Image Manipulationcited by 3
  14. 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimizationcited by 3
  15. 2023TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style Transfercited by 2
  16. 2025EmoStyle: Emotion-Driven Image Stylizationcited by 2
  17. 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesiscited by 1
  18. 2026EmoStory: Emotion-Aware Story Generationcited by 1
  19. 2026What Can I Edit? Open-Ended Strategy Discovery and the Emotion Editability Landscapecited by 1
  20. 2024LEAST: "Local" text-conditioned image style transfercited by 0
  21. 2024Uni-ISP: Toward Unifying the Learning of ISPs from Multiple Mobile Camerascited by 0
  22. 2024Bridging Text and Image for Artist Style Transfer via Contrastive Learningcited by 0
  23. 2025COT-AD: Cotton Analysis Datasetcited by 0
  24. 2025Seeing What You Say: Expressive Image Generation from Speechcited by 0