mlsanityData to 14 Oct 2026

LEAST: "Local" text-conditioned image style transfer

arXiv 2405.16330 ↗First posted 25 May 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-conditioned style transfer enables users to communicate their desired artistic styles through text descriptions, offering a new and expressive means of achieving stylization. In this work, we evaluate the text-conditioned image editing and style transfer techniques on their fine-grained understanding of user prompts for precise "local" style transfer. We find that current methods fail to accomplish localized style transfers effectively, either failing to localize style transfer to certain regions in the image, or distorting the content and structure of the input image. To this end, we develop an end-to-end pipeline for "local" style transfer tailored to align with users' intent. Further, we substantiate the effectiveness of our approach through quantitative and qualitative analysis. The project code is available at: https://github.com/silky1708/local-style-transfer.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 31 references that are in the map. First posted on arXiv 25 May 2024.

Builds on

28 of 31 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2023Segment Anythingcited by 8,234
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  12. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
16 more
  1. 2023Zero-shot Image-to-Image Translationcited by 505
  2. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  3. 2022Inversion-Based Style Transfer with Diffusion Modelscited by 291
  4. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 287
  5. 2021CLIPstyler: Image Style Transfer with a Single Text Conditioncited by 203
  6. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  7. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
  8. 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 155
  9. 2023Expressive Text-to-Image Generation with Rich Textcited by 89
  10. 2023Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfercited by 59
  11. 2021Language-Driven Image Style Transfercited by 37
  12. 2022Name Your Style: An Arbitrary Artist-aware Image Style Transfercited by 14
  13. 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
  14. 2023ITstyler: Image-optimized Text-based Style Transfercited by 3
  15. 2023MOSAIC: Multi-Object Segmented Arbitrary Stylization Using CLIPcited by 2
  16. 2023Sem-CS: Semantic CLIPStyler for Text-Based Image Style Transfercited by 1

Built on by

Not cited yet.