mlsanityData to 14 Oct 2026

One-Shot Structure-Aware Stylized Image Synthesis

arXiv 2402.17275 ↗First posted 27 Feb 2024cs.CVcited by 14

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

While GAN-based models have been successful in image stylization tasks, they often struggle with structure preservation while stylizing a wide range of input images. Recently, diffusion models have been adopted for image stylization but still lack the capability to maintain the original quality of input images. Building on this, we propose OSASIS: a novel one-shot stylization method that is robust in structure preservation. We show that OSASIS is able to effectively disentangle the semantics from the structure of an image, allowing it to control the level of content and style implemented to a given input. We apply OSASIS to various experimental settings, including stylization with out-of-domain reference images and stylization with text-driven manipulation. Results show that OSASIS outperforms other stylization methods, especially for input images that were rarely encountered during training, providing a promising solution to stylization via diffusion models.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 46 references that are in the map. First posted on arXiv 27 Feb 2024.

Builds on

38 of 46 references.

Closest ancestors · 4

Same direction, newest first

  1. 2022Inversion-Based Style Transfer with Diffusion Models23 Nov
  2. 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  4. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation6 Oct

Other references · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  11. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
22 more
  1. 2018Group Normalizationcited by 1,524
  2. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  3. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  4. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  5. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
  6. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  7. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
  8. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  9. 2022Diffusion Models already have a Semantic Latent Spacecited by 328
  10. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  11. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  12. 2021Few-shot Image Generation via Cross-domain Correspondencecited by 207
  13. 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
  14. 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
  15. 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70
  16. 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
  17. 2021JoJoGAN: One Shot Face Stylizationcited by 49
  18. 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
  19. 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
  20. 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
  21. 2022Towards Diverse and Faithful One-shot Adaption of Generative Adversarial Networkscited by 23
  22. 2023In-N-Out: Faithful 3D GAN Inversion with Volumetric Decomposition for Face Editingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 4; 2026: 6.

14 papers.

Sort:

By area:

  1. 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
  2. 2025ConsisLoRA: Enhancing Content and Style Consistency for LoRA-based Style Transfercited by 9
  3. 2025Domain Generalizable Portrait Style Transfercited by 3
  4. 2024ZePo: Zero-Shot Portrait Stylization with Faster Samplingcited by 2
  5. 2026Semi-supervised Latent Disentangled Diffusion Model for Textile Pattern Generationcited by 2
  6. 2024WikiStyle+: A Multimodal Approach to Content-Style Representation Disentanglement for Artistic Image Stylizationcited by 1
  7. 2024FAGStyle: Feature Augmentation on Geodesic Surface for Zero-shot Text-guided Diffusion Image Style Transfercited by 0
  8. 2024Structure-Aware Stylized Image Synthesis for Robust Medical Image Segmentationcited by 0
  9. 2025One-shot Face Sketch Synthesis in the Wild via Generative Diffusion Prior and Instruction Tuningcited by 0
  10. 2026Enhancing Image Aesthetics with Dual-Conditioned Diffusion Models Guided by Multimodal Perceptioncited by 0
  11. 2026Cross-Domain Vessel Segmentation via Latent Similarity Mining and Iterative Co-Optimizationcited by 0
  12. 2026Texture-Shape Bias Balancing for Robust Synthetic-to-Real Semantic Segmentation in Automotive NIR Imagerycited by 0
2 more
  1. 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfercited by 0
  2. 2026SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylizationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Staying True to the Origin: Continuous Image Stylization with Smooth Transitions
  2. 2025Balanced Image Stylization with Style Matching Score
  3. 2024DiffArtist: Towards Structure and Appearance Controllable Image Stylization
  4. 2026Local Content-Style Control for Diffusion-based Image Stylization
  5. 2023Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting
  6. 2025Leveraging Diffusion Models for Stylization using Multiple Style Images
  7. 2025Training-free Stylized Text-to-Image Generation with Fast Inference
  8. 2025A Style is Worth One Code: Unlocking Code-to-Style Image Generation with Discrete Style Space