mlsanityData to 7 Oct 2026

S2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attention

arXiv 2210.12381 ↗First posted 22 Oct 2022cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Transformer's recent integration into style transfer leverages its proficiency in establishing long-range dependencies, albeit at the expense of attenuated local modeling. This paper introduces Strips Window Attention Transformer (S2WAT), a novel hierarchical vision transformer designed for style transfer. S2WAT employs attention computation in diverse window shapes to capture both short- and long-range dependencies. The merged dependencies utilize the "Attn Merge" strategy, which adaptively determines spatial weights based on their relevance to the target. Extensive experiments on representative datasets show the proposed method's effectiveness compared to state-of-the-art (SOTA) transformer-based and other approaches. The code and pre-trained models are available at https://github.com/AlienZhang1996/S2WAT.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 80 of its 105 references that are in the map. First posted on arXiv 22 Oct 2022.

Builds on

80 of 105 references.

References · 80

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  8. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  9. 2020End-to-End Object Detection with Transformerscited by 7,384
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  11. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  12. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
38 more
  1. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  2. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  3. 2020Longformer: The Long-Document Transformercited by 3,362
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  6. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  7. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  8. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  9. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  10. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  11. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  13. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  14. 2020On Layer Normalization in the Transformer Architecturecited by 906
  15. 2021Multiscale Vision Transformerscited by 896
  16. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  17. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  18. 2021Transformer in Transformercited by 632
  19. 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
  20. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
  21. 2015A Neural Algorithm of Artistic Stylecited by 480
  22. 2022MaxViT: Multi-Axis Vision Transformercited by 476
  23. 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
  24. 2020End-to-End Video Instance Segmentation with Transformerscited by 443
  25. 2017Universal Style Transfer via Feature Transformscited by 352
  26. 2016A Learned Representation For Artistic Stylecited by 340
  27. 2017Relation Networks for Object Detectioncited by 305
  28. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  29. 2019Local Relation Networks for Image Recognitioncited by 210
  30. 2020UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Trainingcited by 204
  31. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  32. 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
  33. 2021StyTr2: Image Style Transfer with Transformerscited by 186
  34. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  35. 2021Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformercited by 175
  36. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
  37. 2016Long Short-Term Memory-Networks for Machine Readingcited by 161
  38. 2017Demystifying Neural Style Transfercited by 152

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 0; 2025: 9; 2026: 3.

14 papers.

Sort:

By area:

  1. 2023Z^*: Zero-shot Style Transfer via Attention Rearrangementcited by 17
  2. 2025SaMam: Style-aware State Space Model for Arbitrary Image Style Transfercited by 5
  3. 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfercited by 4
  4. 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Stylescited by 4
  5. 2025Training-free Stylized Text-to-Image Generation with Fast Inferencecited by 2
  6. 2025HSI: A Holistic Style Injector for Arbitrary Style Transfercited by 1
  7. 2025Leveraging Diffusion Models for Stylization using Multiple Style Imagescited by 1
  8. 2025UI-Styler: Ultrasound Image Style Transfer with Class-Aware Prompts for Cross-Device Diagnosis Using a Frozen Black-Box Inference Networkcited by 1
  9. 2023Edge Enhanced Image Style Transfer via Transformerscited by 0
  10. 2025Pluggable Style Representation Learning for Multi-Style Transfercited by 0
  11. 2025TRUST: Token-dRiven Ultrasound Style Transfer for Cross-Device Adaptationcited by 0
  12. 2026AnyStyle: Single-Pass Multimodal Stylization for 3D Gaussian Splattingcited by 0
2 more
  1. 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfercited by 0
  2. 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Modelcited by 0