mlsanityData to 7 Oct 2026

QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelity

arXiv 2212.10431 ↗First posted 20 Dec 2022cs.CV cs.LG cs.MMcited by 18

Not on the map. Why?

Abstract (arXiv)

The mechanism of existing style transfer algorithms is by minimizing a hybrid loss function to push the generated image toward high similarities in both content and style. However, this type of approach cannot guarantee visual fidelity, i.e., the generated artworks should be indistinguishable from real ones. In this paper, we devise a new style transfer framework called QuantArt for high visual-fidelity stylization. QuantArt pushes the latent representation of the generated artwork toward the centroids of the real artwork distribution with vector quantization. By fusing the quantized and continuous latent representations, QuantArt allows flexible control over the generated artworks in terms of content preservation, style similarity, and visual fidelity. Experiments on various style transfer settings show that our QuantArt framework achieves significantly higher visual fidelity compared with the existing style transfer methods.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 20 Dec 2022.

Builds on

56 of 69 references.

References · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2017Neural Discrete Representation Learningcited by 4,650
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
38 more
  1. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  2. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  3. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  4. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  5. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  6. 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
  7. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  8. 2017Universal Style Transfer via Feature Transformscited by 352
  9. 2016A Learned Representation For Artistic Stylecited by 340
  10. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  11. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  12. 2017Neural Style Transfer: A Reviewcited by 199
  13. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
  14. 2021StyTr2: Image Style Transfer with Transformerscited by 186
  15. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  16. 2017Deep Photo Style Transfercited by 168
  17. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
  18. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  19. 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
  20. 2017Visual Attribute Transfer through Deep Image Analogycited by 123
  21. 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
  22. 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
  23. 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
  24. 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 102
  25. 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
  26. 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
  27. 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
  28. 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
  29. 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
  30. 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
  31. 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
  32. 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
  33. 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
  34. 2021Domain-Aware Universal Style Transfercited by 40
  35. 2019Ultrafast Photorealistic Style Transfer via Neural Architecture Searchcited by 39
  36. 2021DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfercited by 38
  37. 2020Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfercited by 31
  38. 2020Real-time Localized Photorealistic Video Style Transfercited by 24

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 5; 2025: 5; 2026: 1.

18 papers.

Sort:

By area: