QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelity
Not on the map. Why?
Abstract (arXiv)
The mechanism of existing style transfer algorithms is by minimizing a hybrid loss function to push the generated image toward high similarities in both content and style. However, this type of approach cannot guarantee visual fidelity, i.e., the generated artworks should be indistinguishable from real ones. In this paper, we devise a new style transfer framework called QuantArt for high visual-fidelity stylization. QuantArt pushes the latent representation of the generated artwork toward the centroids of the real artwork distribution with vector quantization. By fusing the quantized and continuous latent representations, QuantArt allows flexible control over the generated artworks in terms of content preservation, style similarity, and visual fidelity. Experiments on various style transfer settings show that our QuantArt framework achieves significantly higher visual fidelity compared with the existing style transfer methods.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 56 of its 69 references that are in the map. First posted on arXiv 20 Dec 2022.
Builds on
56 of 69 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
38 more
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 656
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2016A Learned Representation For Artistic Stylecited by 340
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2017Neural Style Transfer: A Reviewcited by 199
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2017Deep Photo Style Transfercited by 168
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2017Visual Attribute Transfer through Deep Image Analogycited by 123
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 102
- 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
- 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
- 2021Domain-Aware Universal Style Transfercited by 40
- 2019Ultrafast Photorealistic Style Transfer via Neural Architecture Searchcited by 39
- 2021DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfercited by 38
- 2020Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfercited by 31
- 2020Real-time Localized Photorealistic Video Style Transfercited by 24
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2023: 7; 2024: 5; 2025: 5; 2026: 1.
18 papers.
Sort:
By area:
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
- 2023InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Advisercited by 17
- 2023Z^*: Zero-shot Style Transfer via Attention Rearrangementcited by 17
- 2023Learning to Evaluate the Artness of AI-generated Imagescited by 10
- 2024StyleMamba : State Space Model for Efficient Text-driven Image Style Transfercited by 5
- 2024Evaluation in Neural Style Transfer: A Reviewcited by 4
- 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfercited by 4
- 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Modelcited by 4
- 2023Painterly Image Harmonization by Learning from Painterly Objectscited by 3
- 2025Voxify3D: Pixel Art Meets Volumetric Renderingcited by 3
- 2023Optimal Image Transport on Sparse Dictionariescited by 1
6 more
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Stylescited by 1
- 2024Harnessing the Latent Diffusion Model for Training-Free Image Style Transfercited by 1
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priorscited by 1
- 2024Bridging Text and Image for Artist Style Transfer via Contrastive Learningcited by 0
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillationcited by 0
- 2025Pluggable Style Representation Learning for Multi-Style Transfercited by 0
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2025Voxify3D: Pixel Art Meets Volumetric Rendering8 Dec 2025
- 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Model8 Apr 2025
- 2025Pluggable Style Representation Learning for Multi-Style Transfer26 Mar 2025
- 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfer6 Mar 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2024Bridging Text and Image for Artist Style Transfer via Contrastive Learning12 Oct 2024
- 2024Harnessing the Latent Diffusion Model for Training-Free Image Style Transfer2 Oct 2024
- 2024StyleMamba : State Space Model for Efficient Text-driven Image Style Transfer8 May 2024
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splatting8 Apr 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Styles15 Dec 2023
6 more
- 2023Painterly Image Harmonization by Learning from Painterly Objects15 Dec 2023
- 2023Z^*: Zero-shot Style Transfer via Attention Rearrangement25 Nov 2023
- 2023InstaStyle: Inversion Noise of a Stylized Image is Secretly a Style Adviser25 Nov 2023
- 2023Optimal Image Transport on Sparse Dictionaries3 Nov 2023
- 2023StyleDrop: Text-to-Image Generation in Any Style1 Jun 2023
- 2023Learning to Evaluate the Artness of AI-generated Images8 May 2023
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splattingcited by 23
- 2023Learning to Evaluate the Artness of AI-generated Imagescited by 10
- 2024StyleMamba : State Space Model for Efficient Text-driven Image Style Transfercited by 5
- 2024Evaluation in Neural Style Transfer: A Reviewcited by 4
- 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfercited by 4
- 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Modelcited by 4
- 2023Painterly Image Harmonization by Learning from Painterly Objectscited by 3
- 2025Voxify3D: Pixel Art Meets Volumetric Renderingcited by 3
- 2023Optimal Image Transport on Sparse Dictionariescited by 1
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Stylescited by 1
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priorscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2025Voxify3D: Pixel Art Meets Volumetric Rendering8 Dec 2025
- 2025A Training-Free Style-aligned Image Generation with Scale-wise Autoregressive Model8 Apr 2025
- 2025Pluggable Style Representation Learning for Multi-Style Transfer26 Mar 2025
- 2025SCSA: A Plug-and-Play Semantic Continuous-Sparse Attention for Arbitrary Semantic Style Transfer6 Mar 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2024Bridging Text and Image for Artist Style Transfer via Contrastive Learning12 Oct 2024
- 2024StyleMamba : State Space Model for Efficient Text-driven Image Style Transfer8 May 2024
- 2024StylizedGS: Controllable Stylization for 3D Gaussian Splatting8 Apr 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Styles15 Dec 2023
- 2023Painterly Image Harmonization by Learning from Painterly Objects15 Dec 2023
12 newest of 15 All 15 (JSON)