Evaluation in Neural Style Transfer: A Review
Not on the map. Why?
Abstract (arXiv)
The field of Neural Style Transfer (NST) has witnessed remarkable progress in the past few years, with approaches being able to synthesize artistic and photorealistic images and videos of exceptional quality. To evaluate such results, a diverse landscape of evaluation methods and metrics is used, including authors' opinions based on side-by-side comparisons, human evaluation studies that quantify the subjective judgements of participants, and a multitude of quantitative computational metrics which objectively assess the different aspects of an algorithm's performance. However, there is no consensus regarding the most suitable and effective evaluation procedure that can guarantee the reliability of the results. In this review, we provide an in-depth analysis of existing evaluation techniques, identify the inconsistencies and limitations of current evaluation methods, and give recommendations for standardized evaluation practices. We believe that the development of a robust evaluation framework will not only enable more meaningful and fairer comparisons among NST methods but will also enhance the comprehension and interpretation of research findings in the field.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 80 of its 130 references that are in the map. First posted on arXiv 30 Jan 2024.
Builds on
80 of 130 references.
References · 80
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2021GPT Understands, Toocited by 715
38 more
- 2015Holistically-Nested Edge Detectioncited by 590
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2017NIMA: Neural Image Assessmentcited by 387
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2016A Learned Representation For Artistic Stylecited by 340
- 2018Learning Blind Video Temporal Consistencycited by 247
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2017Neural Style Transfer: A Reviewcited by 199
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
- 2016Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networkscited by 192
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2016Single-Image Depth Perception in the Wildcited by 179
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 173
- 2017Deep Photo Style Transfercited by 168
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2017DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networkscited by 156
- 2017Demystifying Neural Style Transfercited by 152
- 2016Richer Convolutional Features for Edge Detectioncited by 141
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2021ArtEmis: Affective Language for Visual Artcited by 103
- 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
- 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2014Salient Object Detection: A Discriminative Regional Feature Integration Approachcited by 89
- 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
- 2017Exploring the structure of a real-time, arbitrary neural artistic stylization networkcited by 89
- 2020Arbitrary Video Style Transfer via Multi-Channel Correlationcited by 84
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2020Understanding SSIMcited by 75
- 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
- 2013Recognizing Image Stylecited by 64
- 2017Multi-style Generative Network for Real-time Transfercited by 61
- 2019Exploiting temporal consistency for real-time video depth estimationcited by 61
- 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
- 2018A Style-Aware Content Loss for Real-time HD Style Transfercited by 58
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024SGSST: Scaling Gaussian Splatting StyleTransfercited by 20
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfercited by 1
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillationcited by 0
- 2025Few-shot multi-token DreamBooth with LoRa for style-consistent character generationcited by 0
- 2025LouvreSAE: Sparse Autoencoders for Interpretable and Controllable Style Transfer22 Dec 2025
- 2025Few-shot multi-token DreamBooth with LoRa for style-consistent character generation10 Oct 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2024SGSST: Scaling Gaussian Splatting StyleTransfer4 Dec 2024